Article
Improving Hugging Face Training Efficiency Through Packing with Flash Attention 2
- +4
RQlee, ArthurZ, achikundu, lwtr, rganti, mayank-mishra
• • 41Mayank Mishra
mayank-mishra
AI & ML interests
Large Language Models, Distributed Training and Inference
Recent Activity
updated a model about 2 months ago
mayank-mishra/hybrid-mamba2-7b published a model about 2 months ago
mayank-mishra/hybrid-mamba2-7b upvoted a collection 2 months ago
M2RNNOrganizations
published an article over 1 year ago
published an article almost 2 years ago
Article
Saving Memory Using Padding-Free Transformer Layers during Finetuning
mayank-mishra
• • 21 published an article about 2 years ago
Article
Aurora-M: The First Open Source Biden-Harris Executive Order Red teamed Multilingual Language Model
mayank-mishra
• • 7