L4Q: Parameter Efficient Quantization-Aware Training on Large Language Models via LoRA-wise LSQ
Paper
•
2402.04902
•
Published
•
4
Minyoung Choi
myconejo
AI & ML interests
NLP, Transformers, Multimodal Models, Large Language Models, Vision Transformers, Reinforcement Learning
Organizations
None yet
upvoted
7
papers
over 1 year ago
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
189
Honeybee: Locality-enhanced Projector for Multimodal LLM
Paper
•
2312.06742
•
Published
•
15
MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
Paper
•
2403.09611
•
Published
•
129
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Paper
•
2404.14219
•
Published
•
259
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper
•
2312.11514
•
Published
•
260
Llama 2: Open Foundation and Fine-Tuned Chat Models
Paper
•
2307.09288
•
Published
•
247