How to Train Data-Efficient LLMs
Paper
•
2402.09668
•
Published
•
43
LLM Pretrain
-
-
Adapting Large Language Models via Reading Comprehension
Paper • 2309.09530 • Published • 78 -
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper • 2403.03507 • Published • 189 -
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Paper • 2403.02884 • Published • 17 -
Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts
Paper • 2309.07430 • Published • 27 -
Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale
Paper • 2409.17115 • Published • 63