6
RegMix
📚
Generate regression predictions from CSV data
🧬 RegMix: Data Mixture as Regression
Automatic data mixture method for large language model pre-training
-
-
RegMix: Data Mixture as Regression for Language Model Pre-training
Paper • 2407.01492 • Published • 39 -
sail/data-mixture-human-1b
Text Generation • Updated • 23 • 3 -
sail/data-mixture-pile-cc-1b
Text Generation • Updated • 8 • 3 -
sail/data-mixture-regmix-1b
Text Generation • Updated • 5 • 2 -
sail/data-mixture-doremi-1b
Text Generation • Updated • 4 • 2 -
sail/data-mixture-random-1b
Text Generation • Updated • 3 • 4 -
sail/regmix-data-sample
Viewer • Updated • 698k • 162 • 2 -
sail/regmix-data
Viewer • Updated • 13.7M • 24.4k • 4