from-our-page
/

llama3.1-8b-refinedbase-checkpoint-1280

Model card Files Files and versions Community

No model card

Downloads last month: 0

Safetensors

Model size

8.03B params

Tensor type

BF16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including from-our-page/llama3.1-8b-refinedbase-checkpoint-1280

llama3.1-8b-refinedbase v1

continued pretraining of llama3.1 8b on refinedweb for ~80M tokens to try to undo the annealing step and make it act more like an actual base model • 8 items • Updated Mar 28