EleutherAI
/

skip-transcoder-SmolLM2-135M-128x

Model card Files Files and versions

MrGonao commited on Apr 4

Commit

6ca32ed

·

verified ·

1 Parent(s): 19c4c0b

Create README.md

Files changed (1) hide show

README.md +7 -0

README.md ADDED Viewed

	@@ -0,0 +1,7 @@

+---
+license: apache-2.0
+datasets:
+- EleutherAI/fineweb-edu-dedup-10b
+---
+We trained these skip-transcoders using signum, over 1B tokens.