File size: 179 Bytes
6ca32ed
 
 
 
 
 
0bc2fcc
1
2
3
4
5
6
7
---
license: apache-2.0
datasets:
- EleutherAI/fineweb-edu-dedup-10b
---

We trained these skip-transcoders using signum, over 1B tokens. Trained with input and output normalized.