6ca32ed 0bc2fcc
1
2
3
4
5
6
7
--- license: apache-2.0 datasets: - EleutherAI/fineweb-edu-dedup-10b --- We trained these skip-transcoders using signum, over 1B tokens. Trained with input and output normalized.