Update README.md
Browse files
README.md
CHANGED
|
@@ -4,4 +4,4 @@ datasets:
|
|
| 4 |
- EleutherAI/fineweb-edu-dedup-10b
|
| 5 |
---
|
| 6 |
|
| 7 |
-
We trained these skip-transcoders using signum, over 1B tokens.
|
|
|
|
| 4 |
- EleutherAI/fineweb-edu-dedup-10b
|
| 5 |
---
|
| 6 |
|
| 7 |
+
We trained these skip-transcoders using signum, over 1B tokens. Trained with input and output normalized.
|