Spaces:

lucalp
/

blt-entropy-patcher

Running on Zero

Commit History

Srinivasan Iyer

sviyer commited on Apr 8

par-meta commited on Apr 1

par-meta commited on Mar 13

par-meta commited on Mar 11

par-meta commited on Mar 5

par-meta commited on Mar 5

par-meta commited on Feb 25

par-meta commited on Feb 22

par-meta commited on Feb 18

par-meta commited on Feb 13

par-meta commited on Feb 6

par-meta commited on Feb 6

par-meta commited on Jan 28

par-meta commited on Jan 27

par-meta commited on Jan 24

par-meta commited on Jan 17

par-meta commited on Jan 10

par-meta commited on Dec 12, 2024

Commit History

Fix eval mask (#93) 19a3f75 unverified

Get generation working for BLT (#86) b79eb3e unverified

Update ppl evals to work with blt model, in addition to entropy model (#82) 083656c unverified

Get evals working again. (#46) 7517ac2 unverified

Reduce per file resources arrow uses (#77) 63913e4 unverified

Add approximate state persistence (#73) ea1fc75 unverified

Remove byte tokenizer and add config args to switch between byte/patch packing (#68) aeb95f1 unverified

Update iterator inheritance, pass file format args, limit iterator (#63) fc3399e unverified

Make it possible to specify multiple config files (#54) 82ab593 unverified

Fix multiprocessing dataloader checkpointing and use it in the train script (#50) 8c61ab5 unverified

Allow ArrowIterator to read from json (#45) 936d943 unverified

Update checkpointing to use fsspec (#39) afedb16 unverified

This includes fixes that make checkpointing and reloading work correctly. (#35) 7044771 unverified

Initial codes and scripts for training entropy model (#34) 7622d28 unverified

Use load_async flag to not start MP iterator (#33) a809259 unverified

Changes for training entropy model and correcting attention in local models (#25) 6ffeb66 unverified

Replace regular filesystem calls with fsspec + add s3 support (#18) b0120da unverified

Initial commit bcc039b

Fix eval mask (#93)

19a3f75
unverified

Get generation working for BLT (#86)

b79eb3e
unverified

Update ppl evals to work with blt model, in addition to entropy model (#82)

083656c
unverified

Get evals working again. (#46)

7517ac2
unverified

Reduce per file resources arrow uses (#77)

63913e4
unverified

Add approximate state persistence (#73)

ea1fc75
unverified

Remove byte tokenizer and add config args to switch between byte/patch packing (#68)

aeb95f1
unverified

Update iterator inheritance, pass file format args, limit iterator (#63)

fc3399e
unverified

Make it possible to specify multiple config files (#54)

82ab593
unverified

Fix multiprocessing dataloader checkpointing and use it in the train script (#50)

8c61ab5
unverified

Allow ArrowIterator to read from json (#45)

936d943
unverified

Update checkpointing to use fsspec (#39)

afedb16
unverified

This includes fixes that make checkpointing and reloading work correctly. (#35)

7044771
unverified

Initial codes and scripts for training entropy model (#34)

7622d28
unverified

Use load_async flag to not start MP iterator (#33)

a809259
unverified

Changes for training entropy model and correcting attention in local models (#25)

6ffeb66
unverified

Replace regular filesystem calls with fsspec + add s3 support (#18)

b0120da
unverified

Initial commit

bcc039b