Spaces:

lucalp
/

blt-entropy-patcher

Running on Zero

App Files Files Community

blt-entropy-patcher / bytelatent /base_transformer.py

Commit History

Initialize rope embeddings properly for the entropy model (#72)

0da051f
unverified

Srinivasan Iyer

sviyer commited on Feb 25

Add vocab and seq len abstract fields (#66)

ff36aa8
unverified

par-meta commited on Feb 24

Make apex logs less noisy (#60)

b0956bd
unverified

par-meta commited on Feb 18

using apex rmsnorm (#57)

f3e8125
unverified

Srinivasan Iyer

sviyer commited on Feb 14

Fix init and repro (#48)

aebdc48
unverified

Srinivasan Iyer

sviyer commited on Feb 6

Add rope fp32 (#43)

739dc71
unverified

Srinivasan Iyer

sviyer commited on Feb 6

Changes for training entropy model and correcting attention in local models (#25)

6ffeb66
unverified

par-meta commited on Jan 17

allow flex-attention to be disabled (#19)

caec8d2
unverified

Ink commited on Jan 14

Initial commit

bcc039b

par-meta commited on Dec 12, 2024