gpted / expand_llm.py

Commit History

Chunk size 16 -> 64
2d12d3d

mebubo commited on

Split big batches to avoid CUDA OOM
cefa0ab

mebubo commited on

Use the flagging threshold to filter out uninteresting tokens
0235f77

mebubo commited on

Fix performance by ignoring tokens with probabilities below a threshold
2bbbefa

mebubo commited on

Snapshot
e0f1806

mebubo commited on

println profiling
8f33f3e

mebubo commited on

Better names for Expander etc
4537742

mebubo commited on

Working probs in UI
308bca9

mebubo commited on

Working stopping on word boundary
3d1d657

mebubo commited on

Fix
c12f2c8

mebubo commited on

Snapshot
6f4449d

mebubo commited on

Working expand_llm
bb48904

mebubo commited on