Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / tests

Ctrl+K

Ctrl+K

100 contributors

History: 52 commits

winglian's picture

Support Sample packing for phi arch (#586)

12a2dbb unverified over 1 year ago

e2e
Support Sample packing for phi arch (#586) over 1 year ago
fixtures
fix test fixture b/c hf trainer tokenization changed (#464) over 1 year ago
monkeypatch
Attention mask and position id fixes for packing (#285) over 1 year ago
test_data.py

2.23 kB

Fix pretraining with iterable/streaming Dataset (#556) over 1 year ago
test_dict.py

3.17 kB

fix DefaultDict.__or__ over 1 year ago
test_expand_mask.py

1.43 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
test_packed_dataset.py

2.28 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
test_prompt_tokenizers.py

8.19 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
test_prompters.py

4.39 kB

Attention mask and position id fixes for packing (#285) over 1 year ago
test_tokenizers.py

860 Bytes

simplify `load_tokenizer` over 1 year ago
test_validation.py
9.23 kB

recommend padding when using sample packing (#531) over 1 year ago