Commit History
re-enable DPO for tests in modal ci (#1374)
1f151c0
unverified
handle the system role too for chat templates (#1671)
b752080
unverified
Generalizing the chat_template prompt strategy (#1660) [skip ci]
cc11c6b
unverified
Keith Stevens
commited on
support for custom messages field in sharegpt (#1651)
bbfed31
unverified
Add KTO support (#1640)
22ae21a
unverified
feat: Add LLaMA-3 instruct prompt strategies for fine-tuning (#1553)
50421c8
unverified
improve tool handling roles (#1587)
cb78a36
unverified
ORPO Trainer replacement (#1551)
7d1d22f
unverified
fix pretraining_ on odd datasets (#1463)
586bd8d
unverified
fixes for dpo and orpo template loading (#1424)
7803f09
unverified
Feat: Add sharegpt multirole (#1137)
40a88e8
unverified
ORPO (#1419)
2ea70eb
unverified
add handling for argilla dpo-mix (#1397)
8a82d2e
unverified
Add Glaive conversation format support (#1365)
b7d8a7d
unverified
allow the sharegpt handler to also better handle datasets destined for openai finetuning (#1361)
2598c9f
unverified
plain input/output prompt strategy w/o chat templates (#1346)
4d09b42
unverified
add gemma instruct chat template (#1341)
c1a7b3d
unverified
Support user-defined prompt processing strategies for dpo (#1248)
1e3d530
unverified
Pretrain transforms (#1261)
c7cf381
unverified
relora: magnitude pruning of the optimizer (#1245)
8c2e05a
unverified
precompute dpo logprobs setting and fixes (#1199) [skip ci]
33e1170
unverified
Feat/chatml add system message (#1117)
98b4762
unverified
add ultrachat prompt strategies (#996)
ba043a3
unverified
Respect sequence_len in config for `type: llama2_chat` (#926)
f1de29d
unverified
fixing prompt template of chatml by removal of linebreak (#922)
03c6318
unverified
fixes for alpaca w chatml, and don't include attention_mask w mistral for flash attention (#728)
3553172
unverified
add support for defined train split (#654)
409ca0f
unverified
use fastchat conversations template (#578)
e7d3e2d
unverified
split completion text to sequence_len (#616)
97d3776
unverified
support custom field for completion from yml (#580)
f7a2263
unverified
feat: add Metharme prompt strategy (#446)
f474650
unverified
support user defined prompters, pretokenized datasets in config, local parquet, local arrow files (#348)
d2e7f27
unverified
fix orca prompts (#422)
1b7e860
unverified
Attention mask and position id fixes for packing (#285)
2bb0b78
unverified
Fix(message): Improve error message for bad format (#365)
e37d935
unverified
experimental llama 2 chat support (#296)
3392270
unverified
Jan Philipp Harries
Jan Philipp Harries
commited on
Added Orca Mini prompt strategy (#263)
c93655c
unverified
Jan Philipp Harries
Jan Philipp Harries
commited on
