Multilingual SFT & DPO Datasets

nthakur 's Collections

🏜️MIRAGE-Bench [NAACL'25]

🌐 NoMIRACL Dataset [EMNLP'24]

🦢SWIM-IR Dataset [NAACL'24]

GPL BEIR Datasets [NAACL'22]

updated Mar 31

These SFT or DPO datasets were translated from English using the Mistral-7B-Instruct-v0.2 or taken from other sources.

Upvote

nthakur/multilingual-deita-10k-v0-sft-v0.1

Viewer • Updated Aug 9, 2024 • 24.4k • 23

Note SFT Dataset containing multi-turn conversations in 9 languages by translating the `deita-10k-v0-instruct` dataset
nthakur/Bactrian-X-23-lang-instruct

Viewer • Updated Mar 21, 2024 • 1.54M • 77

Note SFT Dataset, which is a ported version of `MBZUAI/Bactrian-X` dataset for 23 languages.
nthakur/GSM8KInstruct-Parallel-instruct

Viewer • Updated Mar 21, 2024 • 73.6k • 38

Note SFT Dataset containing mathematical formulae in 10 languages (including english) formed by translating the GSM8KInstruct dataset.
nthakur/ultrachat-200k-instruct

Viewer • Updated Mar 21, 2024 • 231k • 48

Note SFT Dataset: containing 200k training pairs in English from the ultrachat dataset.
nthakur/multilingual-distilabel-intel-orca-dpo-pairs-v0.1

Viewer • Updated Mar 30, 2024 • 9.42k • 46

Note DPO Dataset: multilingual training pairs of the ORCA dpo dataset translated into 10 languages.
nthakur/GSM8KInstruct-Parallel-instruct-dpo-v0.1

Viewer • Updated Aug 11, 2024 • 70k • 19

Note DPO dataset for GSM8KInstruct, which has been translated into 10 languages + English.
nthakur/multilingual-truthy-dpo-pairs-v0.1

Viewer • Updated Mar 30, 2024 • 8.41k • 15

Note DPO Dataset using the english truthy dataset converted into multiple languages.
nthakur/multilingual-ultrafeedback-binarized-dpo-v0.1

Viewer • Updated Aug 11, 2024 • 76.4k • 28

Note DPO Dataset by translating the ultrafeedback-binarized dataset into multiple languages.

Upvote