Aligning to Thousands of Preferences via System Message Generalization
Paper
•
2405.17977
•
Published
•
7
System Message Generalization
-
-
kaist-ai/Multifaceted-Collection
Viewer • Updated • 197k • 110 • 15 -
kaist-ai/janus-7b
Text Generation • Updated • 56 • 8 -
kaist-ai/Multifaceted-Bench
Viewer • Updated • 921 • 102 • 6 -
kaist-ai/Multifaceted-Collection-DPO
Viewer • Updated • 65.1k • 55 • 9 -
kaist-ai/janus-dpo-7b
Text Generation • Updated • 15 • 3 -
kaist-ai/Multifaceted-Collection-ORPO
Viewer • Updated • 64.6k • 61 • 10 -
kaist-ai/janus-orpo-7b
Text Generation • Updated • 1.35k • 2 -
kaist-ai/Multifaceted-Collection-RM
Viewer • Updated • 64.9k • 107 • 4 -
kaist-ai/janus-rm-7b
Updated • 64 • 4 -
kaist-ai/Multifaceted-Collection-small
Viewer • Updated • 65.7k • 25 • 5