Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

711

Full-text search

Active filters: orpo, trl

HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1

Text Generation • Updated Apr 18, 2024 • 3.38k • 267

mlx-community/zephyr-orpo-141b-A35b-v0.1-4bit

Updated Apr 12, 2024 • 21 • 2

trl-lib/Qwen2-0.5B-ORPO

Text Generation • Updated Oct 11, 2024 • 6 • 2

mradermacher/poemma-12B-GGUF

Updated Nov 9, 2024 • 156 • 2

Goekdeniz-Guelmez/josie-7b-v6.0-step2000

Text Generation • Updated Dec 11, 2024 • 8 • 2

Aratako/Llama-Gemma-2-27b-ORPO-iter3

Text Generation • Updated Dec 16, 2024 • 3 • 1

Aratako/Llama-Gemma-2-27b-ORPO-iter3-5.8bpw

Text Generation • Updated Dec 16, 2024 • 4 • 2

mradermacher/Llama-Gemma-2-27b-ORPO-iter3-GGUF

Updated Mar 9 • 50 • 1

mradermacher/josie-7b-v6.0-step2000-GGUF

Updated Mar 19 • 105 • 1

RsGoksel/DPO_Belge_Model

Text Generation • Updated about 1 month ago • 7 • 1

mradermacher/DPO_Belge_Model-GGUF

Updated 29 days ago • 254 • 1

alvarobartt/Mistral-7B-v0.1-ORPO

Text Generation • Updated Mar 23, 2024 • 6 • 14

alvarobartt/Mistral-7B-v0.1-ORPO-PEFT

Text Generation • Updated Mar 23, 2024 • 4 • 1

anakin87/gemma-2b-orpo

Text Generation • Updated May 6, 2024 • 21 • 28

alvarobartt/mistral-orpo-mix

Text Generation • Updated Mar 24, 2024 • 3 • 1

bartowski/Mistral-7B-v0.1-ORPO-exl2

Text Generation • Updated Mar 24, 2024

bartowski/Mistral-7B-v0.1-ORPO-GGUF

Text Generation • Updated Mar 24, 2024 • 482 • 1

alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt

Text Generation • Updated Mar 26, 2024 • 5

alvarobartt/mistral-orpo-mix-b0.05-l1024-pl512-lr5e-7-cosine

Text Generation • Updated Mar 26, 2024 • 6

alvarobartt/mistral-7b-orpo-alignment-handbook

Text Generation • Updated Mar 27, 2024 • 4

alvarobartt/mistral-7b-orpo-airoboros-pref-10k

Text Generation • Updated Mar 28, 2024 • 9

mradermacher/mistral-7b-orpo-capybara-reproduction-GGUF

Updated May 6, 2024 • 88

vain05/stablelm-2-1_6b-orpo-full-v1

Text Generation • Updated Apr 5, 2024 • 16

vain05/stablelm-2-1_6b-orpo-full-v2

Text Generation • Updated Apr 6, 2024 • 15

vain05/stablelm-2-1_6b-orpo-full-v3

Text Generation • Updated Apr 7, 2024 • 10

wandb/zephyr-orpo-7b-v0.2

Text Generation • Updated Apr 21, 2024 • 6 • 4

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw2.25

Text Generation • Updated Apr 12, 2024 • 4 • 1

DrishtiSharma/doplhin-2.1-mistral-7b-orpo-ultrafeedback-binarized-preferences

Updated Apr 12, 2024

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw2.5

Text Generation • Updated Apr 12, 2024 • 3

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3

Text Generation • Updated Apr 12, 2024 • 2