Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

729

Full-text search

Active filters: orpo, trl

orpo-explorers/kaist-mistral-orpo-OHP-15k-Stratified-1-beta-0.2-1epoch-capybara-2epoch

Text Generation • Updated Apr 26, 2024 • 6

orpo-explorers/kaist-mistral-orpo-capybara-beta0.05-1epoch-ohp-15k-strat-1-beta0.2-2epoch

Text Generation • Updated Apr 26, 2024 • 6

orpo-explorers/kaist-mistral-orpo-capybara-ohp-3epoch-beta-0.2

Text Generation • Updated Apr 27, 2024 • 5

orpo-explorers/kaist-mistral-orpo-OHP-15k-Mathcode

Text Generation • Updated Apr 27, 2024 • 6

orpo-explorers/kaist-mistral-orpo-OHP-15k-Mathcode-1epoch-ohp-15k-strat-1-2epoch

Text Generation • Updated Apr 27, 2024 • 3

orpo-explorers/kaist-mistral-orpo-OHP-15k-Mathcode-2epoch-ohp-15k-strat-1-1epoch

Text Generation • Updated Apr 27, 2024 • 9

amarard/FinetunedOrpoLlama-3-8B

Text Generation • Updated Apr 27, 2024 • 3

cstr/phi-3-orpo-v8_16

Text Generation • Updated Apr 29, 2024 • 6

Ksgk-fy/aligner-v1-llama3-01

Updated Apr 30, 2024

ayoubkirouane/Phi-3-mini-4k-dolphin-orpo

Text Generation • Updated Apr 30, 2024 • 5

cstr/phi-3-orpo-v9_16

Text Generation • Updated May 1, 2024 • 6

cstr/phi-3-orpo-v9_4

Text Generation • Updated Apr 30, 2024 • 5 • 1

cstr/phi-3-orpo-v9_16-GGUF

Updated May 1, 2024 • 2

davanstrien/dataset-tldr

Text Generation • Updated Apr 30, 2024 • 7

C-Stuti/llama3-8b-orpo-unsloth-merged_v2

Text Generation • Updated Apr 30, 2024 • 5

jtatman/OrpoDolphin-3-8B-16k

Text Generation • Updated Apr 30, 2024 • 3

mradermacher/OrpoDolphin-3-8B-16k-GGUF

Updated May 5, 2024 • 51

davanstrien/LLama-3-dataset-tldr

Text Generation • Updated May 1, 2024 • 3

four-two-labs/tinyllama-moe-base-mix-orpo

Text Generation • Updated May 1, 2024 • 2

DuongTrongChi/opp

Text Generation • Updated May 3, 2024 • 2

zz-xx/gemma-7b-bnb-4bit-orpo-bias-merged-detection-16-bit

Text Generation • Updated May 3, 2024 • 7

LBK95/Llama-2-7b-hf-eval_threapist-ORPO-filtered-version-1

Updated May 5, 2024

vipinkatara/Mistral-7B-v0.1-orpo-final1

Text Generation • Updated May 7, 2024 • 6

LBK95/Llama-2-7b-hf-eval_threapist-ORPO-filtered-0.2-version-1

Updated May 8, 2024

nlee-208/inverted-orpo-mistral-capybara

Text Generation • Updated May 8, 2024 • 7

yl2342/llama3-8bing-orpo

Text Generation • Updated May 8, 2024 • 2

orpo-explorers/kaist-sft-mistral-OHP-15k-Stratified-1

Text Generation • Updated May 10, 2024 • 8

orpo-explorers/kaist-sft-mistral-OHP-15k-Stratified-1-fix

Text Generation • Updated May 10, 2024 • 7

cookinai/NeuralLlama-3-ORPO

Text Generation • Updated May 15, 2024 • 5

after-exams/deepseek-math-7b-rl-orpo-merged

Text Generation • Updated May 14, 2024 • 2