Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,506

Full-text search

Active filters: 6-bit

riveRiPH/Violet_Magcap-12B-6bpw-h8-exl2

Updated 13 days ago • 5

mlx-community/GLM-Z1-9B-0414-abliterated-6bit

Text Generation • Updated 12 days ago • 28

cognitivecomputations/Dolphin-Llama3-8B-Instruct-exl2-6bpw

Updated 10 days ago • 2.38k

isogen/Mistral-Nemo-Instruct-2407-exl3-6bpw

Updated 11 days ago • 6

ReadyArt/GLM4-9B-Neon-v2_EXL2_6.0bpw_H8

Text Generation • Updated 11 days ago • 5

mlx-community/CodeLlama-7b-Instruct-hf-6bit-mlx

Text Generation • Updated 11 days ago • 8

gecfdo/Broken-Tutu-24B_EXL2_6.0bpw_H8

Text Generation • Updated 10 days ago • 23

mlx-community/CodeLlama-13b-hf-6bit-mlx

Text Generation • Updated 10 days ago • 7

Jellon/GLM4-9B-Neon-v2-exl2-6bpw

Text Generation • Updated 10 days ago • 1

MikeRoz/ArliAI_QwQ-32B-ArliAI-RpR-v3-6.0bpw-h8-exl2

Updated 10 days ago • 20

MetaphoricalCode/Omega-Darker_The-Final-Directive-24B_EXL2_6.0bpw_H8

Text Generation • Updated 5 days ago • 3

narpas/Alkahest-V9.2-Unhinged-RP-Alpha-V2-Llama-3.3-70B-6.0bpw-h8-exl2

Text Generation • Updated 10 days ago • 3

MikeRoz/allura-org_Gemma-3-Glitter-27B-6.0bpw-h8-exl2

Updated 9 days ago • 5

mlx-community/Qwen3-0.6B-6bit

Text Generation • Updated 9 days ago • 97

mlx-community/Qwen3-1.7B-6bit

Text Generation • Updated 9 days ago • 108

mlx-community/Qwen3-4B-6bit

Text Generation • Updated 9 days ago • 109

mlx-community/Qwen3-14B-6bit

Text Generation • Updated 9 days ago • 105

zerofata/L3.3-GeneticLemonade-Unleashed-v2.1-70B-6bpw-hb8-exl2

Text Generation • Updated 9 days ago • 13

mlx-community/Qwen3-32B-6bit

Text Generation • Updated 9 days ago • 173

MikeRoz/TheDrummer_Fallen-Gemma3-27B-v1-6.0bpw-h8-exl2

Updated 9 days ago • 3

mlx-community/Josiefied-Qwen3-0.6B-abliterated-v1-6bit

Text Generation • Updated 9 days ago • 5

mlx-community/Josiefied-Qwen3-1.7B-abliterated-v1-6bit

Text Generation • Updated 7 days ago • 6

Jellon/QwQ-32B-ArliAI-RpR-v3-exl2-6bpw

Updated 8 days ago • 8

Dundell391/Qwen3-32B_exl2_6.0bpw

Text Generation • Updated 8 days ago • 36

Jellon/Qwen3-32B-exl2-6bpw

Text Generation • Updated 8 days ago • 11

sleepdeprived3/Reformed-Baptist-1689-Bible-Expert-v2.0-12B_EXL2_6bpw_H8

Text Generation • Updated 7 days ago • 12

mlx-community/Phi-4-reasoning-6bit

Text Generation • Updated 7 days ago • 12

mlx-community/Phi-4-mini-reasoning-6bit

Text Generation • Updated 7 days ago • 20

prince-canuma/Phi-4-reasoning-Plus-6bit

Text Generation • Updated 7 days ago • 16

mlx-community/Josiefied-Qwen3-4B-abliterated-v1-6bit

Text Generation • Updated 7 days ago • 3