Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,506

Full-text search

Active filters: 6-bit

Darkhn/L3.3-Damascus-R1-6.0bpw-h8-exl2

Text Generation • Updated Feb 6 • 33 • 1

LoneStriker/DeepSeek-R1-Distill-Llama-70B-6.0bpw-h6-exl2

Text Generation • Updated Feb 2 • 9 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q6_K-GGUF

Text Generation • Updated Feb 3 • 5 • 1

MaziyarPanahi/Qwen2.5-14B-Instruct-1M-GGUF

Text Generation • Updated Feb 8 • 98 • 2

MikeRoz/cognitivecomputations_Dolphin3.0-Mistral-24B-6.0bpw-h6-exl2

Text Generation • Updated Feb 9 • 20 • 1

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • Updated Feb 10 • 96 • 1

ordis-co-ltd/Qwen2.5-VL-72B-Instruct_exl2_6.0bpw

Image-Text-to-Text • Updated Feb 10 • 13 • 2

MaziyarPanahi/DarkIdol-LongWriter-8B-Uncensored-1048k-GGUF

Text Generation • Updated Feb 12 • 119 • 1

MaziyarPanahi/german-r1-GGUF

Text Generation • Updated Feb 12 • 88 • 1

logicbeat/Qwen2.5-Coder-3B-Q6-mlx

Text Generation • Updated Feb 13 • 8 • 1

ReadyArt/Cydonia-24B-v2_EXL2_6bpw_H8

Updated Feb 15 • 7 • 1

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • Updated Feb 14 • 102 • 1

MaziyarPanahi/To-the-end-of-this-earth-MN-12B-GGUF

Text Generation • Updated Feb 14 • 16 • 1

mlx-community/zed-industries-zeta-6bit

Updated Feb 16 • 19 • 1

MaziyarPanahi/UIGEN-7B-16bit-GGUF

Text Generation • Updated Feb 16 • 84 • 1

MaziyarPanahi/Ayla-Light-12B-v2-GGUF

Text Generation • Updated Feb 16 • 75 • 2

mlx-community/Qwen2.5-Coder-1.5B-Instruct-Q6

Text Generation • Updated Feb 18 • 152 • 1

MaziyarPanahi/Ayla-Light-12B-Stock-GGUF

Text Generation • Updated Feb 18 • 61 • 1

mlx-community/Lamarck-14B-v0.7-6bit

Text Generation • Updated Feb 19 • 7 • 1

riveRiPH/Captain-Eris_Violet-GRPO-v0.420-6bpw-h8-exl2

Text Generation • Updated Feb 19 • 9 • 1

MikeRoz/LatitudeGames_Wayfarer-Large-70B-Llama-3.3-6.0bpw-h6-exl2

Text Generation • Updated Feb 20 • 8 • 1

Darkhn/L3.3-Cu-Mai-R1-70b-6.0bpw-h8-exl2

Updated Feb 20 • 5 • 1

mlx-community/Wayfarer-12B-6bit

Text Generation • Updated Feb 20 • 6 • 1

MaziyarPanahi/SmolLM2-1.7B-Instruct-16k-GGUF

Text Generation • Updated Feb 21 • 80 • 1

MaziyarPanahi/ALLaM-7B-Instruct-preview-reasoning-GGUF

Text Generation • Updated Feb 21 • 91 • 1

mlx-community/dans-dangerouswinds-v1.1.1-24b-6bit

Updated Feb 22 • 4 • 1

MaziyarPanahi/Lamarck-14B-v0.7-Fusion-GGUF

Text Generation • Updated Feb 23 • 82 • 1

MaziyarPanahi/Viper-Coder-HybridMini-v1.3-GGUF

Text Generation • Updated Feb 23 • 91 • 1

MaziyarPanahi/DeepSeek-R1-Distill-Llama-3B-GGUF

Text Generation • Updated Feb 24 • 451 • 1

mlx-community/perplexity-ai-r1-1776-6bit

Updated Feb 25 • 12 • 1