Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,506

Full-text search

Active filters: 6-bit

mlx-community/Phi-4-mini-instruct-6bit

Text Generation • Updated Mar 5 • 112 • 1

MaziyarPanahi/Primal-Opus-14B-Optimus-v2-GGUF

Text Generation • Updated Mar 1 • 77 • 1

MaziyarPanahi/Phi-4-mini-instruct-GGUF

Text Generation • Updated Mar 1 • 245k • 4

mlx-community/QwQ-32B-6bit

Text Generation • Updated Mar 5 • 148 • 3

Dracones/QwQ-32B_exl2_6.0bpw

Text Generation • Updated Mar 6 • 7 • 1

MaziyarPanahi/QwQ-32B-GGUF

Text Generation • Updated Mar 7 • 244k • 3

mlx-community/gemma-2-9b-it-6bit

Text Generation • Updated Mar 6 • 43 • 1

MaziyarPanahi/Qwen-1M-DeepSeek-R1-14B-GGUF

Text Generation • Updated Mar 8 • 396 • 1

MaziyarPanahi/Glowing-Forest-12B-GGUF

Text Generation • Updated Mar 8 • 30 • 1

MaziyarPanahi/gemma-2-2b-fa-v2-GGUF

Text Generation • Updated Mar 9 • 39 • 1

mlx-community/miscii-14b-0218-6bit

Text Generation • Updated Mar 10 • 6 • 1

MaziyarPanahi/Llama-3.1-8B-SuperNova-EtherealHermes-GGUF

Text Generation • Updated Mar 11 • 58 • 1

mlx-community/Deductive-Reasoning-Qwen-32B-MLX-6bit

Text Generation • Updated Mar 11 • 13 • 1

MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF

Text Generation • Updated Mar 11 • 380 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-32B-GGUF

Text Generation • Updated Mar 11 • 299 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-14B-GGUF

Text Generation • Updated Mar 11 • 391 • 1

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • Updated Mar 12 • 265k • 6

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated Mar 12 • 252k • 6

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated Mar 16 • 251k • 4

mlx-community/c4ai-command-a-03-2025-6bit

Text Generation • Updated Mar 18 • 11 • 1

MaziyarPanahi/c4ai-command-a-03-2025-GGUF

Text Generation • Updated Mar 15 • 592 • 1

ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_6.0bpw_H8

Text Generation • Updated Mar 14 • 13 • 1

MaziyarPanahi/OLMo-2-0325-32B-Instruct-GGUF

Text Generation • Updated Mar 15 • 151 • 1

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • Updated Mar 18 • 244k • 2

gghfez/Mistral-Small-3.1-24B-Instruct-2503-novision-exl2-6bpw

Updated Mar 19 • 20 • 1

MaziyarPanahi/ByteCraft-GGUF

Text Generation • Updated Mar 20 • 93 • 1

mlx-community/orpheus-3b-0.1-ft-6bit

Text-to-Speech • Updated Mar 21 • 18 • 1

MaziyarPanahi/AURORAV0.3-4B-GGUF

Text Generation • Updated Mar 23 • 80 • 1

MaziyarPanahi/MN-Hekate-Enodia-12B-GGUF

Text Generation • Updated Mar 23 • 134 • 1

MaziyarPanahi/Malaysian-orpheus-3b-0.1-ft-GGUF

Text Generation • Updated Mar 23 • 112 • 1