Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

614

Full-text search

Active filters: vllm

mistralai/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated 20 days ago • 75.1k • • 1.18k

mistralai/Mistral-Small-3.1-24B-Base-2503

Updated Mar 19 • 6.24k • 206

mistralai/Mistral-Small-24B-Instruct-2501

Text Generation • Updated Feb 2 • 896k • • 901

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Updated 4 days ago • 12.3k • 30

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated 29 days ago • 3.02k • 4

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated 29 days ago • 5.78k • 2

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated 29 days ago • 2.77k • 4

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • Updated 18 days ago • 51.8k • 315

mistralai/Pixtral-12B-2409

Image-Text-to-Text • Updated Dec 26, 2024 • • 631

mistralai/Ministral-8B-Instruct-2410

Updated Dec 6, 2024 • 79.4k • 482

mistralai/Mistral-Large-Instruct-2411

Updated Nov 19, 2024 • 5.03k • 217

RedHatAI/DeepSeek-R1-quantized.w4a16

Text Generation • Updated 6 days ago • 118 • 4

mistralai/Mistral-Large-Instruct-2407

Updated Oct 16, 2024 • 7.3k • 829

mistralai/Pixtral-12B-Base-2409

Updated Feb 2 • 98

mistralai/Pixtral-Large-Instruct-2411

Image-Text-to-Text • Updated Mar 16 • 409

mistralai/Mistral-Small-24B-Base-2501

Text Generation • Updated Jan 30 • 12.3k • 244

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 38 • 2

Almawave/Velvet-14B

Text Generation • Updated Feb 20 • 3.5k • 135

RedHatAI/QwQ-32B-FP8-dynamic

Text Generation • Updated Mar 6 • 3.11k • 8

erax-ai/EraX-Translator-V1.0

Translation • Updated 11 days ago • 1.05k • 20

VinkuraAI/KunoRZN-Llama-3-3B

Text Generation • Updated 12 days ago • 9.21k • 4

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19, 2024 • 3.15k • 8

RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Mar 25 • 22.1k • 45

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 8.36k • 16

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated Dec 17, 2024 • 152k • 27

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Feb 11 • 29.3k • 20

RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 408 • 4

bprice9/Palmyra-Medical-70B-FP8

Text Generation • Updated Aug 21, 2024 • 5 • 1

mistralai/Mistral-Small-Instruct-2409

Updated Oct 16, 2024 • 6.39k • 384

mlx-community/Ministral-8B-Instruct-2410-4bit

Updated Oct 17, 2024 • 237 • 8