Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

6,960

Full-text search

Active filters: awq

TheBloke/deepseek-llm-7B-chat-AWQ

Text Generation • Updated Nov 29, 2023 • 262 • 2

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 41.9k • 44

TheBloke/Rogue-Rose-103b-v0.2-AWQ

Text Generation • Updated Dec 16, 2023 • 2.55k • 5

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1, 2024 • 5.77k • 23

TheBloke/DiscoLM_German_7b_v1-AWQ

Text Generation • Updated Jan 24, 2024 • 84 • 4

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 220 • 5

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 180 • 3

alexandreteles/bonito-v1-awq

Text2Text Generation • Updated Mar 16, 2024 • 198 • 3

cnmoro/Mistral-7B-Portuguese-AWQ

Text Generation • Updated Mar 3, 2024 • 17 • 1

taeminlee/KULLM3-awq

Text Generation • Updated Apr 8, 2024 • 28 • 6

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 16.7k • 23

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 311 • 40

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 218k • 3

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26, 2024 • 512 • 4

shuyuej/MedLLaMA3-70B-base-AWQ

Text Generation • Updated Jun 26, 2024 • 1

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 372 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 990 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 41 • 1

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 357k • 67

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 40.7k • 100

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 12.4k • 10

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2, 2024 • 10 • 5

jfiekdjdk/glm-4-9b-chat-awq

Updated Sep 15, 2024 • 7 • 2

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 67.4k • 77

peakji/steiner-32b-preview-awq

Updated Oct 21, 2024 • 4 • 4

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 273 • 4

PyrTools/Ministral-8B-Instruct-2410-AWQ

Updated Oct 25, 2024 • 2.28k • 1

IntelLabs/sqft-phi-3.5-mini-instruct-wikitext2-awq-64g-ppl10.41

Text Generation • Updated Feb 25 • 14 • 1

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated Nov 11, 2024 • 182 • 7

LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct-AWQ

Updated Nov 19, 2024 • 21 • 5