Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

31,164

Full-text search

Active filters: 4-bit

TheBloke/Athnete-13B-GPTQ

Text Generation • Updated Oct 29, 2023 • 28 • 4

TheBloke/Nethena-20B-GPTQ

Text Generation • Updated Oct 30, 2023 • 23 • 7

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • Updated Nov 9, 2023 • 409 • 72

TheBloke/openchat_3.5-GPTQ

Text Generation • Updated Nov 2, 2023 • 122 • 17

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Nov 2, 2023 • 733 • 28

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 3k • 37

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 181 • 16

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • Updated Nov 9, 2023 • 56 • 9

TheBloke/deepseek-coder-6.7B-instruct-GPTQ

Text Generation • Updated Nov 5, 2023 • 312 • 25

TheBloke/LLaMA2-13B-TiefighterLR-AWQ

Text Generation • Updated Nov 9, 2023 • 31 • 2

TheBloke/merlyn-education-corpus-qa-v2-GPTQ

Text Generation • Updated Nov 16, 2023 • 17 • 3

TheBloke/merlyn-education-safety-GPTQ

Text Generation • Updated Nov 16, 2023 • 15 • 3

TheBloke/Qwen-7B-Chat-AWQ

Text Generation • Updated Nov 21, 2023 • 152 • 9

01-ai/Yi-34B-Chat-4bits

Text Generation • Updated Nov 11, 2024 • 27 • 61

TheBloke/saiga_mistral_7b-GPTQ

Text Generation • Updated Nov 28, 2023 • 56 • 8

TheBloke/deepseek-llm-67b-chat-GPTQ

Text Generation • Updated Nov 29, 2023 • 71 • 7

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • Updated Nov 30, 2023 • 78 • 1

TheBloke/deepseek-llm-7B-base-AWQ

Text Generation • Updated Nov 29, 2023 • 1.89k • 2

TheBloke/deepseek-llm-7B-chat-AWQ

Text Generation • Updated Nov 29, 2023 • 264 • 2

TheBloke/deepseek-llm-7B-chat-GPTQ

Text Generation • Updated Nov 30, 2023 • 1.33k • 1

Qwen/Qwen-1_8B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 1.23k • 35

Qwen/Qwen-72B-Chat-Int4

Text Generation • Updated Jan 4, 2024 • 100 • 47

AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct-4bit-gptq

Text Generation • Updated Jan 7 • 41 • 6

Pi3141/alpaca-7b-native-enhanced-GPTQ

Text Generation • Updated Dec 3, 2023 • 2

AI-Sweden-Models/gpt-sw3-20b-instruct-4bit-gptq

Text Generation • Updated Jan 7 • 27 • 4

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 92.5k • 136

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 18.1k • 51

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 39.8k • 44

TheBloke/Rogue-Rose-103b-v0.2-AWQ

Text Generation • Updated Dec 16, 2023 • 2.56k • 5

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 142 • 112