Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

31,177

Full-text search

Active filters: 4-bit

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 85 • 2

TheBloke/laser-dolphin-mixtral-2x7b-dpo-GPTQ

Text Generation • Updated Jan 15, 2024 • 22 • 11

TheBloke/DareVox-7B-GPTQ

Text Generation • Updated Jan 17, 2024 • 17 • 2

TheBloke/DiscoLM_German_7b_v1-AWQ

Text Generation • Updated Jan 24, 2024 • 92 • 4

rahuldshetty/tinyllama-python

Text Generation • Updated Jan 19, 2024 • 50 • 2

AISimplyExplained/Vakil-7B

Text Generation • Updated Jan 23, 2024 • 151 • 3

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 101 • 3

alnrg2arg/blockchainlabs_7B_merged_test2_4_prune_sft_4bit_DPO_orca

Text Generation • Updated Jan 26, 2024 • 22 • 2

MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29, 2024 • 86 • 2

TheBloke/CodeLlama-70B-Instruct-GPTQ

Text Generation • Updated Jan 31, 2024 • 60 • 13

TheBloke/CodeLlama-70B-Python-GPTQ

Text Generation • Updated Jan 31, 2024 • 92 • 19

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 220 • 5

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31, 2024 • 493 • 57

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 112 • 1

MaziyarPanahi/rank_zephyr_7b_v1_full-GGUF

Text Ranking • Updated Apr 2 • 486 • 5

MaziyarPanahi/OPEN-SOLAR-KO-10.7B-GGUF

Text Generation • Updated Feb 4, 2024 • 94 • 1

MaziyarPanahi/miqu-1-70b-sf-GPTQ

Text Generation • Updated Feb 4, 2024 • 12 • 10

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22, 2024 • 102 • 5

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 372 • 10

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 584 • 36

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 173 • 3

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 929 • 51

pavankumarbalijepalli/phi2-nl2sql-lora

Text Generation • Updated Feb 28 • 50 • 1

MaziyarPanahi/gemma-2b-it-GGUF

Text Generation • Updated Feb 27, 2024 • 580 • 10

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 256 • 3

alexandreteles/bonito-v1-awq

Text2Text Generation • Updated Mar 16, 2024 • 207 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 223 • 8

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2, 2024 • 486 • 13

cnmoro/Mistral-7B-Portuguese-AWQ

Text Generation • Updated Mar 3, 2024 • 17 • 1

datatab/Yugo55A-4bit

Text Generation • Updated Oct 1, 2024 • 53 • 1