Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

4-bit precision

text-generation-inference

AutoTrain Compatible

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

140

Full-text search

Active filters: llama.cpp

v000000/Typhon-Mixtral-v1-imatrix-v2.Q6_K-GGUF

Updated Sep 26, 2024 • 7 • 1

LPN64/LongCite-llama3.1-8b-GGUF

Text Generation • Updated Oct 1, 2024 • 193 • 6

cstr/Ministral-8B-Instruct-2410-GGUF

Updated Oct 17, 2024 • 5 • 1

mrcuddle/Lumimaid-v0.2-12B-Q4_K_M-GGUF

Text Generation • Updated Oct 20, 2024 • 1

Manel/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Updated Nov 3, 2024 • 5

Manel/Llama-2-13b-chat-hf-Q4_0-GGUF

Text Generation • Updated Nov 3, 2024 • 6

Manel/gemma-2-9b-Q4_0-GGUF

Updated Nov 3, 2024 • 3

DiYaZeN/aya-sl-biz-8b

Text Generation • Updated Oct 31, 2024 • 1

shreyasmeher/ConflLlama

Text Classification • Updated 4 days ago • 42 • 1

dwikitheduck/gen-try1-Q4_K_M-GGUF

Updated Nov 11, 2024 • 12

XeAI/LLaMa_3.2_3B_Instruct_Text2SQL-Q4_K_M-GGUF

Text Generation • Updated Nov 17, 2024 • 3

jsjeon/SummLlama3.2-3B-Q4_K_M-GGUF

Updated Nov 19, 2024

dwikitheduck/gen-inst-1-Q4_K_M-GGUF

Updated Nov 25, 2024 • 1

Vikhrmodels/Vikhr-Qwen-2.5-1.5B-Instruct-GGUF

Updated Nov 26, 2024 • 175 • 4

lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • Updated Jan 15 • 697 • 7

phymbert/Phi-3.5-MoE-instruct-GGUF

Text Generation • Updated Dec 29, 2024 • 21 • 1

carsenk/llama3.2_3b_122824_uncensored

Text Generation • Updated Dec 31, 2024 • 109 • 2

carsenk/llama3.2_1b_2025_uncensored

Text Generation • Updated Jan 1 • 19 • 2

bullerwins/DeepSeek-V3-GGUF

Text Generation • Updated Feb 19 • 3.57k • 102

yasserrmd/phi-4-gguf

Updated Jan 9 • 4

Novaciano/L3.2-2025-SuperUncensored-GGUF

Text Generation • Updated Jan 12 • 7

Novaciano/L3.2-1b_SuperUncensored_V2-IQ4_XS-GGUF

Text Generation • Updated Jan 20 • 11

Novaciano/L3.2-1b_SuperUncensored_V2-Q5_K_M-GGUF

Text Generation • Updated Jan 20 • 9

Novaciano/L3.2-1b_SuperUncensored_V2-Q4_K_M-GGUF

Text Generation • Updated Jan 20 • 27

s-emanuilov/query-expansion-Llama-3.2-3B-GGUF

Updated Jan 21 • 56

Novaciano/L3.2-1B_Uncensored_ShortStories-Q5_K_M-GGUF

Text Generation • Updated Feb 12 • 3

Novaciano/L3.2-1B-Uncensored_ShortStories_Q4_K_M-GGUF

Text Generation • Updated Feb 12 • 14

bulieme/llama3.2_1b_2025_uncensored_v2-Q3_K_M-GGUF

Text Generation • Updated Feb 22 • 24

Azzedde/llama3.1-8b-reasoning-grpo-gguf

Text Generation • Updated Mar 3 • 9

nvjob/nvjob-1.5b-ru-8q-gguf

Updated Mar 11 • 13