Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Cerebras
Replicate
SambaNova
Together AI
Novita
Cohere
Hyperbolic
fal
Nebius AI Studio
Fireworks
HF Inference API
Misc
Reset Misc
llama-cpp
Inference Endpoints
Merge
text-generation-inference
Eval Results
4-bit precision
AutoTrain Compatible
Mixture of Experts
8-bit precision
Carbon Emissions
text-embeddings-inference
custom_code
Apply filters
Models
19,112
Full-text search
Edit filters
Sort: Trending
Active filters:
llama-cpp
Clear all
redhat6/Phi-3.5-mini-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
Sep 3, 2024
•
33
•
2
byroneverson/internlm2_5-20b-chat-abliterated-gguf
Text Generation
•
Updated
Sep 3, 2024
•
19
•
2
Ffftdtd5dtft/Hermes-3-Llama-3.1-8B-IQ1_S-GGUF
Updated
Sep 4, 2024
•
44
•
1
Triangle104/Ellaria-9B-Q5_K_M-GGUF
Updated
Sep 7, 2024
•
2
•
1
Triangle104/Ellaria-9B-Q6_K-GGUF
Updated
Sep 7, 2024
•
3
•
1
Triangle104/Ellaria-9B-Q8_0-GGUF
Updated
Sep 7, 2024
•
2
•
1
YorkieOH10/Artificium-llama3.1-8B-001-Q4_K_M-GGUF
Updated
Sep 7, 2024
•
2
•
2
QuantFactory/gemma-2-27b-it-abliterated-GGUF
Text Generation
•
Updated
Nov 6, 2024
•
294
•
7
Felladrin/gguf-Q5_K_M-NanoLM-1B-Instruct-v2
Text2Text Generation
•
Updated
Sep 16, 2024
•
56
•
1
Triangle104/MN-12B-Mag-Mell-R1-Q6_K-GGUF
Updated
Sep 16, 2024
•
132
•
3
stephenlzc/Llama-3-8B-Lexi-Uncensored-Q2_K-GGUF
Updated
Sep 19, 2024
•
14
•
1
Triangle104/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
Nov 20, 2024
•
54
•
1
Triangle104/Qwen2.5-Coder-7B-Q5_K_M-GGUF
Text Generation
•
Updated
Nov 20, 2024
•
11
•
1
v000000/L3.1-Niitorm-8B-DPO-t0.0001-GGUFs-IMATRIX
Updated
Oct 6, 2024
•
70
•
4
Karsh-CAI/Qwen2.5-32B-AGI-Q4_K_M-GGUF
Updated
Sep 21, 2024
•
46
•
28
HigherMind/Self-Aware-AI-1-Q8_0-GGUF
Updated
Feb 19
•
46
•
1
hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
Sep 25, 2024
•
22.7k
•
15
hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF
Text Generation
•
Updated
Sep 25, 2024
•
53.3k
•
29
hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF
Text Generation
•
Updated
Sep 25, 2024
•
23.7k
•
47
Abc7347/BlackSheep-Llama3.2-3B-Q4_K_M-GGUF
Updated
Oct 1, 2024
•
28
•
4
Triangle104/L3.1-Aglow-Vulca-v0.1-8B-Q4_K_S-GGUF
Updated
Oct 3, 2024
•
10
•
1
Triangle104/L3.1-Aglow-Vulca-v0.1-8B-Q6_K-GGUF
Updated
Oct 3, 2024
•
9
•
1
SteelQuants/MSM-MS-Cydrion-22B-Q6_K-GGUF
Updated
Oct 3, 2024
•
11
•
4
ZeroXClem/L3SAO-Mix-SuperHermes-NovaPurosani-8B-Q8_0-GGUF
Updated
Oct 5, 2024
•
2
•
1
ZeroXClem/L3SAO-Mix-SuperHermes-NovaPurosani-8B-Q4_0-GGUF
Updated
Oct 5, 2024
•
5
•
2
ZeroXClem/Llama3.1-Hermes3-SuperNova-8B-L3.1-Purosani-2-8B-Q5_0-GGUF
Updated
Oct 7, 2024
•
8
•
2
ZeroXClem/Llama3.1-Hermes3-SuperNova-8B-L3.1-Purosani-2-8B-Q4_K_M-GGUF
Updated
Oct 8, 2024
•
2
•
2
ZeroXClem/L3SAO-Mix-SuperHermes-NovaPurosani-8B-Q4_K_M-GGUF
Updated
Oct 10, 2024
•
4
•
1
ZeroXClem/L3SAO-Mix-SuperHermes-NovaPurosani-8B-Q5_0-GGUF
Updated
Oct 10, 2024
•
6
•
2
ZeroXClem/L3SAO-Mix-SuperHermes-NovaPurosani-8B-Q4_K_S-GGUF
Updated
Oct 10, 2024
•
5
•
1
Previous
1
...
3
4
5
6
7
...
100
Next