Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Fireworks
Replicate
fal
Nebius AI Studio
Together AI
Cohere
Hyperbolic
Novita
Cerebras
SambaNova
HF Inference API
Misc
Reset Misc
torchao-my-repo
Inference Endpoints
text-generation-inference
4-bit precision
Merge
Misc with no match
AutoTrain Compatible
Eval Results
8-bit precision
custom_code
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
28
Full-text search
Edit filters
Sort: Trending
Active filters:
torchao-my-repo
Clear all
medmekk/Llama-3.2-1B-ao-int8wo
Text Generation
•
Updated
28 days ago
•
5
medmekk/Llama-3.2-1B-ao-int8da8w
Text Generation
•
Updated
28 days ago
•
5
medmekk/Llama-3.2-1B-ao-int8wo-gs16
Text Generation
•
Updated
28 days ago
•
27
medmekk/Llama-3.2-1B-ao-int8wo-gs32
Text Generation
•
Updated
28 days ago
•
14
medmekk/Qwen2.5-0.5B-Instruct-ao-int8wo-gs128
Text Generation
•
Updated
28 days ago
•
5
medmekk/Qwen2.5-0.5B-Instruct-ao-int8da8w
Text Generation
•
Updated
28 days ago
•
5
Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int4wo-gs128
Text Generation
•
Updated
23 days ago
•
7
Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int8wo-gs128
Text Generation
•
Updated
23 days ago
•
8
Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int8da8w
Text Generation
•
Updated
12 days ago
•
389
medmekk/Llama-3.2-1B-ao-float8wo
Text Generation
•
Updated
6 days ago
•
29
medmekk/Llama-3.2-1B-ao-float8da8w
Text Generation
•
Updated
6 days ago
•
39
medmekk/Llama-3.2-1B-ao-autoquant-1
Text Generation
•
Updated
6 days ago
•
24
medmekk/Llama-3.2-1B-ao-float8wo-2
Text Generation
•
Updated
6 days ago
•
16
medmekk/Llama-3.2-1B-ao-float8wo-3
Text Generation
•
Updated
6 days ago
•
4
medmekk/Llama-3.2-1B-ao-int8wo-gs256
Text Generation
•
Updated
6 days ago
•
45
medmekk/Llama-3.2-1B-ao-int4wo-gs128
Text Generation
•
Updated
6 days ago
•
45
medmekk/Qwen2.5-0.5B-Instruct-ao-float8wo
Text Generation
•
Updated
6 days ago
•
12
medmekk/Llama-3.2-1B-ao-int4wo-gs256
Text Generation
•
Updated
6 days ago
•
15
medmekk/Llama-3.1-8B-Instruct-ao-int8wo
Text Generation
•
Updated
4 days ago
•
5
medmekk/Llama-3.1-8B-Instruct-ao-autoquant
Text Generation
•
Updated
4 days ago
•
2
medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs128
Text Generation
•
Updated
4 days ago
•
5
medmekk/Llama-3.1-8B-Instruct-ao-float8wo
Text Generation
•
Updated
4 days ago
•
6
medmekk/Llama-3.1-8B-Instruct-ao-float8da8w8
Text Generation
•
Updated
4 days ago
•
6
medmekk/Llama-3.1-8B-Instruct-ao-int8da8w8
Text Generation
•
Updated
4 days ago
•
5
medmekk/Llama-3.1-8B-Instruct-ao-float8da8w8-2
Text Generation
•
Updated
4 days ago
•
4
medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs32
Text Generation
•
Updated
4 days ago
•
5
medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs16
Text Generation
•
Updated
4 days ago
•
5
irresistiblegrace97/tinyllama.gguf
Updated
4 days ago
•
6