GGUF seems to be broken
1
#10 opened 5 days ago
by
aportnoy
VLLM support
12
1
#8 opened 9 days ago
by
potanin-marat
request for benchmarks to compare between original model and quantized models
2
#7 opened 10 days ago
by
riversnow
KeyError: 'general.name'
3
7
#4 opened 22 days ago
by
vilyuha
Ollama run returns authentication error on in Windows.
6
#3 opened 24 days ago
by
theforgehermit
Run on Ollama problem
5
#2 opened 25 days ago
by
Sagicc

why is the size bigger than regular Q4_0 quants ?
3
6
#1 opened 25 days ago
by
lefromage