VLLM support
#8 opened about 2 hours ago
by
potanin-marat
request for benchmarks to compare between original model and quantized models
#7 opened about 22 hours ago
by
riversnow
KeyError: 'general.name'
1
7
#4 opened 13 days ago
by
vilyuha
Ollama run returns authentication error on in Windows.
6
#3 opened 15 days ago
by
theforgehermit
Run on Ollama problem
5
#2 opened 16 days ago
by
Sagicc

why is the size bigger than regular Q4_0 quants ?
2
6
#1 opened 16 days ago
by
lefromage