Update app.py
Browse files
app.py
CHANGED
@@ -240,6 +240,11 @@ def process_model(model_id, q_method, use_imatrix, imatrix_q_method, private_rep
|
|
240 |
## β
Quantized Models Download List
|
241 |
|
242 |
### π Recommended Quantizations
|
|
|
|
|
|
|
|
|
|
|
243 |
| π Download | π’ Type | π Notes |
|
244 |
|:---------|:-----|:------|
|
245 |
| [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) |  | Basic quantization |
|
|
|
240 |
## β
Quantized Models Download List
|
241 |
|
242 |
### π Recommended Quantizations
|
243 |
+
- **β¨ General CPU Use:** [`Q4_K_M`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_k_m.gguf) (Best balance of speed/quality)
|
244 |
+
- **π± ARM Devices:** [`Q4_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_0.gguf) (Optimized for ARM CPUs)
|
245 |
+
- **π Maximum Quality:** [`Q8_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q8_0.gguf) (Near-original quality)
|
246 |
+
|
247 |
+
### π¦ Full Quantization Options
|
248 |
| π Download | π’ Type | π Notes |
|
249 |
|:---------|:-----|:------|
|
250 |
| [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) |  | Basic quantization |
|