matrixportal commited on
Commit
9cace94
Β·
verified Β·
1 Parent(s): 522adf4

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +5 -0
app.py CHANGED
@@ -240,6 +240,11 @@ def process_model(model_id, q_method, use_imatrix, imatrix_q_method, private_rep
240
  ## βœ… Quantized Models Download List
241
 
242
  ### πŸ” Recommended Quantizations
 
 
 
 
 
243
  | πŸš€ Download | πŸ”’ Type | πŸ“ Notes |
244
  |:---------|:-----|:------|
245
  | [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) | ![Q2_K](https://img.shields.io/badge/Q2_K-1A73E8) | Basic quantization |
 
240
  ## βœ… Quantized Models Download List
241
 
242
  ### πŸ” Recommended Quantizations
243
+ - **✨ General CPU Use:** [`Q4_K_M`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_k_m.gguf) (Best balance of speed/quality)
244
+ - **πŸ“± ARM Devices:** [`Q4_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_0.gguf) (Optimized for ARM CPUs)
245
+ - **πŸ† Maximum Quality:** [`Q8_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q8_0.gguf) (Near-original quality)
246
+
247
+ ### πŸ“¦ Full Quantization Options
248
  | πŸš€ Download | πŸ”’ Type | πŸ“ Notes |
249
  |:---------|:-----|:------|
250
  | [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) | ![Q2_K](https://img.shields.io/badge/Q2_K-1A73E8) | Basic quantization |