Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Llama-3.1-70B-Instruct-exl2

Model card Files Files and versions Community
4
Llama-3.1-70B-Instruct-exl2 / README.md
turboderp's picture
turboderp
Update README.md
00853aa verified 10 months ago
preview code
|
raw
history blame contribute delete
962 Bytes
metadata
license: llama3.1

EXL2 quants of Llama-3.1 70B Instruct

2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json