turboderp
/

Llama-3-8B-Instruct-exl2

Model card Files Files and versions Community

Llama-3-8B-Instruct-exl2 / README.md

turboderp's picture

Create README.md

3a13080 verified about 1 year ago

|

history blame contribute delete

710 Bytes

EXL2 quants of Llama-3 8B instruct

2.50 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json