EXL3 quants of C4AI Command R7B 12-2024
2.00 bits per weight2.50 bits per weight3.00 bits per weight4.00 bits per weight5.00 bits per weight6.00 bits per weight8.00 bits per weight / H8
-