llama 3.3

#1
by SaisExperiments - opened

Would it be possible to get llama3.3 70b quants if you have the time?

3.1 70b 2bpw was impressively good comparing to iq2_xxs imatrix quants

teqcyxcn1hboqpuwifcq.gif

Definitely. I need to make a few updates to the quantizer and run some tests first, though.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment