What?! (Quantized BitNet?)

#1
by AI-B - opened

This doesn't make sense to me-

the bitnet weights are either 0, 1 or -1;

Doesn't this imply there's nothing left to round off with GGUF?

Maybe MS is just using GGUF to fluff CPU/GPU handshake.. idk.

This space belongs in private archive IMHO.

Please school me on WTF is happening here. :pray:

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment