microsoft
/

bitnet-b1.58-2B-4T-gguf

Text Generation

large-language-model

Model card Files Files and versions Community

Resources

View closed (2)

running model in ollama is not supported.

#15 opened 7 days ago by

llama_cpp_python: gguf_init_from_file_impl: failed to read tensor info

#14 opened 9 days ago by

Kind of a strange responses GGGGGGGGGGGG....

#13 opened 12 days ago by

Run with 400MB

#12 opened 14 days ago by

How to easily run on Windows OS ?

#11 opened 15 days ago by

Chat template issue

#8 opened 17 days ago by

TQ1 quant version

#7 opened 17 days ago by

Does not work in LM Studio

#6 opened 18 days ago by

When I run "python setup_env.py -md models/BitNet-b1.58-2B-4T -q tl2" specifying "tl2", I get the following error and cannot create a gguf.

#5 opened 19 days ago by

Chinese Ha is not supported

#3 opened 22 days ago by

gguf not llama.cpp compatible yet

#2 opened 22 days ago by

Update README.md

#1 opened 23 days ago by