transformers
accelerate
bitsandbytes
gguf>=0.10.0