huggingface_hub==0.25.2
transformers
torch
accelerate
auto-gptq
einops
sentencepiece