transformers
torch
accelerate
auto-gptq
gradio