torch
flash-attn
transformers==4.40.1
gradio