torch
transformers
fastapi
uvicorn
pydantic
numpy
accelerate>=0.26.0