# vllm-test

conda create -n vllm_test python=3.11
conda activate vllm_test
pip install -r requirements.txt

## environment settings

Please set the following environment variables first

```
export SHOPPAL_VLLM_API_URL=
export SHOPPAL_VLLM_MODEL_NAME=
export SHOPPAL_VLLM_API_KEY=
```