vllm-test / README.md
Stanley Xu
add a simple vllm api application
2ae3a0e
|
raw
history blame
285 Bytes
# vllm-test
conda create -n vllm_test python=3.11
conda activate vllm_test
pip install -r requirements.txt
## environment settings
Please set the following environment variables first
```
export SHOPPAL_VLLM_API_URL=
export SHOPPAL_VLLM_MODEL_NAME=
export SHOPPAL_VLLM_API_KEY=
```