vllm depolyment error

#10
by Saicy - opened

ValueError: GGUF model with architecture glm4 is not supported yet.

I want to deploy it with vllm,but I find the error above. vllm=0.7.3

its a vllm issue. ask there

Sign up or log in to comment