FunAGI
/

Qwen2.5-Omni-7B-GPTQ-4bit

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

vllm error

#3 opened 3 days ago by

Can you create an 8bit version?

#2 opened 19 days ago by

test the inference script and quantized model, but have error as below

#1 opened about 1 month ago by