Spaces:

Steven10429
/

apply_lora_and_quantize

Running

App Files Files Community

apply_lora_and_quantize / llama.cpp /examples /parallel /README.md

Steven10429's picture

llama.cpp

61b850a 3 months ago

|

history blame contribute delete

93 Bytes

A newer version of the Gradio SDK is available: 5.29.0

Upgrade

llama.cpp/example/parallel

Simplified simulation of serving incoming requests in parallel