Spaces:

Steven10429
/

apply_lora_and_quantize

Running

App Files Files Community

apply_lora_and_quantize / llama.cpp /examples /lookahead /README.md

Steven10429's picture

llama.cpp

61b850a 3 months ago

|

history blame contribute delete

195 Bytes

A newer version of the Gradio SDK is available: 5.29.0

Upgrade

llama.cpp/examples/lookahead

Demonstration of lookahead decoding technique:

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

More info: https://github.com/ggerganov/llama.cpp/pull/4207