ggml-mllm / config.toml
matthoffner's picture
Update config.toml
366e813
raw
history blame
121 Bytes
model="Samantha-7B-GGML/Samantha-7B.ggmlv3.q4_0.bin"
use_mmap="True"
use_mlock="True"
n_threads="4"
n_ctx="2048"
ngl="35"