ggml-mllm / config.toml
matthoffner's picture
Update config.toml
b469297
raw
history blame
113 Bytes
model="robin-13b.ggmlv3.q3_K_M.bin"
use_mmap="True"
use_mlock="True"
n_threads="8"
n_ctx="2048"
n_gpu_layers="20"