Spaces:

matthoffner
/

ggml-mllm

Paused

ggml-mllm / config.toml

Update config.toml

9bb5d66 almost 2 years ago

130 Bytes

	model="guanaco-33B-GGML/guanaco-33B.ggmlv3.q4_0.bin"
	use_mmap="True"
	use_mlock="True"
	n_threads="6"
	n_ctx="2048"
	n_gpu_layers="50"