Spaces:

matthoffner
/

ggml-mllm

Paused

ggml-mllm / config.toml

Update config.toml

45d5455 about 2 years ago

128 Bytes

	model="wizardLM-7B-GGML/wizardLM-7B.ggml.q5_1.bin"
	use_mmap="True"
	use_mlock="True"
	n_threads="6"
	n_ctx="1024"
	n_gpu_layers="40"