btbtyler09
/

cogito-v1-preview-qwen-32B-gptq-8bit

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Cogito v1 preview - 32B

GPTQ quantization of Cogito v1 preview - 32B based on Qwen QwQ. This is an 8bit gptq quantization.

Downloads last month: 80

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for btbtyler09/cogito-v1-preview-qwen-32B-gptq-8bit

Base model

Qwen/Qwen2.5-32B

Finetuned

deepcogito/cogito-v1-preview-qwen-32B

Quantized

(20)

this model