Downtown-Case
/

nbeerbower_EVA-Gutenberg3-Qwen2.5-32B-exl3-4.0bpw-hb8

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

EVA-Gutenberg3-Qwen2.5-32B

EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2 finetuned on jondurbin/gutenberg-dpo-v0.1, nbeerbower/gutenberg2-dpo, and nbeerbower/gutenberg-moderne-dpo.

Method

ORPO tuned with 8x A100 for 2 epochs.

Downloads last month: 2

Safetensors

Model size

8.98B params

Tensor type

FP16

·

I16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Downtown-Case/nbeerbower_EVA-Gutenberg3-Qwen2.5-32B-exl3-4.0bpw-hb8

Base model

Qwen/Qwen2.5-32B

Finetuned

EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2

Quantized

(24)

this model

Datasets used to train Downtown-Case/nbeerbower_EVA-Gutenberg3-Qwen2.5-32B-exl3-4.0bpw-hb8