LLMs quantized with GPTQ
Irina Proskurina
iproskurina
AI & ML interests
LLMs: quantization, pre-training
Recent Activity
updated
a model
3 minutes ago
iproskurina/Llama-2-7b-hf-int4-QS-100.0-base-x01
published
a model
5 minutes ago
iproskurina/Llama-2-7b-hf-int4-QS-100.0-base-x01
updated
a model
about 3 hours ago
iproskurina/opt-6.7b-int4-QS-100.0-base-x01
Organizations
Collections
4
models
117

iproskurina/Llama-2-7b-hf-int4-QS-100.0-base-x01
Updated

iproskurina/opt-6.7b-int4-QS-100.0-base-x01
Updated

iproskurina/Mistral-7B-v0.3-int4-QS-0-base
Updated

iproskurina/Mistral-7B-v0.3-int4-QS-100.0-base
Updated

iproskurina/Llama-2-7b-hf-int4-QS-100.0-base
Updated

iproskurina/Llama-2-7b-hf-int4
Updated
•
6

iproskurina/Meta-Llama-3-8B-int4
Updated
•
4

iproskurina/Llama-3.1-8B-int4-c4
Updated
•
7

iproskurina/Llama-3.1-8B-int4
Updated
•
6

iproskurina/Llama-3.1-8B-int4-QS-200.0-base
Updated
•
15