Llama-3.3-70B-Instruct AWQ 4-Bit Quantized Version

This repository provides the AWQ 4-bit quantized version of meta-llama/Llama-3.3-70B-Instruct, originally developed by Meta AI.

Downloads last month
301,453
Safetensors
Model size
11.3B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kosbu/Llama-3.3-70B-Instruct-AWQ

Quantized
(115)
this model