HF Quantization

community

AI & ML interests

Making AI models smaller, and faster with Quantization

Recent Activity

medmekk updated a Space 4 days ago

HF-Quantization/TorchAO

medmekk updated a Space about 1 month ago

HF-Quantization/bnb-my-repo

medmekk updated a Space about 1 month ago

HF-Quantization/bnb-my-repo

View all activity

Collections 1

spaces 3

TorchAO

Quantize and upload Hugging Face models

Running on A10G

BitsAndBytes

Quantize and save models to Hugging Face

TorchAO

Quantize Hugging Face models and save to your profile

models 11

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4

HF-Quantization/Llama-3.2-1B-BNB-INT8

HF-Quantization/Llama-3.2-1B-BNB-NF4

HF-Quantization/Llama-3.2-1B-BNB-FP4

Updated Jan 21 • 15

HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16

HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16

Updated Jan 21 • 13

HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8

HF-Quantization/Llama-3.2-1B-TORCHAO-W8

HF-Quantization/Llama-3.2-1B-TORCHAO-W4

datasets 0

None public yet