Meta-Llama-3.1-Quantized - a fsaudm Collection

fsaudm 's Collections

Meta-Llama-3.1-Quantized

Meta-Llama-3.1-Quantized

updated Aug 28, 2024

Collection of quantized Llama 3.1 models (8B & 70B versions for now), using bitsandbites.

fsaudm/Meta-Llama-3.1-8B-Instruct-NF4

Text Generation • Updated Sep 27, 2024 • 25
fsaudm/Meta-Llama-3.1-70B-Instruct-NF4

Text Generation • Updated Oct 5, 2024 • 2
fsaudm/Meta-Llama-3.1-8B-Instruct-INT8

Text Generation • Updated Aug 21, 2024 • 14
fsaudm/Meta-Llama-3.1-70B-Instruct-INT8

Text Generation • Updated Aug 21, 2024 • 23