metadata

title: README
emoji: 📈
colorFrom: green
colorTo: yellow
sdk: gradio
pinned: false

Welcome to Our Extreme Quantization Hub

Here, we focus on models built with extreme quantization techniques. Our mission is to push the boundaries of this technology, driving innovation and setting new standards for the field.

🚀 Latest Releases: 8B Models Fine-tuned on BitNet Architecture

Checkout the blog post :

Llama3-8B-1.58-100B-tokens
Fine-tuned on 100B tokens for maximum performance.
Llama3-8B-1.58-Linear-10B-tokens
Fine-tuned with a Linear Lambda scheduler on 10B tokens.
Llama3-8B-1.58-Sigmoid-k100-10B-tokens
Fine-tuned with a Simgoid Lambda scheduler with k=100 on 10B tokens.

Join us as we continue to push this technology forward!