Edit Models filters

Model Tree

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

9

Full-text search

Active filters: 01-ai/Yi-6B

TheBloke/Yi-6B-GGUF

Text Generation • Updated Nov 10, 2023 • 3.3k • 14

Jezzarax/yi-6B-GGUF

Updated Jun 25, 2024 • 47

TheBloke/Yi-6B-GPTQ

Text Generation • Updated Nov 10, 2023 • 12 • 1

TheBloke/Yi-6B-AWQ

Text Generation • Updated Nov 10, 2023 • 5 • 1

BricksDisplay/Yi-6B-q4

Text Generation • Updated Mar 26, 2024 • 4

PrunaAI/01-ai-Yi-6B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

mradermacher/Yi-6B-GGUF

Updated Jun 26, 2024 • 154

mradermacher/Yi-6B-i1-GGUF

Updated Dec 14, 2024 • 143

tensorblock/Yi-6B-GGUF

Text Generation • Updated 17 days ago • 94