Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

287

Full-text search

Active filters: ggml

Crataco/Pythia-Deduped-Series-GGML

Text Generation • Updated Oct 1, 2023 • 16

ShadowPower/ggml-alpaca-chatgpt

Text Generation • Updated May 12, 2023 • 8

phi0112358/PMC_LLaMA-7B-ggml

Updated Jun 19, 2023 • 3

mukowaty/ggml-whisper

Updated Jul 15, 2024 • 5

Trelis/Llama-2-7b-chat-hf-function-calling

Text Generation • Updated Aug 22, 2023 • 53 • 48

bornjre/btlm-3b-ggml

Updated Aug 21, 2023 • 8

Crataco/AI-Dungeon-2-Classic-GGML

Text Generation • Updated Sep 28, 2023 • 6

mys/ggml_llava-v1.5-7b

Updated Oct 9, 2023 • 5k • 111

afrideva/TinyLlama-1.1B-alpaca-chat-v1.5-GGUF

Text Generation • Updated Nov 6, 2023 • 44 • 2

afrideva/GPT-NeoX-1.3B-viet-final-GGUF

Text Generation • Updated Nov 9, 2023 • 170 • 1

afrideva/TinyMistral-248M-GGUF

Text Generation • Updated Dec 11, 2023 • 211 • 5

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 65 • 4

afrideva/TinyLlama-1.1B-Chat-v0.6-GGUF

Text Generation • Updated Nov 20, 2023 • 128 • 9

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 209k • 6

staghado/vit.cpp

Updated Nov 28, 2023 • 54 • 3

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 1.47k • 11

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • Updated Dec 26, 2023 • 138 • 3

afrideva/Llama-68M-Chat-v1-GGUF

Text Generation • Updated Jan 17, 2024 • 69 • 2

afrideva/Tinystories-gpt-0.1-3m-GGUF

Text Generation • Updated May 12, 2024 • 119 • 3

afrideva/Phi-3-mini-128k-instruct_function-GGUF

Text Generation • Updated May 8, 2024 • 40 • 1

afrideva/TeenyTinyLlama-160m-GGUF

Text Generation • Updated May 12, 2024 • 148 • 1

afrideva/pip-code-bandit-GGUF

Text Generation • Updated May 13, 2024 • 89 • 1

afrideva/llama3-instrucTrans-enko-8b-GGUF

Text Generation • Updated May 13, 2024 • 111 • 1

ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1-GGUF

Updated Dec 3, 2024 • 2.17k • 22

malteos/bloom-6b4-clp-german

Text Generation • Updated Apr 6, 2024 • 64 • 37

nouamanetazi/bloomz-560m-ggml

Updated Mar 15, 2023 • 4

maximeseth/alpaca-native-7B-ggml

Updated Mar 26, 2023 • 1

bertin-project/bertin-gpt-j-6B-alpaca

Text Generation • Updated Nov 10, 2024 • 106 • 7

CRD716/ggml-LLaMa-65B-quantized

Text Generation • Updated Sep 9, 2023 • 30

CRD716/ggml-vicuna-1.1-quantized

Text Generation • Updated Sep 9, 2023 • 43