TinyLlama 1.1B Chat v0.3 - GGUF
- Model creator: Zhang Peiyuan
- Original model: TinyLlama 1.1B Chat v0.3
- TheBloke quant: TinyLlama-1.1B-Chat-v0.3-GGUF
Support for calm
These models support the calm language model runner. The particular quants selected for this repo are in support of calm, which is a language model runner that automatically uses the right prompts, templates, context size, etc.
- Downloads last month
- 11
Hardware compatibility
Log In
to view the estimation
4-bit
6-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for iandennismiller/TinyLlama-1.1B-Chat-v0.3-GGUF
Base model
TinyLlama/TinyLlama-1.1B-Chat-v0.3