Description
Quantified mistralai/Mistral-7B-Instruct-v0.2 into Q8_0 and converted to LLaMa CPP (GGUF) format.
About GGUF
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
Prompt template: ChatML
Prompt template: Mistral
<s>[INST] {prompt} [/INST]
- Downloads last month
- 19
Hardware compatibility
Log In
to view the estimation
8-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for Rocwo/Mistral-7B.Q8_0-Instruct-v0.2-GGUF
Base model
mistralai/Mistral-7B-Instruct-v0.2