README.md

metadata

title: tiny-santacoder
emoji: 🎅🛫
sdk: docker
app_port: 8000
duplicated_from: matthoffner/ggml-ctransformers-fastapi

santacoder-ggml

ggml

ctransformers

FastAPI Docs

Updates

• While WizardCoder proves to be capable on a CPU upgrade, there will be a need for santacoder-ggml as we look for best in class small model for edge
• Added /v1/chat/completions
• Start using ctransformers
• Added starcoder example