tiny-gguf-on-cpu / README.md
wolfofbackstreet's picture
Init files
0aa5cd7 verified

A newer version of the Gradio SDK is available: 5.29.0

Upgrade
metadata
title: Tiny GPTQ V2 LLM On CPU
emoji: πŸŒ–
colorFrom: green
colorTo: gray
sdk: gradio
sdk_version: 5.27.1
app_file: app.py
pinned: false
license: mit
short_description: A Simple app to test out the potentials of small GPTQ LLM mo

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

Build and Run on Docker

docker build -t my_gradio_app .  
docker run -d -p 7860:7860 my_gradio_app