|
--- |
|
title: Flask |
|
emoji: 🤖 |
|
colorFrom: purple |
|
colorTo: purple |
|
sdk: docker |
|
pinned: false |
|
--- |
|
|
|
# MoA Chat |
|
|
|
MoA Chat is a multi-agent AI chat platform where several LLMs respond in parallel, and an aggregator model combines their outputs into a single response. |
|
|
|
## Features |
|
|
|
- Python 3 backend using Flask |
|
- Frontend with HTML, JavaScript, TailwindCSS (optional) |
|
- Simultaneous queries to multiple AI models |
|
- Aggregator LLM refines the combined output |
|
- Supports light and dark themes |
|
- Switch documentation language between English and Spanish |
|
- Secret API keys management |
|
- Hugging Face Spaces compatibility |
|
- Docker support |
|
- Free models through OpenRouter and others |
|
|
|
## Requirements |
|
|
|
- Python 3.11+ |
|
- pip |
|
- API keys for model providers |
|
|
|
## Installation |
|
|
|
1. Clone the repository: |
|
|
|
```bash |
|
git clone https://huggingface.co/spaces/UntilDot/Flask |
|
cd Flask |
|
``` |
|
|
|
2. Create a `.env` file: |
|
|
|
```env |
|
OPENROUTER_API_KEY=your-openrouter-key |
|
TOGETHER_API_KEY=your-together-key |
|
GROK_API_KEY=your-grok-key |
|
GROQ_API_KEY=your-groq-key |
|
``` |
|
|
|
3. Install dependencies: |
|
|
|
```bash |
|
pip install -r requirements.txt |
|
``` |
|
|
|
4. Run the application: |
|
|
|
```bash |
|
python app.py |
|
``` |
|
|
|
The server will be available at `http://localhost:7860`. |
|
|
|
## Adding New Models |
|
|
|
Edit the file `llm/model_config.json` to register new models and providers. |
|
|
|
Example: |
|
|
|
```json |
|
{ |
|
"providers": { |
|
"openrouter": { |
|
"url": "https://openrouter.ai/api/v1/chat/completions", |
|
"key_env": "OPENROUTER_API_KEY" |
|
} |
|
}, |
|
"models": { |
|
"deepseek/deepseek-chat-v3-0324:free": "openrouter" |
|
} |
|
} |
|
``` |
|
|
|
## Docker Support |
|
|
|
To build and run using Docker: |
|
|
|
Create the following `Dockerfile`: |
|
|
|
```Dockerfile |
|
FROM python:3.11-slim |
|
WORKDIR /app |
|
COPY requirements.txt ./ |
|
RUN pip install --no-cache-dir -r requirements.txt |
|
COPY . . |
|
EXPOSE 7860 |
|
CMD ["python", "app.py"] |
|
``` |
|
|
|
Then: |
|
|
|
```bash |
|
docker build -t moa-chat . |
|
docker run -d -p 7860:7860 --env-file .env moa-chat |
|
``` |
|
|
|
Environment variables or an `.env` file are required for API keys. |
|
|
|
## License |
|
|
|
Licensed under the Apache License 2.0. |
