Baraaqasem commited on
Commit
1e1b3a5
·
verified ·
1 Parent(s): 700a3cf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -241
README.md CHANGED
@@ -1,241 +1,7 @@
1
- <h1 align="center">
2
- <br>
3
- <img height="300" src="https://github.com/go-skynet/LocalAI/assets/2420543/0966aa2a-166e-4f99-a3e5-6c915fc997dd"> <br>
4
- LocalAI
5
- <br>
6
- </h1>
7
-
8
- <p align="center">
9
- <a href="https://github.com/go-skynet/LocalAI/fork" target="blank">
10
- <img src="https://img.shields.io/github/forks/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI forks"/>
11
- </a>
12
- <a href="https://github.com/go-skynet/LocalAI/stargazers" target="blank">
13
- <img src="https://img.shields.io/github/stars/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI stars"/>
14
- </a>
15
- <a href="https://github.com/go-skynet/LocalAI/pulls" target="blank">
16
- <img src="https://img.shields.io/github/issues-pr/go-skynet/LocalAI?style=for-the-badge" alt="LocalAI pull-requests"/>
17
- </a>
18
- <a href='https://github.com/go-skynet/LocalAI/releases'>
19
- <img src='https://img.shields.io/github/release/go-skynet/LocalAI?&label=Latest&style=for-the-badge'>
20
- </a>
21
- </p>
22
-
23
- <p align="center">
24
- <a href="https://hub.docker.com/r/localai/localai" target="blank">
25
- <img src="https://img.shields.io/badge/dockerhub-images-important.svg?logo=Docker" alt="LocalAI Docker hub"/>
26
- </a>
27
- <a href="https://quay.io/repository/go-skynet/local-ai?tab=tags&tag=latest" target="blank">
28
- <img src="https://img.shields.io/badge/quay.io-images-important.svg?" alt="LocalAI Quay.io"/>
29
- </a>
30
- </p>
31
-
32
- <p align="center">
33
- <a href="https://twitter.com/LocalAI_API" target="blank">
34
- <img src="https://img.shields.io/twitter/follow/LocalAI_API?label=Follow: LocalAI_API&style=social" alt="Follow LocalAI_API"/>
35
- </a>
36
- <a href="https://discord.gg/uJAeKSAGDy" target="blank">
37
- <img src="https://dcbadge.vercel.app/api/server/uJAeKSAGDy?style=flat-square&theme=default-inverted" alt="Join LocalAI Discord Community"/>
38
- </a>
39
- </p>
40
-
41
- > :bulb: Get help - [❓FAQ](https://localai.io/faq/) [💭Discussions](https://github.com/go-skynet/LocalAI/discussions) [:speech_balloon: Discord](https://discord.gg/uJAeKSAGDy) [:book: Documentation website](https://localai.io/)
42
- >
43
- > [💻 Quickstart](https://localai.io/basics/getting_started/) [🖼️ Models](https://models.localai.io/) [🚀 Roadmap](https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3Aroadmap) [🥽 Demo](https://demo.localai.io) [🌍 Explorer](https://explorer.localai.io) [🛫 Examples](https://github.com/mudler/LocalAI-examples)
44
-
45
- [![tests](https://github.com/go-skynet/LocalAI/actions/workflows/test.yml/badge.svg)](https://github.com/go-skynet/LocalAI/actions/workflows/test.yml)[![Build and Release](https://github.com/go-skynet/LocalAI/actions/workflows/release.yaml/badge.svg)](https://github.com/go-skynet/LocalAI/actions/workflows/release.yaml)[![build container images](https://github.com/go-skynet/LocalAI/actions/workflows/image.yml/badge.svg)](https://github.com/go-skynet/LocalAI/actions/workflows/image.yml)[![Bump dependencies](https://github.com/go-skynet/LocalAI/actions/workflows/bump_deps.yaml/badge.svg)](https://github.com/go-skynet/LocalAI/actions/workflows/bump_deps.yaml)[![Artifact Hub](https://img.shields.io/endpoint?url=https://artifacthub.io/badge/repository/localai)](https://artifacthub.io/packages/search?repo=localai)
46
-
47
- **LocalAI** is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI (Elevenlabs, Anthropic... ) API specifications for local AI inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU. It is created and maintained by [Ettore Di Giacinto](https://github.com/mudler).
48
-
49
- ![screen](https://github.com/mudler/LocalAI/assets/2420543/20b5ccd2-8393-44f0-aaf6-87a23806381e)
50
-
51
- Run the installer script:
52
-
53
- ```bash
54
- curl https://localai.io/install.sh | sh
55
- ```
56
-
57
- Or run with docker:
58
- ```bash
59
- docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-aio-cpu
60
- # Alternative images:
61
- # - if you have an Nvidia GPU:
62
- # docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-aio-gpu-nvidia-cuda-12
63
- # - without preconfigured models
64
- # docker run -ti --name local-ai -p 8080:8080 localai/localai:latest
65
- # - without preconfigured models for Nvidia GPUs
66
- # docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-gpu-nvidia-cuda-12
67
- ```
68
-
69
- To load models:
70
-
71
- ```bash
72
- # From the model gallery (see available models with `local-ai models list`, in the WebUI from the model tab, or visiting https://models.localai.io)
73
- local-ai run llama-3.2-1b-instruct:q4_k_m
74
- # Start LocalAI with the phi-2 model directly from huggingface
75
- local-ai run huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
76
- # Install and run a model from the Ollama OCI registry
77
- local-ai run ollama://gemma:2b
78
- # Run a model from a configuration file
79
- local-ai run https://gist.githubusercontent.com/.../phi-2.yaml
80
- # Install and run a model from a standard OCI registry (e.g., Docker Hub)
81
- local-ai run oci://localai/phi-2:latest
82
- ```
83
-
84
- [💻 Getting started](https://localai.io/basics/getting_started/index.html)
85
-
86
- ## 📰 Latest project news
87
-
88
- - Oct 2024: examples moved to [LocalAI-examples](https://github.com/mudler/LocalAI-examples)
89
- - Aug 2024: 🆕 FLUX-1, [P2P Explorer](https://explorer.localai.io)
90
- - July 2024: 🔥🔥 🆕 P2P Dashboard, LocalAI Federated mode and AI Swarms: https://github.com/mudler/LocalAI/pull/2723
91
- - June 2024: 🆕 You can browse now the model gallery without LocalAI! Check out https://models.localai.io
92
- - June 2024: Support for models from OCI registries: https://github.com/mudler/LocalAI/pull/2628
93
- - May 2024: 🔥🔥 Decentralized P2P llama.cpp: https://github.com/mudler/LocalAI/pull/2343 (peer2peer llama.cpp!) 👉 Docs https://localai.io/features/distribute/
94
- - May 2024: 🔥🔥 Openvoice: https://github.com/mudler/LocalAI/pull/2334
95
- - May 2024: 🆕 Function calls without grammars and mixed mode: https://github.com/mudler/LocalAI/pull/2328
96
- - May 2024: 🔥🔥 Distributed inferencing: https://github.com/mudler/LocalAI/pull/2324
97
- - May 2024: Chat, TTS, and Image generation in the WebUI: https://github.com/mudler/LocalAI/pull/2222
98
- - April 2024: Reranker API: https://github.com/mudler/LocalAI/pull/2121
99
-
100
- Roadmap items: [List of issues](https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3Aroadmap)
101
-
102
- ## 🔥🔥 Hot topics (looking for help):
103
-
104
- - Multimodal with vLLM and Video understanding: https://github.com/mudler/LocalAI/pull/3729
105
- - Realtime API https://github.com/mudler/LocalAI/issues/3714
106
- - 🔥🔥 Distributed, P2P Global community pools: https://github.com/mudler/LocalAI/issues/3113
107
- - WebUI improvements: https://github.com/mudler/LocalAI/issues/2156
108
- - Backends v2: https://github.com/mudler/LocalAI/issues/1126
109
- - Improving UX v2: https://github.com/mudler/LocalAI/issues/1373
110
- - Assistant API: https://github.com/mudler/LocalAI/issues/1273
111
- - Moderation endpoint: https://github.com/mudler/LocalAI/issues/999
112
- - Vulkan: https://github.com/mudler/LocalAI/issues/1647
113
- - Anthropic API: https://github.com/mudler/LocalAI/issues/1808
114
-
115
- If you want to help and contribute, issues up for grabs: https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3A%22up+for+grabs%22
116
-
117
- ## 🚀 [Features](https://localai.io/features/)
118
-
119
- - 📖 [Text generation with GPTs](https://localai.io/features/text-generation/) (`llama.cpp`, `gpt4all.cpp`, ... [:book: and more](https://localai.io/model-compatibility/index.html#model-compatibility-table))
120
- - 🗣 [Text to Audio](https://localai.io/features/text-to-audio/)
121
- - 🔈 [Audio to Text](https://localai.io/features/audio-to-text/) (Audio transcription with `whisper.cpp`)
122
- - 🎨 [Image generation with stable diffusion](https://localai.io/features/image-generation)
123
- - 🔥 [OpenAI-alike tools API](https://localai.io/features/openai-functions/)
124
- - 🧠 [Embeddings generation for vector databases](https://localai.io/features/embeddings/)
125
- - ✍️ [Constrained grammars](https://localai.io/features/constrained_grammars/)
126
- - 🖼️ [Download Models directly from Huggingface ](https://localai.io/models/)
127
- - 🥽 [Vision API](https://localai.io/features/gpt-vision/)
128
- - 📈 [Reranker API](https://localai.io/features/reranker/)
129
- - 🆕🖧 [P2P Inferencing](https://localai.io/features/distribute/)
130
- - 🌍 Integrated WebUI!
131
-
132
- ## 💻 Usage
133
-
134
- Check out the [Getting started](https://localai.io/basics/getting_started/index.html) section in our documentation.
135
-
136
- ### 🔗 Community and integrations
137
-
138
- Build and deploy custom containers:
139
- - https://github.com/sozercan/aikit
140
-
141
- WebUIs:
142
- - https://github.com/Jirubizu/localai-admin
143
- - https://github.com/go-skynet/LocalAI-frontend
144
- - QA-Pilot(An interactive chat project that leverages LocalAI LLMs for rapid understanding and navigation of GitHub code repository) https://github.com/reid41/QA-Pilot
145
-
146
- Model galleries
147
- - https://github.com/go-skynet/model-gallery
148
-
149
- Other:
150
- - Helm chart https://github.com/go-skynet/helm-charts
151
- - VSCode extension https://github.com/badgooooor/localai-vscode-plugin
152
- - Terminal utility https://github.com/djcopley/ShellOracle
153
- - Local Smart assistant https://github.com/mudler/LocalAGI
154
- - Home Assistant https://github.com/sammcj/homeassistant-localai / https://github.com/drndos/hass-openai-custom-conversation / https://github.com/valentinfrlch/ha-gpt4vision
155
- - Discord bot https://github.com/mudler/LocalAGI/tree/main/examples/discord
156
- - Slack bot https://github.com/mudler/LocalAGI/tree/main/examples/slack
157
- - Shell-Pilot(Interact with LLM using LocalAI models via pure shell scripts on your Linux or MacOS system) https://github.com/reid41/shell-pilot
158
- - Telegram bot https://github.com/mudler/LocalAI/tree/master/examples/telegram-bot
159
- - Github Actions: https://github.com/marketplace/actions/start-localai
160
- - Examples: https://github.com/mudler/LocalAI/tree/master/examples/
161
-
162
-
163
- ### 🔗 Resources
164
-
165
- - [LLM finetuning guide](https://localai.io/docs/advanced/fine-tuning/)
166
- - [How to build locally](https://localai.io/basics/build/index.html)
167
- - [How to install in Kubernetes](https://localai.io/basics/getting_started/index.html#run-localai-in-kubernetes)
168
- - [Projects integrating LocalAI](https://localai.io/docs/integrations/)
169
- - [How tos section](https://io.midori-ai.xyz/howtos/) (curated by our community)
170
-
171
- ## :book: 🎥 [Media, Blogs, Social](https://localai.io/basics/news/#media-blogs-social)
172
-
173
- - [Run Visual studio code with LocalAI (SUSE)](https://www.suse.com/c/running-ai-locally/)
174
- - 🆕 [Run LocalAI on Jetson Nano Devkit](https://mudler.pm/posts/local-ai-jetson-nano-devkit/)
175
- - [Run LocalAI on AWS EKS with Pulumi](https://www.pulumi.com/blog/low-code-llm-apps-with-local-ai-flowise-and-pulumi/)
176
- - [Run LocalAI on AWS](https://staleks.hashnode.dev/installing-localai-on-aws-ec2-instance)
177
- - [Create a slackbot for teams and OSS projects that answer to documentation](https://mudler.pm/posts/smart-slackbot-for-teams/)
178
- - [LocalAI meets k8sgpt](https://www.youtube.com/watch?v=PKrDNuJ_dfE)
179
- - [Question Answering on Documents locally with LangChain, LocalAI, Chroma, and GPT4All](https://mudler.pm/posts/localai-question-answering/)
180
- - [Tutorial to use k8sgpt with LocalAI](https://medium.com/@tyler_97636/k8sgpt-localai-unlock-kubernetes-superpowers-for-free-584790de9b65)
181
-
182
- ## Citation
183
-
184
- If you utilize this repository, data in a downstream project, please consider citing it with:
185
-
186
- ```
187
- @misc{localai,
188
- author = {Ettore Di Giacinto},
189
- title = {LocalAI: The free, Open source OpenAI alternative},
190
- year = {2023},
191
- publisher = {GitHub},
192
- journal = {GitHub repository},
193
- howpublished = {\url{https://github.com/go-skynet/LocalAI}},
194
- ```
195
-
196
- ## ❤️ Sponsors
197
-
198
- > Do you find LocalAI useful?
199
-
200
- Support the project by becoming [a backer or sponsor](https://github.com/sponsors/mudler). Your logo will show up here with a link to your website.
201
-
202
- A huge thank you to our generous sponsors who support this project covering CI expenses, and our [Sponsor list](https://github.com/sponsors/mudler):
203
-
204
- <p align="center">
205
- <a href="https://www.spectrocloud.com/" target="blank">
206
- <img height="200" src="https://github.com/go-skynet/LocalAI/assets/2420543/68a6f3cb-8a65-4a4d-99b5-6417a8905512">
207
- </a>
208
- <a href="https://www.premai.io/" target="blank">
209
- <img height="200" src="https://github.com/mudler/LocalAI/assets/2420543/42e4ca83-661e-4f79-8e46-ae43689683d6"> <br>
210
- </a>
211
- </p>
212
-
213
- ## 🌟 Star history
214
-
215
- [![LocalAI Star history Chart](https://api.star-history.com/svg?repos=go-skynet/LocalAI&type=Date)](https://star-history.com/#go-skynet/LocalAI&Date)
216
-
217
- ## 📖 License
218
-
219
- LocalAI is a community-driven project created by [Ettore Di Giacinto](https://github.com/mudler/).
220
-
221
- MIT - Author Ettore Di Giacinto <[email protected]>
222
-
223
- ## 🙇 Acknowledgements
224
-
225
- LocalAI couldn't have been built without the help of great software already available from the community. Thank you!
226
-
227
- - [llama.cpp](https://github.com/ggerganov/llama.cpp)
228
- - https://github.com/tatsu-lab/stanford_alpaca
229
- - https://github.com/cornelk/llama-go for the initial ideas
230
- - https://github.com/antimatter15/alpaca.cpp
231
- - https://github.com/EdVince/Stable-Diffusion-NCNN
232
- - https://github.com/ggerganov/whisper.cpp
233
- - https://github.com/saharNooby/rwkv.cpp
234
- - https://github.com/rhasspy/piper
235
-
236
- ## 🤗 Contributors
237
-
238
- This is a community project, a special thanks to our contributors! 🤗
239
- <a href="https://github.com/go-skynet/LocalAI/graphs/contributors">
240
- <img src="https://contrib.rocks/image?repo=go-skynet/LocalAI" />
241
- </a>
 
1
+ title: Chat
2
+ emoji: 😻
3
+ colorFrom: purple
4
+ colorTo: red
5
+ sdk: docker
6
+ pinned: false
7
+ license: apache-2.0