Mudler LocalAI

---

What is LocalAI ?

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU.

---

LocalAI Features

• 📖 Text generation with GPTs (llama.cpp, gpt4all.cpp, … :book: and more)

• 🗣 Text to Audio

• 🔈 Audio to Text (Audio transcription with whisper.cpp)

• 🎨 Image generation with stable diffusion

• 🔥 OpenAI functions 🆕

• 🧠 Embeddings generation for vector databases

• ✍️ Constrained grammars

• 🖼️ Download Models directly from Huggingface

• 🆕 Vision API

---

💻 Usage

Check out the Getting started section in our documentation.

🔗 Community and integrations

Build and deploy custom containers:

• https://github.com/sozercan/aikit

WebUIs:

• https://github.com/Jirubizu/localai-admin

• https://github.com/go-skynet/LocalAI-frontend

Model galleries

• https://github.com/go-skynet/model-gallery

Other:

• Helm chart https://github.com/go-skynet/helm-charts

• VSCode extension https://github.com/badgooooor/localai-vscode-plugin

• Local Smart assistant https://github.com/mudler/LocalAGI

• Home Assistant https://github.com/sammcj/homeassistant-localai / https://github.com/drndos/hass-openai-custom-conversation

• Discord bot https://github.com/mudler/LocalAGI/tree/main/examples/discord

• Slack bot https://github.com/mudler/LocalAGI/tree/main/examples/slack

• Telegram bot https://github.com/mudler/LocalAI/tree/master/examples/telegram-bot

• Examples: https://github.com/mudler/LocalAI/tree/master/examples/