Maid 68
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama models remotely.
Mudler LocalAI 19.9k
Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required.
Ollama 63.3k
Ollama is LLMs Backend that allow you to get up and running with large language models locally.
Text Gen WebUI 36.5k
Oobabooga Text Generation WebUI is a Gradio browser interface for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
