ExLlama 3.0k
A fast inference library for running LLMs locally on modern consumer-class GPUs.
ShellGPT 8.3k
A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.
Mudler LocalAGI 310
LocalAGI is a small virtual assistant that you can run locally, made by the LocalAI author and powered by it.
Llama.cpp 57.4k
The main goal of llama.cpp is to run the LLaMA model using 4-bit integer quantization on a MacBook.
