JanAI

17.8k 1.0k

LLMs ChatUI Text Gen

04 May, 2024

TypeScript

What is Jan AI ?

Jan is an open-source ChatGPT alternative that runs 100% offline on your computer.

Jan runs on any hardware. From PCs to multi-GPU clusters, Jan supports universal architectures:

Jan banner

Demo

Realtime Video: Jan v0.4.3-nightly on a Mac M1, 16GB Sonoma 14

Quicklinks

Jan

Nitro

Nitro is a high-efficiency C++ inference engine for edge computing. It is lightweight and embeddable, and can be used on its own within your own projects.

Troubleshooting

As Jan is in development mode, you might get stuck on a broken build.

To reset your installation:

Use the following commands to remove any dangling backend processes:
Terminal window
```
ps aux | grep nitro
```
Look for processes like “nitro” and “nitro_arm_64,” and kill them one by one with:
Terminal window
```
kill -9 <PID>
```
Remove Jan from your Applications folder and Cache folder
Terminal window
```
make clean
```
This will remove all build artifacts and cached files:
- Delete Jan extension from your ~/jan/extensions folder
- Delete all node_modules in current folder
- Clear Application cache in ~/Library/Caches/jan

Requirements for running Jan

MacOS: 13 or higher
Windows:
- Windows 10 or higher
- To enable GPU support:
  - Nvidia GPU with CUDA Toolkit 11.7 or higher
  - Nvidia driver 470.63.01 or higher
Linux:
- glibc 2.27 or higher (check with ldd --version)
- gcc 11, g++ 11, cpp 11 or higher, refer to this link for more information
- To enable GPU support:
  - Nvidia GPU with CUDA Toolkit 11.7 or higher
  - Nvidia driver 470.63.01 or higher