Type something to search...
Lunary

Lunary

Lunary

866 83
04 May, 2024
  TypeScript

What is Lunary ?

Lunary is a production toolkit for LLMs. Observability, prompt management and evaluations.


Lunary Features

Lunary helps AI devs take their apps in production, with features such as:

  • ๐Ÿ’ต Analytics (cost, token, latency, ..)

  • ๐Ÿ” Monitoring (logs, traces, user tracking, ..)

  • โ›ฉ๏ธ Prompt Templates (versioning, team collaboration, ..)

  • ๐Ÿท๏ธ Creat fine-tuning datasets

  • ๐Ÿ–ฒ๏ธ Chat & feedback tracking

  • ๐Ÿงช Evaluations

It also designed to be:

  • ๐Ÿค– Usable with any model, not just OpenAI

  • ๐Ÿ“ฆ Easy to integrate (2 minutes)

  • ๐Ÿง‘โ€๐Ÿ’ป Simple to self-host (deploy to Vercel & Supabase)


Demo

https://github.com/lunary-ai/lunary/assets/5092466/a2b4ba9b-4afb-46e3-9b6b-faf7ddb4a931


Integration

Modules available for:

Lunary natively supports:

Additionally you can use it with any framework by wrapping the relevant methods.