Lunary
Lunary is an open-source AI developer platform to monitor, manage, and improve LLM apps. It performs essential functions like logs and debu...
Last verified:
What is Lunary?
Lunary is an open-source platform designed to monitor, improve, and secure AI chatbots and LLM-powered applications. It provides enterprises and GenAI teams with essential observability tools including agent tracing, analytics, prompt management, evaluations, and LLM guardrails. The platform logs all prompts and results, enabling developers to debug LLM agents, trace errors, and see how agents perform in production with traces and error stack traces.
Key features include comprehensive analytics for tracking model usage and costs, analyzing frequent topics, and measuring user satisfaction with custom dashboards. The prompt management system allows teams to create template versions, collaborate with non-technical teammates, and run A/B tests. Security features include PII masking to safeguard user personal information (GDPR compliance), RBAC and SSO for access control, and self-hosting options with Kubernetes or Docker deployment. Additional tools include chat replays, topic classification, human reviews for judging LLM responses, an AI playground for experimenting with prompts, instant search with filters, alerts system for performance notifications, and support for multi-modal inputs (text, audio, images).
Lunary is built for AI developers, GenAI teams, enterprises building internal tools or customer-facing chatbots, and startups scaling AI applications. It integrates seamlessly with any LLM and framework through lightweight SDKs supporting OpenAI, LangChain, LiteLLM, Flowise, and more, with a simple 1-line integration. The platform is SOC 2 Type II and ISO 27001 certified, making it enterprise-ready for companies that need to stay compliant and safeguard sensitive data.
Lunary pricing
Pricing model: Freemium
Lunary offers three plans: Free ($0/mo) includes 10k events/month, 3 projects, 30 days log retention, 1 month history, and 1 maximum seat. Team ($20/user/mo) includes 50k events/month (then $10/50k/month), AI Playground (1000/month then $0.05 per query), unlimited projects, 1 year history, advanced features, and up to 10 seats. Enterprise (Custom, get a quote) starts from $400/month for companies building solutions for clients, includes self-hosted option, SSO, granular access control, PII masking, 99.9% SLA, white labeling, data warehouse connectors, SOC2 & ISO27001 reports, audit papertrail, technical account manager, and legendary support with same-day support via shared Slack/Teams channel. Discounts available for students, non-profits, and open-source projects without commercial use. Quarterly billing accommodated upon request.
Lunary pros
- Open-source platform with free community edition
- Self-hostable with Docker and Kubernetes support
- 1-line integration with zero friction
- Works with any LLM model and custom agents
- Compatible with LangChain, AutoGPT, and other libraries
- comprehensive agent tracing with error stack traces
- PII masking for GDPR compliance and data security
- Prompt templates with versioning and A/B testing
- AI Playground for experimentation without coding
- Custom dashboards for performance analytics
- Real-time monitoring and alerts system
- Human reviews feature for judging LLM responses
- Chat replays to understand user interactions
- Topic classification to uncover trends instantly
- CSV and JSONL exports for fine-tuning data
- Full API access for custom integrations
- Multi-modal support for text, audio, and images
- SOC 2 Type II and ISO 27001 certified
- RBAC and SSO for granular access control
- Data stays with you when self-hosted
Lunary cons
- Free plan only keeps data for 30 days
- Free tier limited to 10k events per month
- Free plan maximum of 1 seat
- Team plan starts at $20 per user per month
- Enterprise plans require getting a quote
- AI Playground on free plan limited to 1000 queries/month
- Additional 50k events cost $10/month on Team plan
- Self-hosted Enterprise Edition is paid (Community is free)
- White-labeling only available on Enterprise plans
- Data warehouse connectors only on Enterprise plans
Frequently asked questions about Lunary
What is Lunary?
Lunary is an open-source platform to monitor, improve and secure your AI chatbots. With features such as Observability, Prompt Management, Evaluations and LLM guardrails, it helps GenAI teams manage and improve LLM chatbots.
What is a run in Lunary?
There are multiple types of runs such as 'llm', 'trace', 'chain', 'embedding', 'chat', etc. For LLMs, a run is 1 API call to an inference API, such as OpenAI, LangChain, etc., or a chat message in a thread.
How long is data kept on each plan?
On the free plan, data is accessible only for the last 30 days. On paid plans, data is kept indefinitely. On the self-hosted versions, data stays with you and is kept indefinitely.
Does Lunary impact the latency of my API calls?
No. The Lunary SDKs run asynchronously, not sitting as a middleman between your code and inference APIs, thus not impacting the latency of your calls.
How do I export logs for fine-tuning models?
In the Logs section, you can filter logs by criteria such as feedback and sentiment. Use the 'Export to OpenAI JSONL' button to export the logs to a JSONL file, which you can upload to OpenAI to fine-tune your models.
What integrations does Lunary support?
You can use our SDKs to integrate with OpenAI, LangChain, LiteLLM, Flowise, and more. We are continuously adding new integrations, check our integrations page for the complete list. You can also use the HTTP API to integrate with any other service.
Is Lunary GDPR compliant?
Our data is hosted in Europe and compliant with GDPR. We can also accommodate on-premises hosting for additional data security control.
What happens if I exceed my event limit?
If you exceed the limit 2 days in a row, your account will be limited but the data will still be captured. That means exceptional bursts are fine. You'll regain full access once you upgrade your account or stay below the limit for 3 consecutive days.
Can I self-host Lunary?
You can self-host the Community Edition for free. The Enterprise Edition, with support for Docker, Kubernetes, and more, is paid. Follow the self-hosting instructions in our documentation at https://docs.lunary.ai/self-host for local, Docker, or Kubernetes deployments.
Do you offer discounts for students or non-profits?
Yes, we offer discounts for students, non-profits, and open-source projects without commercial use. Please contact us with details about your project to claim a discount.