Promote Sign in Sign up

Analysis

LLMonitor

Open-source AI platform for LLM chatbot management, observability, and evaluation.

Source rating 5.0 (86) 0 views 0 saves Freemium
Analysis Analytics Training
More categories (19)
Datasets DEVELOPER TOOLS Developer Docs Product Analytics Chatbots duet ai assistant ai flag generator Observability LLM Chatbot analytics Prompt management Agent Tracing Debugging open-source Self-hosting AI monitoring Evaluation PII Masking Feedback Tracking
Visit website Sign in to save

Free + from $20

Verdict

A quick read before you dig into the full page.

Best if
Open-source AI platform for LLM chatbot management, observability, and evaluation
Skip if
You need enterprise SLAs or a fully managed team plan right away
Pick this when
Freemium · Free + from $20

Overview

Lunary is an open-source observability and evaluation toolkit for AI developers, providing log queries and tools to improve app quality. It's an AI developer platform designed to manage and improve LLM chatbots, offering chatbot analytics, internal knowledge management, customer support solutions, and autonomous agent deployment.

LLMonitor screenshot

Access & connections

Where you can use LLMonitor.

Platforms

Web

Capabilities

What this tool accepts, produces, and is strongest at.

Highlights

  • Chatbot Analytics
  • Prompt Templates
  • Agent Tracing
  • Custom Dashboards
  • PII Masking
  • Feedback Tracking

FAQ 10

What is Lunary?
Lunary is an open-source observability and evaluation toolkit for AI developers, providing log queries and tools to improve app quality. It's an AI developer platform designed to manage and improve LLM chatbots, offering chatbot analytics, internal knowledge management, customer support solutions, and autonomous agent deployment.
How to use Lunary?
Integrate Lunary's SDK into your codebase with a 1-line integration to log prompts and results, track agent performance, analyze usage and costs, iterate on prompts, and debug LLM agents. Choose between self-hosting or cloud deployment.
What happens if I go over the events limit?
If you exceed the limit 2 days in row, your account will be limited but the data will still be captured. That means exceptional bursts are fine. You'll regain full access once you upgrade your account or stay below the limit for 3 consecutive days.
Where is the data hosted?
Our data is hosted in Europe and compliant with GDPR. We can also accommodate on-premises hosting. Read more about data security.
How do I cancel my subscription?
You can cancel your subscription by clicking on the 'Customer Portal' button in the billing section of the dashboard.
Do you offer discounts for students or non-profits?
Yes, we offer discounts for students, non-profits, and open-source projects without commercial use. Please contact us with details about your project to claim a discount.
Can you accommodate quarterly billing?
Yes, we can accommodate quarterly billing. Please contact us to discuss your needs.
Is there an agency-specific pricing?
For companies and individuals building solutions for clients, we offer flat and predictable plans starting from $US 400/month. Create and share projects for each client. Reach out to get a precise quote.
Is self-hosting free?
You can self-host the Community Edition for free. The Enterprise Edition, with support for Docker, Kubernetes, and more, is paid. Check the pricing page for more information.
Is there a migration path from cloud to self-hosting, if required?
Yes, if you are migrating from the cloud-hosted version to a paid self-hosted plan, contact us and we will help you migrate your data.
LLMonitor Free + from $20
Visit website