opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready d

What is opik?

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Overview of opik

What it is

Opik is an open-source LLM observability and evaluation platform for AI agent tracing, LLM evaluation, prompt management, and production monitoring. Built by Comet. It is licensed under Apache-2.0 and free to self-host the full platform. The repository includes the server backend, web application, tracing, datasets, experiments, evaluations, prompt management, online evaluation, and agent optimization components.

Key features

  • AI Agent Tracing & Observability: deep tracing of LLM calls, conversation logging, and agent activity with full trace trees for multi-step agents and tool calls.
  • LLM Evaluation: datasets, experiments, and LLM-as-a-judge metrics for hallucination detection, moderation, and RAG assessment.
  • Prompt & Agent Optimization: the Opik Agent Optimizer SDK to improve prompts and agents.
  • Production-Ready Monitoring: scalable dashboards and online evaluation rules.
  • Opik Guardrails: features to help implement safe and responsible AI practices.
  • CI/CD Evaluation: a PyTest integration to test LLM pipelines on every commit.

Use cases

Opik is designed for ML engineers building LLM-powered agents, AI teams moving from prototype to production, and engineering teams that need open-source, self-hostable observability they can run in their own environment. It covers the full LLM application lifecycle from development tracing to production monitoring.

Getting started

bashpip install opikopik configure

License and pricing

Opik is licensed under Apache-2.0. The stated pricing type is open source. It is free to self-host the full platform, including the server backend and all core components, with no commercial license required for self-hosted deployment.

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/comet-mlopik.svg)](https://yunodb.com/tools/comet-mlopik?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/comet-mlopik?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/comet-mlopik.svg" alt="Featured on YunoDB" height="20"></a>