openlit
Same agent, Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.
What is openlit?
Same agent, Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.
Overview of openlit
What it is
OpenLIT is an open-source agent harness engineering platform. It provides OpenTelemetry-native tracing, evaluations, guardrails, prompt and context management, and cost and GPU monitoring for the harness around AI agents and coding agents. The platform is free to self-host under Apache 2.0 and works with any model, framework, or harness, including Claude Code, Codex, Cursor, OpenAI Agents SDK, LangGraph, CrewAI, and 70+ more integrations.
Key features
- Agent observability and OpenTelemetry LLM tracing for every LLM call, tool call, MCP request, retrieval, and agent step
- Evaluations using LLM-as-a-judge, programmatic checks, and human feedback, plus CI gates
- Guardrails for prompt injection, sensitive topics, and topic restriction at runtime
- Prompt Hub for versioned, centrally managed prompts; Context for reusable RAG content; Rule Engine for conditional rules on trace attributes; Vault for LLM API key management
- Cost tracking with custom pricing support and GPU monitoring for NVIDIA, AMD, and Intel GPUs
- OpenGround for comparing models side by side on cost, latency, and output quality
Use cases
OpenLIT is designed for teams building and operating AI agents and coding agents in production. Use cases include debugging production agent failures by tracing the full agent conversation, evaluating agent output quality and safety, managing prompts and context without redeploying, enforcing runtime guardrails, tracking LLM costs and GPU utilization, and comparing models before shipping.
Getting started
bashgit clone https://github.com/openlit/openlit.gitcd openlitdocker compose up -dOpen http://127.0.0.1:3000. Install the SDK: pip install openlit (Python) or npm install openlit (TypeScript). Then instrument your application with openlit.init() and configure the OTLP endpoint. For coding-agent observability, install the CLI and run openlit coding install --vendor=all.
License and pricing
OpenLIT is licensed under Apache 2.0 and is free to self-host. The pricing type is open source.
Based on the project's public README and repository metadata.