langtrace
Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics f
What is langtrace?
Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊
Overview of langtrace
What it is
Langtrace is an open-source, OpenTelemetry-based end-to-end observability tool for LLM applications. It captures, debugs, and analyzes traces and metrics from applications that use LLM APIs, vector databases, and LLM frameworks. The project provides SDKs for TypeScript/JavaScript and Python, and offers both a managed cloud version and a self-hosting option. Langtrace's traces adhere to OpenTelemetry standards, and the SDKs are licensed under Apache 2.0 while the main application is under AGPL 3.0. The tool does not collect any telemetry when self-hosted.
Key features
- OpenTelemetry support for comprehensive tracing.
- Real-time monitoring of LLM API calls, vector operations, and framework usage.
- Performance insights, including latency, costs, and usage patterns.
- Debug tools to trace and debug LLM application workflows.
- Detailed analytics and visualizations.
- Self-hosting option deployable on own infrastructure.
Use cases
- Monitoring and debugging production LLM applications.
- Analyzing performance and cost patterns of LLM API calls.
- Tracing interactions across LLM providers like OpenAI, Anthropic, Gemini, and frameworks like Langchain, LlamaIndex, and CrewAI.
- Observing vector database operations with Pinecone, ChromaDB, QDrant, and others.
- End-to-end traceability for multi-step LLM workflows.
Getting started
Install the SDK: bash # For TypeScript/JavaScript npm i @langtrase/typescript-sdk # For Python pip install langtrace-python-sdk Initialize with an API key (from langtrace.ai) or environment variable: typescript // TypeScript import * as Langtrace from '@langtrase/typescript-sdk' Langtrace.init({ api_key: '' }) // OR Langtrace.init() // with LANGTRACE_API_KEY env var python # Python from langtrace_python_sdk import langtrace langtrace.init(api_key='') # OR langtrace.init() # with LANGTRACE_API_KEY env var For self-hosting, use Docker Compose: bash docker compose up
License and pricing
The Langtrace application (this repository) is licensed under the AGPL 3.0 License. The Langtrace SDKs are licensed under the Apache 2.0 License. The cloud version is currently free while gathering feedback; the project may monetize in the future. Self-hosting is free and does not collect telemetry.
Based on the project's public README and repository metadata.
