OrcaRouter-Lite
Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter
What is OrcaRouter-Lite?
Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter
Overview of OrcaRouter-Lite
What it is
OrcaRouter Lite is a self-hosted LLM router with a managed safety net. It is OpenAI-compatible, supports bring-your-own-keys (BYOK), single-workspace, and streaming. It is the open-source single-workspace edition of OrcaRouter. It can be run on a laptop or shipped in a product. For more advanced routing, the hosted OrcaRouter is available.
Key features
- Self-hosted server with OpenAI-compatible API.
model='auto'feature that picks the cheapest capable model based on request requirements (tools, vision, JSON mode).- Streaming support with OpenAI-compatible SSE format.
- Native protocol endpoints for Anthropic Messages API and Gemini API, allowing direct connection without OpenAI SDK.
- Built-in dashboard at
/for providers, routing, analytics, and keys (self-hosted only). - Model catalog of 100+ chat models loaded at startup from LiteLLM's pricing database, with capability flags and per-token costs.
- SQLite by default; Postgres opt-in via
DATABASE_URL; Redis optional. - Cross-provider prompt cache and routing strategies (balanced, cheapest, fastest, quality).
Use cases
- Running a self-hosted LLM router with your own provider keys.
- Using
model='auto'to automatically select the cheapest capable model without manual routing rules. - Failover: local providers fail, hosted OrcaRouter acts as a safety net.
- Try-before-you-buy: no local provider keys needed when using hosted as upstream.
- Local logging: hosted handles routing, Lite stores RequestLog rows for the dashboard.
Getting started
Two ways to use OrcaRouter:Path A — Self-hosted (BYOK)bashgit clone https://github.com/Continuum-AI-Corp/OrcaRouter-Lite.gitcd OrcaRouter-Litecp .env.example .env# add at least one: OPENAI_API_KEY=sk-... (or ORCAROUTER_API_KEY=...)docker compose up# logs: ✓ orcarouter-lite ready. API key: sk-orca-abc123...Base URL: http://localhost:8000/v1. Use the sk-orca-* key printed at startup.**Path B — Hosted (account required)**No clone, no docker. Register at https://www.orcarouter.ai and copy your sk-orca-* key. Use https://api.orcarouter.ai/v1 as the base URL.Then call from any OpenAI SDK (examples in README for Python, Node.js, curl).
License and pricing
License: MIT. Pricing: open source (free). The hosted OrcaRouter is billed per-token on an OrcaRouter account.
Based on the project's public README and repository metadata.