OrcaRouter-Lite

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

What is OrcaRouter-Lite?

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

Overview of OrcaRouter-Lite

What it is

OrcaRouter Lite is a self-hosted LLM router with a managed safety net. It is OpenAI-compatible, supports bring-your-own-keys (BYOK), single-workspace, and streaming. It is the open-source single-workspace edition of OrcaRouter. It can be run on a laptop or shipped in a product. For more advanced routing, the hosted OrcaRouter is available.

Key features

  • Self-hosted server with OpenAI-compatible API.
  • model='auto' feature that picks the cheapest capable model based on request requirements (tools, vision, JSON mode).
  • Streaming support with OpenAI-compatible SSE format.
  • Native protocol endpoints for Anthropic Messages API and Gemini API, allowing direct connection without OpenAI SDK.
  • Built-in dashboard at / for providers, routing, analytics, and keys (self-hosted only).
  • Model catalog of 100+ chat models loaded at startup from LiteLLM's pricing database, with capability flags and per-token costs.
  • SQLite by default; Postgres opt-in via DATABASE_URL; Redis optional.
  • Cross-provider prompt cache and routing strategies (balanced, cheapest, fastest, quality).

Use cases

  • Running a self-hosted LLM router with your own provider keys.
  • Using model='auto' to automatically select the cheapest capable model without manual routing rules.
  • Failover: local providers fail, hosted OrcaRouter acts as a safety net.
  • Try-before-you-buy: no local provider keys needed when using hosted as upstream.
  • Local logging: hosted handles routing, Lite stores RequestLog rows for the dashboard.

Getting started

Two ways to use OrcaRouter:Path A — Self-hosted (BYOK)bashgit clone https://github.com/Continuum-AI-Corp/OrcaRouter-Lite.gitcd OrcaRouter-Litecp .env.example .env# add at least one: OPENAI_API_KEY=sk-... (or ORCAROUTER_API_KEY=...)docker compose up# logs: ✓ orcarouter-lite ready. API key: sk-orca-abc123...Base URL: http://localhost:8000/v1. Use the sk-orca-* key printed at startup.**Path B — Hosted (account required)**No clone, no docker. Register at https://www.orcarouter.ai and copy your sk-orca-* key. Use https://api.orcarouter.ai/v1 as the base URL.Then call from any OpenAI SDK (examples in README for Python, Node.js, curl).

License and pricing

License: MIT. Pricing: open source (free). The hosted OrcaRouter is billed per-token on an OrcaRouter account.

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/continuum-ai-corporcarouter-lite.svg)](https://yunodb.com/tools/continuum-ai-corporcarouter-lite?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/continuum-ai-corporcarouter-lite?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/continuum-ai-corporcarouter-lite.svg" alt="Featured on YunoDB" height="20"></a>