octopus
One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关
What is octopus?
One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关
Overview of octopus
What it is
Octopus is an LLM API aggregation service designed for individuals. It connects multiple LLM provider channels and provides unified management, protocol conversion, automatic failover, and real-time request visualization.
Key features
- Multi-channel aggregation with unified management - Protocol conversion between OpenAI Chat, OpenAI Responses, and Anthropic API formats - Automatic model pricing and model list synchronization - Automatic failover to available channels - Real-time end-to-end request visualization in the frontend - Upstream error shielding to keep agent tasks running - Analytics with request statistics, token consumption, and cost tracking - Lightweight single-binary deployment with multi-database support (SQLite, MySQL, PostgreSQL)
Use cases
- Individuals who want to manage multiple LLM API providers from a single endpoint - Developers needing protocol conversion between different LLM APIs - Users who require automatic failover for high availability - Those who want to monitor and analyze API usage and costs
Getting started
Run with Docker: bash docker run -d --name octopus -v /path/to/data:/app/data -p 8080:8080 bestrui/octopus Or use docker-compose: bash wget https://raw.githubusercontent.com/bestruirui/octopus/refs/heads/master/docker-compose.yml docker compose up -d Download binary from Releases and run: bash ./octopus start Build from source (requires Go 1.24.4, Node.js 18+, pnpm): bash git clone https://github.com/bestruirui/octopus.git cd octopus cd web && pnpm install && pnpm run build go run main.go start Default credentials: username admin, password admin. Change immediately.
License and pricing
Licensed under AGPL-3.0. Open source and free.
Based on the project's public README and repository metadata.