a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)
Maintain this project? Show that it is featured on YunoDB.
[](https://yunodb.com/tools/localai-orgvllmcpp?utm_source=github&utm_medium=badge)<a href="https://yunodb.com/tools/localai-orgvllmcpp?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/localai-orgvllmcpp.svg" alt="Featured on YunoDB" height="20"></a>
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faste
🎭 277 个即插即用的 AI 专家角色 — 支持 Claude Code/Cursor/Copilot 等 20 种工具，覆盖工程/设计/营销/金融等 20 个部门。含 64 个中国市场原创智能体（小红书/抖音/微
Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked contex