QEngine

Fast open-source (MIT) LLM engine in C++/CUDA for RTX 3090-class GPUs. Five models in one OpenAI/Anthropic-compatible server: Qwen3.8-Flash-Next, Qwen3.8-27B, D

What is QEngine?

Fast open-source (MIT) LLM engine in C++/CUDA for RTX 3090-class GPUs. Five models in one OpenAI/Anthropic-compatible server: Qwen3.8-Flash-Next, Qwen3.8-27B, DeepSeek-V4.1-Flash, GLM-5.3-Flash, gpt-oss-120B. On 3x RTX 3090: up to 1,061 tok/s total output, 524 tok/s single stream, 13,280 tok/s prefill, up to 1M context.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/bpx03qengine.svg)](https://yunodb.com/tools/bpx03qengine?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/bpx03qengine?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/bpx03qengine.svg" alt="Featured on YunoDB" height="20"></a>