QEngine
Fast open-source (MIT) LLM engine in C++/CUDA for RTX 3090-class GPUs. Five models in one OpenAI/Anthropic-compatible server: Qwen3.8-Flash-Next, Qwen3.8-27B, D
What is QEngine?
Fast open-source (MIT) LLM engine in C++/CUDA for RTX 3090-class GPUs. Five models in one OpenAI/Anthropic-compatible server: Qwen3.8-Flash-Next, Qwen3.8-27B, DeepSeek-V4.1-Flash, GLM-5.3-Flash, gpt-oss-120B. On 3x RTX 3090: up to 1,061 tok/s total output, 524 tok/s single stream, 13,280 tok/s prefill, up to 1M context.