vllm-windows-build

Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the Releases page. PyTorch 2.14, FlashAttention/Rust,

What is vllm-windows-build?

Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the Releases page. PyTorch 2.14, FlashAttention/Rust, OpenAI serving, 10 KV formats, Multi-TurboQuant, experimental CPU/NVMe KV offload. No WSL or Docker.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/aivrarvllm-windows-build.svg)](https://yunodb.com/tools/aivrarvllm-windows-build?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/aivrarvllm-windows-build?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/aivrarvllm-windows-build.svg" alt="Featured on YunoDB" height="20"></a>