V
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
What is vllm?
A high-throughput and memory-efficient inference and serving engine for LLMs
Keep exploring
View all alternatives Related tools
M
100/100
MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Open source AI
15,848GitHub stars
H
100/100
hyperframes
Write HTML. Render video. Built for agents.
Open source AI
40,274GitHub stars
N
100/100
next-ai-draw-io
A next.js web application that integrates AI capabilities with draw.io diagrams. This app allows you to create, modify, and enhance diagrams through natural lan
Open source AIProductivity
34,483GitHub stars