worker-vllm
The Runpod worker template for serving our large language model endpoints. Powered by vLLM.
What is worker-vllm?
The Runpod worker template for serving our large language model endpoints. Powered by vLLM.
Keep exploring
View all alternatives Related tools
100/100
MoneyPrinterTurbo
利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
100/100
peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
100/100
pentagi
Fully autonomous AI Agents system capable of performing complex penetration testing tasks