llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
What is llm-d?
Achieve state of the art inference performance with modern accelerators on Kubernetes
Keep exploring
View all alternatives Related tools
100/100
WeKnora
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
100/100
spec-kit
💫 Toolkit to help you get started with Spec-Driven Development
100/100
repomix
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Langua