Llamadeck
Unified management and routing for llama.cpp, MLX and vLLM models - one CLI, several backends, and a small HTTP surface for the rest.
What is Llamadeck?
Unified management and routing for llama.cpp, MLX and vLLM models - one CLI, several backends, and a small HTTP surface for the rest.