llamactl
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
What is llamactl?
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.