llama-swap
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
What is llama-swap?
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc