ollama-gpu-calculator
Check whether your GPU can run an Ollama model. Estimates VRAM, KV cache, tokens/sec and power for single and multi-GPU setups.
What is ollama-gpu-calculator?
Check whether your GPU can run an Ollama model. Estimates VRAM, KV cache, tokens/sec and power for single and multi-GPU setups.