KIVI
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
What is KIVI?
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache