kv-cache

KV Cache Quantization's Effect on KLD in Qwen3.6-27B

A KL-divergence benchmark on bartowski's Qwen3.6-27B GGUF quants (Q8/Q6/Q5) shows KV cache quantization at (q8_0,q8_0) preserves quality almost for free.