» Tag

kv-cache

1 posts

6–Jul 12, 2026

Jul 7, 20267.5
KV Cache Quantization's Effect on KLD in Qwen3.6-27B
A KL-divergence benchmark on bartowski's Qwen3.6-27B GGUF quants (Q8/Q6/Q5) shows KV cache quantization at (q8_0,q8_0) preserves quality almost for free.
llmquantizationkv-cachegguf