LRU vs GDSF vs Recency-Weighted Eviction for Long-Context KV Cache
Three eviction policies battle for control of shrinking KV cache memory.
Omar Ford
Section
1 story in KV Cache Systems.
Three eviction policies battle for control of shrinking KV cache memory.