alphaXiv Shares Paper on Probabilistic KV Cache Eviction
Tweet from alphaXiv account describes a paper reframing KV eviction with sampling and weighting.
TLDR
The official alphaXiv account posted about the paper “A Probabilistic Interpretation of KV Cache Eviction.” The post states that most KV eviction methods rely on top-k heuristics, which can distort attention after tokens are removed. It says the paper instead treats eviction as expectation estimation and applies probabilistic sampling plus importance weighting to correct the distortion. The tweet includes a static screenshot of the paper’s first page. No other details or confirmations appear in the packet.
Combined views
11.5K
1 Source, first seen 30d ago