Well, the idea seems cool. This uses a coreset idea from approximation theory to "expresss" strong non-causal attention approximation into a causal, streaming one. https://arxiv.org/abs/2606.10944