Reaction
Informal intuition on linear attention, DeltaNet and decay proposed for a blog
A commenter also suggests adding DSA as an example and drawing on their own tweet.
TLDR
In a reply, a commenter suggests extending a blog with informal intuition on linear attention, DeltaNet and decay, along the lines of their own tweet. They also suggest adding DSA as an example.
Combined views
—
1 Source, first seen ago
