A memory-based perspective on transformer layers
A blogger says their new post explores how you could invent every transformer layer by thinking about memory.
TLDR
The author asks how much models can remember and says their new blog post offers a way to imagine inventing every layer of the transformer from memory. They describe it as a perspective on neural networks that deserves wider attention.
Combined views
—
1 Source, first seen ago
