Reaction
The claim that transformers only read, write and combine symbols in embedding space
A post argues that those three operations are all transformers do.
TLDR
The author characterizes transformers as reading, writing and combining symbols in embedding space, arguing that they do nothing else.
Combined views
2.5K
1 Source, first seen ago
likes
