Reaction
How 'multi-token prediction' can mean two different things in speculative decoding
A user shares an illustration of the difference, saying they think they’ve finally grasped the distinction.
TLDR
A user says 'multi-token prediction' is used for two very different techniques in speculative decoding. They say they think they’ve finally understood the distinction and share an illustration of it.
Combined views
1.3K
1 Source, first seen ago
