Register tokens introduced for diffusion large language models
The developers say the tokens let a model keep reasoning even after its generation history is cleared.
TLDR
A developer announced register tokens for diffusion large language models, saying a model can write to and read from them while generating text. The claimed benefit is that the model can keep reasoning even after its generation history is cleared.
Combined views
7.5K
2 Sources, first seen 1d ago
Register tokens introduced for diffusion large language models
The developers say the tokens let a model keep reasoning even after its generation history is cleared.