Announcement
Spherical Fixed-Point Reasoners propose a stopping rule for looped transformers
The introductory post says SFPRM loops on a unit sphere, where each step is an angle.
TLDR
The post introduces Spherical Fixed-Point Reasoners (SFPRM) as an approach to two challenges for looped transformers: keeping their state bounded and knowing when to stop. It says SFPRM loops on a unit sphere and stops once the angle for a step is small enough.
Combined views
19.6K
4 Sources, first seen ago
