Report
David Bau says a cache swap redirects a coding modelโs sub-goal about 94% of the time
Bau highlights @arnab_apiโs research turning coding modelsโ internal goal signals into English descriptions of upcoming actions.
TLDR
Read the next move, then reroute it: David Bau highlights @arnab_apiโs research on coding-model goals. Bau says selected attention-head signals can produce English goal descriptions when patched into a verbalizer prompt. He also reports that swapping cached task keys and values makes the tested model follow another promptโs sub-goal about 94% of the time. His interpretation: the model recomputes what to do from the task description at each step.
Combined views
527
3 Sources, first seen ago
Comments