Language models reportedly learn to report their own internal activity

In a post introducing a paper, the poster compares language-model introspection to proprioception, the sense of where your arm is. A digital analogue could let a model report which expert activated in a layer for a previous token. The poster says language models can learn a range of these skills, and researchers can evaluate whether training for them changes model behavior.