One attention head may be important across five in-context learning task families

A coauthor reports that one attention head can be important across five families of in-context learning tasks. The team says it generalized its earlier mechanistic analysis of addition to four more task families, spanning arithmetic and semantic tasks. The coauthor also announced that “Understanding In-context Learning of Addition via Activation Subspaces” was accepted to COLM 2026.