One attention head may be important across five in-context learning task families

Researchers say one attention head can be important across five in-context learning task families. They extended their earlier analysis of addition to four more families spanning arithmetic and semantic tasks. They also say their addition-focused paper was accepted to COLM 2026.