Syntax-tracking attention heads may not drive language models' syntactic predictions

In a preprint, William Timkey and Tal Linzen test whether attention heads that track syntactic relations actually influence language models' syntactic predictions. Forcing those heads to attend to a distractor noun still left predictions more consistent with the subject. The authors found a significantly stronger effect from intervening on specialized heads than on random heads, but only on one of their two measures.