How language models represent grammaticality

A new preprint examines whether grammaticality is a major organizing principle in neural language models. Announcing the work, a coauthor reports that many models show abstract separation in their representations on this basis. The authors believe the findings address debates about confounding factors in measuring models’ grammatical knowledge.