Chris Manning discusses linguistics and language models on 'The Information Bottleneck'
A post announcing the new episode says Manning discusses what linguistics contributed to machine learning and why he thinks NLP’s open questions are shifting toward pragmatics and dialogue.
TLDR
The episode announcement says Manning walks through a new paper showing that language models learn verb categories before individual verbs. The conversation also covers whether text alone can teach meaning, his disagreement with Yann LeCun about language, and editing model representations instead of weights.
Combined views
627
1 Source, first seen 3h ago
