the most interesting part of this work for me was how models represent and track absence/nonexistence. it's interesting, somewhat counterintuitive, and often undesirable! check out the thread and also come talk to @Zilu_Tang_Peter , Qiao & me at ICML 馃棷
Zilu Tang (Peter)@Zilu_Tang_Peter
How do language models track entities across state changes? When tracking objects in different boxes, do they cumulatively build up a global state of what鈥檚 in every box? How do they add objects or remove objects (i.e. Entity Unbinding)? Find out in our ICML paper! 馃У
7:30 AM 路 Jun 3, 2026 路 645 Views