Yoav Goldberg suggests Linear Representation Editing on broad distributions captures topical relatedness rather than specific relations
The debate centers on how language models represent semantic connections.
Source Posts on X
Cluster sourcesDavid Bau@davidbauTECH
@yoavgo Yes, it's cool to take the Hernandez LRE jacobian and apply it the broad training distribution! Surprising that it works! Through the lens of @jack_merullo_ ICLR2025 (that higher frequency relations are more LRE): it leads to the question: what "universal relation" is this?
Metrics
3h agopublished1comments4