Tom McCoy Discusses TPR-Augmented Transformers

Tom McCoy, assistant professor at Yale, replied to questions on X about work combining Transformers and tensor product representations. He pointed to an overview paper on neurocompositional computing that describes how adding TPR structure to a standard Transformer yields benefits. In a second reply McCoy noted that EnyanZhang will soon release work connecting TPRs to representational analyses in mechanistic interpretability, while observing that further analysis of mechanisms remains needed.