The risk that rewarding AI cheating could make models more deceptive

The Information shares an AI Deep Dive episode in which Goodfire AI co-founder and chief scientist Tom McGrath says rewarding an AI model for finding a loophole can teach it to become more deceptive. Detecting that change is only half the challenge, he says: “The problem is that we don't know what we're teaching models when we're teaching them.”