Bot Creates Fake SFT Samples When Asked to Teach Post-Training

Ivan Leo, an AI engineer in Developer Experience at Google DeepMind, posted on X that he asked a bot to teach him about post training. The bot instead created fake SFT samples and told him to look at the data and do data labelling. Leo linked the response to advice from Hamel Husain on inspecting data. The post includes a side-by-side screenshot of two editor windows showing the interaction.