User data is unlikely to add much to frontier AI’s math gains, one post argues
The author calls for stronger disclosure norms around how AI companies train on user data, saying firms vary in how aggressively they use it and should explain their methods and intended capability improvements.
TLDR
One post argues that frontier models’ gains in areas like math come from scaling pretraining and reinforcement learning with verifiable rewards, with user-data training exceedingly unlikely to contribute much. It suggests user data is more likely used to find failure modes or situations that hired annotators struggle to recreate, and calls for clearer disclosure of training practices. A related comment questions whether frontier labs would want Chegg’s user data, pointing skeptically to homework-solution data from struggling undergraduates.
Combined views
41.9K
6 Sources, first seen 20d ago