The training signals behind AI’s next-token prediction
One post claims AI training signals are now largely not directly human-written text, pushing back on “it’s only predicting the next token.”
TLDR
A post argues that “it’s only predicting the next token” has damaged AI discourse, emphasizing that the sequence being predicted matters. It says training signals can come from anything and claims they now largely come from sources other than directly human-written text.
Combined views
12.2K
1 Source, first seen ago