AIIn-context learning reportedly emerges across language, genome, protein and image models
A researcher announcing work at @jhuclsp says models trained on six kinds of data all show few-shot in-context learning, with highly correlated performance.
TLDR
The researcher announced “Convergent Emergence of In-Context Learning Across Modalities,” saying models trained on language, genomes, proteins, images, time series and integer sequences all exhibit few-shot in-context learning—learning from a few examples provided in context. The announcement also claims their performance is highly correlated. A separate post sharing the work argues that in-context learning emerges through next-token prediction on “pretty much any kind of pattern rich data.”
Combined views
5.6K
5 Sources, first seen 2d ago
In-context learning reportedly emerges across language, genome, protein and image models
A researcher announcing work at @jhuclsp says models trained on six kinds of data all show few-shot in-context learning, with highly correlated performance.