What are the success stories of meta learning?
Ortega argues modern LLMs act as scaled meta-learning systems.
What are the success stories of meta learning?
Users affirm the idea of querying documented success stories in meta learning by agreeing it is a worthwhile approach worth pursuing.

@andrewgwils Model merging 😁

@andrewgwils PFN-style tabular foundation models like TabPFN or TabICL meta-learn how to do in-context tabular classification/regression, outperforming other models (boosted trees, from-scratch deep learning) within their pre-training ranges even without hyperparameter tuning.

@andrewgwils would you consider in-context learning meta-learning?

@andrewgwils meta imitation-learning?

@andrewgwils Reptile was the feasibility trigger

@andrewgwils In-context learning. Some facial recognition
@andrewgwils LLMs
What are the success stories of meta learning?

@andrewgwils PFNs for BayesOpt by and large.

@Joanvelja @andrewgwils yes
Ortega argues modern LLMs act as scaled meta-learning systems.
What are the success stories of meta learning?