Michael Y. Li

@michaelyli_

CS PhD @StanfordAILab @StanfordNLP advised by @noahdgoodman and Emily Fox. Prev: undergrad @princeton

following
followers

Self-play pretraining reportedly scales without real training data

A researcher introducing “Self-Play Pretraining with Zero Data” says two models start from random initialization: a generator proposes programs, and a learner trains on their outputs.

14 Sources, 22d ago, updated 22d ago

Featured in

Self-play pretraining reportedly scales without real training data

Featured in

Self-play pretraining reportedly scales without real training data