A claimed 9.65-second NanoGPT training run awaits review
Deven Pietrzak says he adapted CPU-assisted work from an earlier pull request and submitted his own for review.
TLDR
Deven Pietrzak reported training NanoGPT in 9.65 seconds by adapting earlier work that ran a connected longest exact match model concurrently on a CPU. He said that earlier approach moved the reported record from 39.9 to 21.5 seconds. Pietrzak submitted a pull request for his run, but said all the claimed records were still subject to review and CPU use remained a gray area.
Combined views
1.4K
6 Sources, first seen ago