Announcement
NanoGPT Speedrun time reportedly drops from 39.9 to 6.7 seconds
A developer credits retrieval-augmented n-gram hints for the claimed 83.2% cut in time.
TLDR
The developer says retrieval-augmented n-gram hints cut their NanoGPT Speedrun time from 39.9 to 6.7 seconds, a drop they say exceeds the combined 81.4% reduction from every record since 2025. They say the hints address rare, repeated web content a language model cannot memorize in time. Another poster praised the result and expressed surprise that big nanoGPT gains have come from AI-assisted humans rather than autoresearch.
Combined views
151.1K
9 Sources, first seen ago
