Google Brain advances were discovered with far less compute, a user recalls

A user recalls that many innovations from the Google Brain era that reached frontier AI were discovered with less than 10^20 FLOPs (floating-point operations), then scaled to 10^25 FLOPs. They describe these as advances that frontier AI calls “algorithmic progress.”