Reaction
The potential payoff from betting on the right scaling law
A user cites superlinear thermal scaling and pretraining loss yielding to scale as examples of potentially lucrative bets.
TLDR
A user argues that enormous fortunes could go to people who bet on the right scaling law. They point to superlinear thermal scaling and the way the loss function yields to scale in pretraining, describing the latter as slow but capable of producing surprising results.
Combined views
652
1 Source, first seen ago