Fascinating to see so much scrutiny of the tokens-to-ROI connection all of the sudden. AFAIK current observations (however dismal) are in line with inference-time scaling predictions. It was always there to see in all those (often unlabeled) log-scale x-axes!
Here's a great summary of this new scrutiny from @ttunguz: https://tomtunguz.com/tokens-per-result/
Fascinating to see so much scrutiny of the tokens-to-ROI connection all of the sudden. AFAIK current observations (however dismal) are in line with inference-time scaling predictions. It was always there to see in all those (often unlabeled) log-scale x-axes!