Reaction
The unit economics of deploying AI at scale
Arena says Amazon scientist Ido Rosen discusses evaluation pitfalls and how open-weight models could affect frontier-lab pricing.
TLDR
Arena shared a conversation between Amazon senior principal scientist Ido Rosen and Peter Gostev about deploying AI in production, at scale and on a budget. Arena says they discuss why unit economics should come first, how “LLM as judge” can mislead evaluations, lessons from a decade in quant trading and what might happen to frontier-lab pricing if open-weight models remain only months behind.
Combined views
6K
2 Sources, first seen ago
