Roon Urges Real-Time Priced AI APIs
OpenAI staffer argues variable pricing can manage daily demand swings and capacity limits.
Roon posted that major AI companies should commit to real-time priced API products. Demand varies wildly over a day and night curve while the industry faces severe capacity constraints. Agents can handle variable pricing, batching, and cost projections. Replies examined token markets that could emerge, risks of one lab pulling ahead and capturing extreme profits, whether tokens measure compute consistently across models, and suggestions such as evening discounts. One reply warned the setup could create permanent regional underclasses tied to ability to pay.
the major ai companies should commit to a real time priced API product. ai demand varies wildly over a day/night curve and the industry is broadly extremely capacity crunched. meanwhile agents make dealing with variable pricing, batching, and projecting total costs very easy
Combined views
Reactions from ranked influencers
15 posts@tszzl Token markets, middle men. Power brokers and energy dealers.
I can't wait for token futures
the major ai companies should commit to a real time priced API product. ai demand varies wildly over a day/night curve and the industry is broadly extremely capacity crunched. meanwhile agents make dealing with variable pricing, batching, and projecting total costs very easy
@_sholtodouglas you're not ambitious enough: token lootboxes.
a few thoughts on why this is a terrible idea in the short-term. you would need a lot of new structures to facilitate and regulate token-markets: it would mostly create massive windfall profits for AI labs, help large corporations and incentivize very dynamic agentic workflows…
the major ai companies should commit to a real time priced API product. ai demand varies wildly over a day/night curve and the industry is broadly extremely capacity crunched. meanwhile agents make dealing with variable pricing, batching, and projecting total costs very easy
i guess some of these are preventable by designing the derivatives in a smart way
also I haven't really thought about how this would interact with foreign/chinese token markets