Reaction
Four levers to try for agentic app cost and performance
Sharing notes from OpenAI DevDay, a user recommends prompt caching, reasoning effort, programmatic tool calling and batch requests.
TLDR
A user sharing notes from OpenAI DevDay recommends four starting points for optimizing agentic apps: prompt caching, reasoning effort, programmatic tool calling and batch requests. They advise measuring the results with evals.
Combined views
10.2K
2 Sources, first seen ago