Announcement
OpenAI adds a 12-hour prompt caching option to its API
OpenAI says persistent agents can keep shared instructions, tools and context cached between requests hours apart.
TLDR
OpenAI’s developer account announced a 12-hour prompt caching option for its API. It says persistent agents can keep shared instructions, tools and context cached longer and pay the lower cached-input rate even when requests are hours apart.
Combined views
418.5K
10 Sources, first seen ago
