Coinbase cuts AI spending by nearly 50% using dynamic routing, open-weight models, and prompt caching
Prompt cache hit rates increased from 5% to 60%.
Combined views
198.8K
10 posts, first seen 61d ago
1.6K likes189 comments706 saves
Coinbase cuts AI spending by nearly 50% using dynamic routing, open-weight models, and prompt caching
Prompt cache hit rates increased from 5% to 60%.