Opencode Deploys Fix For Inference Service Degradation Amid Rising Traffic
Reactions from ranked influencers
2 posts
we're seeing more traffic than ever and although most of our infra can scale flexibly it's not perfect we're seeing some issues with large request bodies hitting up against some memory limits continuing to work through them and improve things
we just deployed a fix that was causing a small percentage of requests to our inference service to degrade should see improved responsiveness
they raised it to 10
errors are back down down to near zero after some more optimizations + allocating more resources thank you to the @Cloudflare team for jumping in and enabling that inference is a quirky workload with some unique challenges - post on that soon