Charles 🎉 Frye @ ICML@charles_irlTECH
Rates are not costs! Serverless GPUs can cost more per hour but in many practical cases they cost less in aggregate. The key statistic is the workload's peak-to-average demand ratio. I wrote a lil article for the @modal blog (and vibed up a lil widget) demonstrating this. https://x.com/charles_irl/status/2074870011328594250/video/1