AIAI cloud security, GPU revenue and the future of shared infrastructure
vCluster Labs recaps an AI Infra Summit discussion linking rising token output to higher revenue per GPU, alongside claims of security gaps in shared AI clouds.
TLDR
According to vCluster Labs' recap, speakers at AI Infra Summit argued that revenue per GPU keeps rising because token output grows faster than token prices fall. The recap says one speaker described SemiAnalysis tests that uncovered vulnerabilities involving other tenants' storage and nodes, with many vulnerabilities discoverable by asking an AI model to look. It also describes a shortage of talent to build and secure cloud software in-house. The unresolved question: if security concerns push large customers to rent entire sites rather than share infrastructure, can a middle market exist?