AI CEO Claims Most GPU Energy Wasted on Data Movement
Retweet shares comments on energy use in AI hardware from Naveen Rao.
TLDR
Danielle Fong retweeted a post from MTSlive that attributes to AI CEO Naveen Rao an explanation of the GPU energy problem. The post states that 99.9 percent of energy goes into moving data rather than computing. It describes this as a feature of traditional von Neumann architectures in AI systems. The packet contains no first-party statement from Rao or independent confirmation of the figure.
Combined views
36
1 Source, first seen 29d ago