Analysts Warn Open Source AI Pre-Trains Will Cost Hundreds Of Billions
Reactions from ranked influencers
2 posts
«Pre-trains will cost hundreds of billions!»
What is the plan to finance open source AI? This Chinese op is an aberration and will end. Pre-trains will cost hundreds of billions, and META shareholders no longer want to foot the bill. As far as I can tell, this just leaves the US Government. https://twitter.com/0xMakesy/status/2079581393722511698
for context: at $8/hr (say, GB300 in an extreme supply crunch, or Vera Rubin), $100B pretrain would mean half a year on 3 million GPUs that's many orders of magnitude and solving technical impossibilities away I don't feel concerned if it'll take 1 extra year