Cursor and SpaceXAI train a significantly larger AI model from scratch using 10 times more compute on Colossus 2’s cluster of one million H100-equivalent GPUs
Companies expect the scale to deliver a major leap in capability.
#517Andrew Curran@ANDREWCURRAN_Elon also has a 6T and 10T version of Grok in training now. The step-change that emerged when Anthropic had enough compute to train Mythos in March will start appearing from dozens of other places this year.
Cursor@cursor_aiTogether with SpaceXAI, we’re training a significantly larger model from scratch, using 10x more total compute. With Colossus 2’s million H100-equivalents and our combined data and training techniques, we expect this to be a major leap in model capability.
#517Andrew Curran@ANDREWCURRAN_
Sualeh Asif@sualehasif996Big model coming soon ... !
#1733Ryo Lu@RYOLU_…and more to come
Cursor@cursor_aiTogether with SpaceXAI, we’re training a significantly larger model from scratch, using 10x more total compute. With Colossus 2’s million H100-equivalents and our combined data and training techniques, we expect this to be a major leap in model capability.
#1749Sualeh Asif@SUALEHASIF996Big model coming soon ... !
Cursor@cursor_aiTogether with SpaceXAI, we’re training a significantly larger model from scratch, using 10x more total compute. With Colossus 2’s million H100-equivalents and our combined data and training techniques, we expect this to be a major leap in model capability.