Great take with a strong overview of what’s needed to compete at the almost frontier.
Nando didn’t discuss Canada, but I think the major limitation there is talent; in particular, compensation is just so low in Canada that it’s difficult to get/retain great people
No one should be surprised by this. The USA is doing what any self-interested nation state would do.
The real question is why are Europe, Canada, Australia, Korea, Japan and UK not able to compete seriously. That is the question everyone in government needs to answer.
And no, having a couple of startups that have raised $1B or $2B is FAR from enough to compete with $100B American companies. The scale matters. Imagine your sword’s length is 1cm and your rival’s 1m — no match.
Here is the harsh math (thanks to a poor version of Claude):
•10,000 GB200 superchips ≈ ~278 NVL72 racks. •Each NVL72 rack costs roughly $3M–$3.5M. •That puts the full-system total around $830M–$970M, before networking, power, cooling, and datacenter buildout.
That would enable you to train a model that was Sota 2 years ago. You need about 5 to 7 times this to compete today. So the starting bill is $5B, but even if you have this, here is the reality: there’s no available chips. So when you hear someone raised $1B, remember this is going back to American compute, and is simply not enough.
The other two ingredients for AI are data and people.
American startups pay better than European ones, so the people vote with their feet so they can pay their mortgage and send kids to school. An experienced AI engineer makes double the salary in Europe by working for an American startup (like Anthropic) than a European one, and about ten times more if they work for a USA corporation. There are however amazing European startups, but the money and ambition is lacking.
The USA is far more relaxed with data and fair use - Canada is good too and @cohere is doing fine thanks to this. So American companies have a strong advantage over European ones. Brussels and the UK think they can hold the world to their questionable “ethical” views on data but they are just destroying the local AI industry, and in the process falling into a very precarious situation. They are partly responsible. Only the French minister has stood by their local LLM @MistralAI … and I guess more recently Germany has started to wake up.
The hope is of course LLM startups like @MistralAI and @cohere which are a year or so behind but can provide personalised services, and amazing startups like @cusp_ai @IneffableLabs @nscale @Orbital_Ind @bfl_ai and a few others. But for all these, it’s incredibly hard to compete.