Frontier AI Pretraining Costs Hit 20 Million Dollars, Limiting Access
Commentary on X
@willccbb At these numbers a failed training run isn't a bug fix anymore, its a company ending event for anyone outside a few dozen labs.
@willccbb "only", that's dirt cheap. That's 100 relatively inexpensive ftes for a year or a 20 person acqui hire
@willccbb So you are saying that we could have thousands of competitors for the frontier? Nice!
@willccbb Yeah that makes sense it will consolidate further the barrier to entry is absurdly high