AI models could reach 100 trillion parameters by 2030
A post says outsiders lack firm numbers and suggests the largest models are nearing or already at 10 trillion parameters.
TLDR
A post says people outside AI labs don't know the numbers, but GPT-3.5 is believed to have had around 175 billion parameters and the largest models may be nearing 10 trillion, if they haven't reached it already. It estimates a 50-fold increase in three years and speculates that models could hit 100 trillion parameters by 2030, with ramifications for training, data centers, cybersecurity and society.
Combined views
—
1 Source, first seen ago