A historical bug in LLM scaling laws led the AI industry to train oversized, undertrained models
Google DeepMind's Sander Dieleman highlighted the costly pre-Chinchilla compute error
Combined views
94.5K
2 posts, first seen 50d ago
625 likes8 comments650 saves
Useful Links
No useful links have been added yet.
A historical bug in LLM scaling laws led the AI industry to train oversized, undertrained models
Google DeepMind's Sander Dieleman highlighted the costly pre-Chinchilla compute error