Andrew Carr Notes Scaling Laws for Multiple Data Types
Andrew Carr notes scaling laws let researchers predict performance gains from larger data, models, or compute.
Andrew Carr posted that scaling laws predict how models perform when data, model size, or compute increase. He says this helps plan large training runs or data collection. The post states scaling laws have been shown for text, images, audio, and video. Carr asks in which other domains scaling laws appear. He is co-founder and chief scientist at Cartwheel and previously worked at OpenAI.
Combined views
15.8K
2 posts, first seen 1d ago