• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Andrew Carr Notes Scaling Laws for Multiple Data Types

    Andrew Carr notes scaling laws let researchers predict performance gains from larger data, models, or compute.

    AC
    GV
    2 Sources, 29d ago, first seen 29d ago

    TLDR

    Andrew Carr posted that scaling laws predict how models perform when data, model size, or compute increase. He says this helps plan large training runs or data collection. The post states scaling laws have been shown for text, images, audio, and video. Carr asks in which other domains scaling laws appear. He is co-founder and chief scientist at Cartwheel and previously worked at OpenAI.

    Combined views

    16.2K

    2 Sources, first seen 29d ago

    Combined views

    16.2K

    2 Sources, first seen 29d ago

    126 likes
    126 likes
    4 comments
    50 saves
    9 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    4 comments
    50 saves
    9 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    2 Sources

    @andrew_n_carrscaling laws mean you can predict how a model will perform when you scale up data, model size, or compute it's great because then you can plan the biggest runs (or plan data collection efforts). all the main data types have been shown to have a scaling law: text, images, audio, and video. where else are there scaling laws hiding?
    @GillVerdNew thermo scaling law coming soon

    2 Sources

    @andrew_n_carrscaling laws mean you can predict how a model will perform when you scale up data, model size, or compute it's great because then you can plan the biggest runs (or plan data collection efforts). all the main data types have been shown to have a scaling law: text, images, audio, and video. where else are there scaling laws hiding?
    @GillVerdNew thermo scaling law coming soon