• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    A post invokes “the slow death of scaling”

    “On the slow death of scaling,” reads a brief comment accompanying a quoted post.

    SH
    AK
    ML
    3 Sources, 19d ago, first seen 19d ago

    TLDR

    One post offers a terse, skeptical take on scaling, describing it with the phrase “On the slow death of scaling.”

    Combined views

    570

    3 Sources, first seen 19d ago

    2 likes

    Combined views

    570

    3 Sources, first seen 19d ago

    2 likes
    62 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    62 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    3 Sources

    @MLStreetTalkRT @sarahookr: On the slow death of scaling.
    @BlackHC@sarahookr I thought the slow death of scaling was about compute scaling. Isn't the claim here about algorithm improvements vs data improvements while compute remains more or less fixed? 🙃
    @sarahookr@BlackHC Actually the main point is now that transformer innovation is saturated it doesn’t make sense to continue to scale model size. So very much in keeping with saying that innovation in architecture is not yielding returns.

    3 Sources

    @MLStreetTalkRT @sarahookr: On the slow death of scaling.
    @BlackHC@sarahookr I thought the slow death of scaling was about compute scaling. Isn't the claim here about algorithm improvements vs data improvements while compute remains more or less fixed? 🙃
    @sarahookr@BlackHC Actually the main point is now that transformer innovation is saturated it doesn’t make sense to continue to scale model size. So very much in keeping with saying that innovation in architecture is not yielding returns.