• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Models Spend Same Compute on Every Token

    Conversation notes models allocate identical compute to every token.

    PJ
    1 Source, 26d ago, first seen 26d ago

    TLDR

    AnneliesGamble posted that current models assign the same compute to each token regardless of whether the token is easy or hard. The post references a conversation with Prateek Jain, Distinguished Scientist at Google DeepMind India who co-leads long-term model research for Gemini. Jain retweeted the post. The visible text stops at the start of what the two discussed and supplies no further details on any proposed changes or outcomes.

    Combined views

    8

    1 Source, first seen 26d ago

    Combined views

    8

    1 Source, first seen 26d ago

    1 reposts
    1 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @jainprateek_RT @AnneliesGamble: Today a model spends the same compute on every token, easy or hard. In my conversation with @jainprateek_ we discussed…

    1 Source

    @jainprateek_RT @AnneliesGamble: Today a model spends the same compute on every token, easy or hard. In my conversation with @jainprateek_ we discussed…