• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    The case for AI models sharing more than tokens

    A post uses a detective-novel analogy to argue that passing another model a killer’s name is not the same as handing over the case—a contrast between text output and a model’s internal states.

    SM
    1 Source, 17d ago, first seen 17d ago

    TLDR

    A post imagines a language model reading a detective novel ending with “the killer was.” To supply the next word, the author argues, the model must build the case internally, weighing alibis and earlier clues. In the analogy, a second model receiving only the killer’s name misses that underlying work. The author uses this contrast to argue that hidden states matter more than output tokens, and says @mostik_ai is building a channel that “hands over the case.”

    Combined views

    1.9K

    1 Source, first seen 17d ago

    Combined views

    1.9K

    1 Source, first seen 17d ago

    29 likes
    29 likes
    7 comments
    13 saves
    4 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    7 comments
    13 saves
    4 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @aimalyshevaa thought experiment I use when someone asks why hidden states matter more than tokens give a language model an entire detective novel, ending with the sentence "the killer was" -- to produce the next token the model has to have built the whole case: who was where, which alibis conflict, what the author planted in chapter three -- an enormous amount of modeling happens inside the forward pass that produces that one word and then it emits the word, so if a second model now has to continue the story, all it receives is the name... the whole case is gone! that's the situation every multi-model system is in today: each model rebuilds the case from the name @mostik_ai is building the channel that hands over the case 🕵️‍♀️

    1 Source

    @aimalyshevaa thought experiment I use when someone asks why hidden states matter more than tokens give a language model an entire detective novel, ending with the sentence "the killer was" -- to produce the next token the model has to have built the whole case: who was where, which alibis conflict, what the author planted in chapter three -- an enormous amount of modeling happens inside the forward pass that produces that one word and then it emits the word, so if a second model now has to continue the story, all it receives is the name... the whole case is gone! that's the situation every multi-model system is in today: each model rebuilds the case from the name @mostik_ai is building the channel that hands over the case 🕵️‍♀️