• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Report

    LLMs may use outdated choices even after recognizing an update

    A post describing an LLM paper says nudging attention toward the newest value fixed most update-related mistakes in five open models without retraining.

    RP
    1 Source, 10h ago, first seen 10h ago

    TLDR

    A post describing an LLM paper says models can recognize a changed preference or deadline yet still draw on older mentions in a long conversation. It says nudging attention toward the newest value fixed most of these mistakes in five open models without retraining. In another test it cites, GPT-5.6 Sol got nine of 40 questions right on long agent logs, compared with 40 of 40 when given the current state.

    Combined views

    3.3K

    1 Source, first seen 10h ago

    Combined views

    3.3K

    1 Source, first seen 10h ago

    44 likes
    44 likes
    17 comments
    15 saves
    7 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Featured Source
    17 comments
    15 saves
    7 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @rohanpaul_aiNew Berkley paper: LLMs often know you changed your mind but still use your old choice, so agents need the current state spelled out. When a preference or deadline changes, the old version stays in context. The model still holds the new one, but its attention keeps drifting back to older mentions. In 5 open models, nudging attention toward the newest value fixed most of these mistakes without retraining. Even top-tier GPT-5.6 Sol got only 9 of 40 questions right on long agent logs, but 40 of 40 when given the current state. If your agent tracks anything that changes, keep the current state in the prompt instead of making the model dig through history. – arxiv. org/abs/2609.38866 Title: "When Context Changes: Understanding Update Failures in LLMs"10h