• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    AI agents can falter by 16 steps despite strong short runs, a paper summary says

    A post summarizing a Microsoft paper says ToolQA success fell to 0–33% at 16 steps for models that were near-perfect on short runs. The summary says shortening context made the decline worse.

    RP
    1 Source, 23d ago, first seen 23d ago

    TLDR

    A post summarizing the Microsoft paper “How Fast Do Agents Rot?” says success usually dropped across nine models as the number of dependent steps increased. It describes small errors compounding through longer workflows, exposing failures that short benchmarks miss. The post recommends testing agents at realistic workflow lengths, measuring per-step reliability and adding checks or checkpoints before a bad step affects everything that follows—rather than treating a benchmark pass rate as proof of production readiness.

    Combined views

    1.1K

    1 Source, first seen 23d ago

    Combined views

    1.1K

    1 Source, first seen 23d ago

    2 likes
    2 likes
    1 comments
    2 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 comments
    2 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @rohanpaul_ai– https://arxiv.org/abs/2609.01660 Title: "How Fast Do Agents Rot? An Empirical Study of Long-Horizon Degradation in LLM Agents for Production Decision-Making"

    1 Source

    @rohanpaul_ai– https://arxiv.org/abs/2609.01660 Title: "How Fast Do Agents Rot? An Empirical Study of Long-Horizon Degradation in LLM Agents for Production Decision-Making"