Adding capabilities can make AI agents worse at familiar tasks, EvoHarnessBench announcement says
The authors introducing EvoHarnessBench say even today’s self-evolving methods cannot reliably adapt to new capabilities while retaining earlier competence.
TLDR
Adding tools, skills and specialist agents can hurt an AI agent’s performance on tasks it could already solve, according to the authors introducing EvoHarnessBench. They say their results show that expanding this surrounding “harness” can undermine existing abilities—and that today’s self-evolving methods cannot reliably adapt to new capabilities while retaining earlier competence.
Combined views
4.1K
4 Sources, first seen 19d ago