MemoHarness Optimizes AI Agent Harnesses Using Past Executions
Reactions from ranked influencers
2 posts
Great research paper on optimizing harnesses. (bookmark it) There is a lot of alpha in building a harness. And you don't need much to keep them optimized. This paper argues you can do this effectively using the harness own executions. The harness is the external control layer that turns a base LLM into an executable agent. Automatic improvement methods optimize a narrow part of it, usually prompts or pipelines, and deployed agents then reuse a single global harness for every case. MemoHarness decomposes the harness along the temporal flow of inference into six editable control surfaces (context, tool, generation, orchestration, memory, output) and turns improvement into structured editing over those dimensions. It documents per-case diagnoses plus distilled global patterns about what works and how dimensions interact, then adapts to each new case by retrieving similar past cases. No compute is waisted on test-time labels, feedback, gradient updates, or extra search. On the shell-agent benchmark it reaches 0.806 against 0.722 for the strongest fixed-harness baseline, at lower per-task dollar cost than the strongest commercial baselines compared. Paper: https://arxiv.org/abs/2607.14159 Learn to build effective AI agents in our academy: https://academy.dair.ai/
Great research paper on optimizing harnesses. (bookmark it) There is a lot of alpha in building a harness. And you don't need much to keep them optimized. This paper argues you can do this effectively using the harness own executions. The harness is the external control layer that turns a base LLM into an executable agent. Automatic improvement methods optimize a narrow part of it, usually prompts or pipelines, and deployed agents then reuse a single global harness for every case. MemoHarness decomposes the harness along the temporal flow of inference into six editable control surfaces (context, tool, generation, orchestration, memory, output) and turns improvement into structured editing over those dimensions. It documents per-case diagnoses plus distilled global patterns about what works and how dimensions interact, then adapts to each new case by retrieving similar past cases. No compute is waisted on test-time labels, feedback, gradient updates, or extra search. On the shell-agent benchmark it reaches 0.806 against 0.722 for the strongest fixed-harness baseline, at lower per-task dollar cost than the strongest commercial baselines compared. Paper: https://arxiv.org/abs/2607.14159 Learn to build effective AI agents in our academy: https://academy.dair.ai/