• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Announcement

    Harness evolution reportedly improves game-benchmark results but doesn't beat test-time scaling on Terminal-Bench

    A post reports +80% on ARC-AGI-3 and +11% on EdgeBench games under matched budgets.

    Pradeep DasigiPD
    Yike Wang @COLMYW
    Teng XiaoTX
    4 Sources, ,

    TLDR

    In an October post, the author says harness evolution does not beat test-time scaling on Terminal-Bench but reports +80% on ARC-AGI-3 and +11% on EdgeBench games under matched budgets. The post suggests it can help adaptation in long-horizon, out-of-distribution games. In July, the same author said its gains largely came from repeated sampling and showed limited generalization.

    Combined views

    2K

    4 Sources, first seen 5h ago

    Combined views

    2K

    4 Sources, first seen 5h ago

    34 likes
    5h ago
    first seen 5h ago
    34 likes
    2 comments
    14 saves
    10 reposts
    2 comments
    14 saves
    10 reposts
    Featured Source

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    4 Sources

    Yike Wang @COLM@yikewang_Harness evolution doesn’t beat test-time scaling on Terminal-Bench. But on long-horizon, out-of-distribution games, where harness evolution can help with adaptation, it shines: +80% on ARC-AGI-3 and +11% on EdgeBench games under matched budgets. Check out our newest findings: https://arxiv.org/abs/2607.122275h
    Pradeep Dasigi@pdasigiRT @yikewang_: Harness evolution doesn’t beat test-time scaling on Terminal-Bench. But on long-horizon, out-of-distribution games, where ha…1h
    Teng Xiao@TengX6Our updated results highlight where harness evolution can help: long-horizon, out-of-distribution environments. We see gains on ARC-AGI-3 and EdgeBench under matched budgets, while test-time scaling remains hard to beat on Terminal-Bench.1h

    4 Sources

    Yike Wang @COLM@yikewang_Harness evolution doesn’t beat test-time scaling on Terminal-Bench. But on long-horizon, out-of-distribution games, where harness evolution can help with adaptation, it shines: +80% on ARC-AGI-3 and +11% on EdgeBench games under matched budgets. Check out our newest findings: https://arxiv.org/abs/2607.122275h
    Pradeep Dasigi@pdasigiRT @yikewang_: Harness evolution doesn’t beat test-time scaling on Terminal-Bench. But on long-horizon, out-of-distribution games, where ha…1h
    Teng Xiao@TengX6Our updated results highlight where harness evolution can help: long-horizon, out-of-distribution environments. We see gains on ARC-AGI-3 and EdgeBench under matched budgets, while test-time scaling remains hard to beat on Terminal-Bench.1h