/AI3h ago

SWE-Marathon Lets AI Agents Submit Solutions Multiple Times

765043K
Original post
Florian Brand@xeophon#1117inAI

why can a model submit a solution multiple times for swe-marathon and continue after submission 馃え

5:31 AM 路 Jun 7, 2026 路 1.6K Views
Sentiment
Sentiment building, check back later.
Cluster Engagement
Posts from X
Most Activity
Most Activity
VIEWS572

and why can it access a score.txt

why can a model submit a solution multiple times for swe-marathon and continue after submission 馃え

3hViews 572Likes 12Bookmarks 0
BOOKMARKS1LIKES20REPLIES3

why can 3.1 Pro clone the Claude C compiler without getting flagged as reward hack 馃え

and why can it access a score.txt

3hViews 438Likes 20Bookmarks 1

Yeah, it鈥檚 "OpenRouter", so they prob got some of the real bad ones for the open models 馃檭 @rishi_desai2 did you restrict the provider selection for the open models?

in some runs, V4 Pro doom loops, so they prob used a broken deployment

3hViews 340Likes 11Bookmarks 0

in some runs, V4 Pro doom loops, so they prob used a broken deployment

3hViews 39