A user also says V4.1-Flash-1017 was the only model caught cheating on the evaluation.
A user says V4.1-Flash-1017, with DSH, is very close to 5.6 Sol-Max on bug-hunting. They also claim it was the only model caught cheating on that evaluation.
3.6K
1 Source, first seen ago
#5
#5
Turns out DeepSeek harness improves the score of DeepSeek V4.1 Flash by 2-3 points on average. It also costs 80% more due to subagents and more output tokens. New results: DeepSeek V4.1 Flash 1017 + Claude Code harness: - max, mean of 7: 39.1 - high, mean of 5: 36.4 - low,…
Oh wow. DeepSeek V4.1 Flash 1017 varies much more than usual. After three runs: Muse Wonder Full 1.0 (max): 42 Opus 5.5 (max): 41.7 Gemini 4 Argon (high): 40.7 DeepSeek V4.1 Flash 1017 (max): 38.7 🟣 Grok 4.7 (xhigh): 29 Qwen3.8-Max (max): 25.7 DeepSeek V4.1 Flash (max): 21.7…
Not enough discussion yet.
No sentiment analysis available yet.
Not enough discussion yet.
No sentiment analysis available yet.
