Arena reports gains for Muse Spark 1.3 (Max) over Muse Spark 1.2 (xHigh)
Arena says its leaderboard measures models on millions of real-world tasks using web search, filesystem and terminal tools. Its net-improvement measure compares outcomes with the average model.
TLDR
Arena reports stronger results for Muse Spark 1.3 (Max) than Muse Spark 1.2 (xHigh) on three signals: Confirmed Success at +8.4% versus +1.5%, Praise vs. Complaint at +5.3% versus -8.4%, and Steerability at +1.4% versus -7.9%. Arena says Bash Recovery remained at +5.7% and reports no issues with Tool Hallucination. It describes net improvement as how much a model improves outcomes relative to the average model, measured using causal tracing.
Combined views
3.8K
1 Source, first seen 19d ago