ICYMI: Agentic AI is now measured in the Arena. Agent Mode can handle deep research around competitive intelligence, market sizing & opportunity analysis, scientific & medical research and more.

Every session shapes the Agent Arena leaderboard. Get a walkthrough of the causal tracing methodology with Evan.

Dive into the thread for more on Agent Mode and Agent Arena.

0:00 How causal tracing works 1:09 A living leaderboard that evolves with AI 1:35 The five behavioral signals explained 1:54 Confirmed success 2:22 Praise and complaint 2:46 Steerability 3:13 Bash recovery 3:39 Tool hallucination 4:11 Natural language model insights 4:37 Per-signal leaderboard cards walkthrough 5:41 What people actually do in Agent Arena 6:01 Scale: conversations, tool calls, and context length 6:13 Most-used tools and task types 7:22 Why this is a real-usage leaderboard 7:49 Labs comparison: OpenAI vs. Anthropic vs. the field 8:24 How Agent Arena differs from past evaluations