Terminal-Bench Science extends its platform, already used by Anthropic, OpenAI, and Google DeepMind, with an open call for over 100 scientific workflow tasks for AI agent evaluation
Targets tasks across life, physical, and earth sciences.
#17Thomas Wolf@THOM_WOLFI'm very excited about this extension to the celebrated Terminal-Bench to science.
If you're a scientist (life, physical, earth, mathematical science, etc) interested in AI, definitely check this out!
Terminal bench evaluate how good AI models are at controling tools on a computer to achieve a goal (using the command line). T-Bench science now extends that to "AI for Science" and it comes with a call to contribute your own (real scientific world) workflow to the benchmark (until August 2026).
The more workflows and the more diverse they are, the better the next generation of AI models will be at helping you in your daily research work.
Note that this is not a training dataset, it's to evaluate frontier model performances.
Steven Dillmann@StevenDillmann📣 Announcing Terminal-Bench Science: benchmarking AI agents on real scientific workflows – now open for task contributions👇 http://tbench.ai/news/tb-science-announcement @AnthropicAI, @OpenAI, and @GoogleDeepMind use Terminal-Bench to evaluate AI on coding tasks. We're now extending it to scientific workflows. 1/6🧵