AIA claimed one-to-one match between autorubric's and Jev's criterion types
An autorubric contributor says its criterion types map one-to-one to Jev's Noul, Score and Choice, describing the two abstractions as similar.
TLDR
An autorubric contributor says Jev uses a similar abstraction to autorubric, a framework for rubric-based LLM evaluation. They claim autorubric's criterion types map one-to-one to Jev's Noul, Score and Choice. Writing on September 20, 2026, they said autorubric had been released eight months earlier and was scheduled for presentation at COLM in October.
Combined views
8.5K
1 Source, first seen 6h ago
A claimed one-to-one match between autorubric's and Jev's criterion types
An autorubric contributor says its criterion types map one-to-one to Jev's Noul, Score and Choice, describing the two abstractions as similar.
TLDR
An autorubric contributor says Jev uses a similar abstraction to autorubric, a framework for rubric-based LLM evaluation. They claim autorubric's criterion types map one-to-one to Jev's Noul, Score and Choice. Writing on September 20, 2026, they said autorubric had been released eight months earlier and was scheduled for presentation at COLM in October.