• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
AI

A claimed one-to-one match between autorubric's and Jev's criterion types

An autorubric contributor says its criterion types map one-to-one to Jev's Noul, Score and Choice, describing the two abstractions as similar.

Delip Rao @ COLM26DR
1 Source, 19d ago, first seen 19d ago

TLDR

An autorubric contributor says Jev uses a similar abstraction to autorubric, a framework for rubric-based LLM evaluation. They claim autorubric's criterion types map one-to-one to Jev's Noul, Score and Choice. Writing on September 20, 2026, they said autorubric had been released eight months earlier and was scheduled for presentation at COLM in October.

Combined views

16.1K

1 Source, first seen 19d ago

237 likes14 comments186 saves22 reposts

Combined views

16.1K

1 Source, first seen 19d ago

237 likes14 comments186 saves22 reposts

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

1 Source

Delip Rao @ COLM26@delipraoI spent some time investigating @typesafeai's Jev and striking to see them use a similar abstraction as autorubric -- released 8 months ago and to be presented at @COLM_conf next month. Our criterion types map 1:1 to Jev's Noul/Score/Choice: https://arxiv.org/abs/2603.0007719d
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    1 Source

    Delip Rao @ COLM26@delipraoI spent some time investigating @typesafeai's Jev and striking to see them use a similar abstraction as autorubric -- released 8 months ago and to be presented at @COLM_conf next month. Our criterion types map 1:1 to Jev's Noul/Score/Choice: https://arxiv.org/abs/2603.0007719d
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet