World & Business

Home
Technology
Gaming
Entertainment
World & Business
Science
Sports
AI

Home
Technology
Gaming
Entertainment
World & Business
Science
Sports
AI

The claim that LLM judges are underrated · Digg

Reaction

The claim that LLM judges are underrated

A poster calls LLM judges underrated.

3 Sources, 20d ago, first seen 20d ago

TLDR

A poster offers a brief opinion on LLM judges, saying they are underrated.

Combined views

2.3K

3 Sources, first seen 20d ago

likes

Combined views

2.3K

3 Sources, first seen 20d ago

10 likes

Today's Rank

—

Not ranked yet

Today's Rank

—

Not ranked yet

10

5 saves

5 saves

Featured Source

3 Sources

@johnjhortonHot take: From about GPT-5 onward, if humans and LLMs disagree in a data labeling task, when you look at the actual disagreeing cases, it's almost always that the LLM is right and the human(s) are wrong OR the humans also substantively disagree with each other20d

@ChenhaoTanLLM judges are underrated.20d

@menhguinRT @johnjhorton: Hot take: From about GPT-5 onward, if humans and LLMs disagree in a data labeling task, when you look at the actual disagr…20d

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

3 Sources

@johnjhortonHot take: From about GPT-5 onward, if humans and LLMs disagree in a data labeling task, when you look at the actual disagreeing cases, it's almost always that the LLM is right and the human(s) are wrong OR the humans also substantively disagree with each other20d

@ChenhaoTanLLM judges are underrated.20d

@menhguinRT @johnjhorton: Hot take: From about GPT-5 onward, if humans and LLMs disagree in a data labeling task, when you look at the actual disagr…20d