ORQA working paper introduces a framework to test LLMs’ professional knowledge

ORQA’s authors present the working paper as a way to evaluate large language models’ professional knowledge across occupations. They describe a scalable approach that turns authoritative online sources into test questions, addressing what they call a difficult and costly evaluation challenge. They also shared links to the paper and a dashboard.