Reasoning Models Struggle on Human-Like Problems

Rohan Paul posted about an arXiv paper examining reasoning models. The post states that these models encounter the same problems that slow human thinking. It notes reasoning token counts can signal problem difficulty yet cautions against relying on a single model run for that signal. The researchers compared human response times to model behavior as part of the work. The tweet included a screenshot of the paper's first page.