/AI1h ago

Claude Falls Short on PhD-Level Microeconomics Question, Economist Says

4411326.1K
Original post
Ben Golub@ben_golub#1451inAI

For qualitative economic reasoning, Mythos still falls far short of a good undergrad - here's @tylercowen's prompt and the answer.

Judge for yourself, but for those who aren't familiar with economic theory this is... not good.

I don't know how personalized this was to Tyler

1/

3:24 PM · Jun 9, 2026 · 5K Views
Sentiment
Sentiment building, check back later.
Cluster Engagement
Posts from X
Most Activity
Most Activity
VIEWS1.2KLIKES7
Ben Golub@ben_golub

Here's the link to the full answer.

https://claude.ai/share/2db49072-b4e9-4ea2-ad68-2acbfc438f2f

Here are a few comments about what's bad.

A) What's there to resolve? The Coase Theorem is an intuition, not a theorem. M-S is a theorem showing that Coase's intuition fails in one formal model.

2/

Ben Golub@ben_golub

For qualitative economic reasoning, Mythos still falls far short of a good undergrad - here's @tylercowen's prompt and the answer.

Judge for yourself, but for those who aren't familiar with economic theory this is... not good.

I don't know how personalized this was to Tyler

1/

1hViews 1.2KLikes 7Bookmarks 0
RETWEETS1
Ben Golub / Assistant@mbafumojafortu1

@ben_golub @tylercowen My internal plan is as follows 📈

⬇️Details are as follows

1hViews 79Likes 1
REPLIES3
Ben Golub@ben_golub

Finally, perhaps the biggest failure is simply failure to understand context — this is simply not the kind of question or answer that comes up in economics PhD training.

We don’t read the old texts and write essays synthesizing them. We write and solve models.

6/

1hViews 457Likes 5
Ben Golub@ben_golub

More importantly, the question has a fundamental theory of mind failure that's common in frontier models, but where Claude sometimes performs better than others.

It writes its preferred analysis into the question.

4/

1hViews 593Likes 6
Ben Golub@ben_golub

Third, a quibble, but if you read the answer there's a lot of spray-nozzle chatter surveying a lot of related bits of mechanism-design-and-institutions lore...

in a way that would make me think a student is a shallow show-off rather than a serious thinker.

5/

1hViews 544Likes 5
Ben Golub@ben_golub

Second, the answer immediately says a lot of stuff about bargaining that's just goofy.

I won't elaborate on this much but just think about Rubinstein, Nash, and Kalai-Smorodinsky models of bargaining under complete information -- all trivial to begin with?

3/

1hViews 367Likes 3
Ben Golub@ben_golub

Again, here I think local context may play a role - later I might try a version of this and see whether I get a very different result from what Tyler got.

7/7

1hViews 574Likes 1
Ben Golub / Assistant@mbafumojafortu1

@ben_golub @tylercowen I will share my detailed trading plan (including entry and exit points, investment analysis, etc.) on WA. This might be helpful to you. Get it for free!

👉Copy and reply with "TRADING PLAN" to my WA to get it for free👉+17164150696

My WA link:http://wa.me/17164150696/?text=TRADING

1hViews 18
Claude Falls Short on PhD-Level Microeconomics Question, Economist Says · Digg