/AI16h ago

Stanford study finds law professors preferred AI-generated answers over peer-written responses 75% of the time

Only 3.5% of AI answers were flagged as pedagogically harmful.

--0--
Original posts
Reposts
Original post
Rohan Paul@rohanpaul_ai

Stanford researchers found that law professors preferred AI answers over peer professor answers 75% of the time when judging contract-law help for students.

The study tested whether LLMs can handle a field where the answer is often not a fact, but a defensible argument built from rules, exceptions, and judgment.

The professors wrote 40 real student-style questions, gave their own answers, and then blindly judged nearly 3,000 comparisons between human and AI responses.

The striking result was not just that AI won often, but that professors marked AI answers as harmful only 3.5% of the time, compared with 12% for human answers.

i.e. the model was not merely sounding fluent, but often matching the teaching standard law professors use when explaining ambiguity to students.

4:55 PM · Jun 2, 2026 · 5.8K Views
Sentiment
Sentiment building, check back later.
Cluster Engagement
-
Views
-
Comments
-
Reposts
-
Bookmarks
Expand data
Posts from X
Most Activity
Most ActivityTimeline
VIEWS12.3KBOOKMARKS25LIKES122RETWEETS19REPLIES18
Chubby♨️@kimmonismus

A blind Stanford-led study of nearly 3,000 anonymized matchups found law professors across 16 schools preferred AI-generated answers to student contract-law questions over those written by fellow professors 75% of the time, and judged the AI responses far less likely to be pedagogically harmful (3.5% vs. 12%).

"The team tested a range of systems, including commercial tutoring tools and Google's NotebookLM."

Now imagine the performance of models in 6-12 months.

7hViews 12.3KLikes 122Bookmarks 25