Ethan Mollick posted that AIs are retroactively reading published finance and economics papers, identifying opportunities and issues, then sharing those judgments publicly. He described the AI Referee Paper Leaderboard as both an interesting experiment and a sign of a tsunami coming for academia. The leaderboard comes from Georgetown University's AI, Analytics, and the Future of Work Initiative and uses an ensemble of LLM referees to score working papers. Visible replies raised points about plagiarism detection, journal rules against AI use by editors, accuracy questions, and possible extensions to medical literature.
This is both an interesting experiment and a sign of a tsunami coming for academia. AIs retroactively reading the research and finding both opportunities and issues with published papers, then sharing those judgements publicly.
90.4K
8 posts, first seen 12h ago
Wharton professor Ethan Mollick shares an AI leaderboard that scores finance and economics papers.
Ethan Mollick posted that AIs are retroactively reading published finance and economics papers, identifying opportunities and issues, then sharing those judgments publicly. He described the AI Referee Paper Leaderboard as both an interesting experiment and a sign of a tsunami coming for academia. The leaderboard comes from Georgetown University's AI, Analytics, and the Future of Work Initiative and uses an ensemble of LLM referees to score working papers. Visible replies raised points about plagiarism detection, journal rules against AI use by editors, accuracy questions, and possible extensions to medical literature.
This is both an interesting experiment and a sign of a tsunami coming for academia. AIs retroactively reading the research and finding both opportunities and issues with published papers, then sharing those judgements publicly.


#3
#3