Announcement
Bespoke Labs: Nearly half of AI research runs spend 24 hours on idea one
Bespoke Labs reports bigger gains after trying new approaches in AutoResearchExam, with benefits concentrated early.
TLDR
In 348 AutoResearchExam runs across 12 models, Bespoke Labs found 47% stayed with their first broad approach for all 24 hours. So much for brainstorming. Switching to a new approach was followed by roughly nine times the validation-score gain of a refinement step, mostly in the first six hours. The lab found no link between switching after hour 12 and greater late test-score gains.
Combined views
575
4 Sources, first seen ago

Comments