Reaction
An excerpt from Dario Amodei’s unpublished 2017 AI-scaling document is being published
Kevin Roose says “Big Blob of Compute” laid out Amodei’s hypothesis that scaling models was the best way to make them smarter.
TLDR
Kevin Roose says he is publishing an excerpt from “Big Blob of Compute,” an unpublished internal research document Amodei wrote at OpenAI in 2017. Roose argues the essay helped start the AI race: he says GPT-2 tested Amodei’s scaling hypothesis, and its success led OpenAI to focus on scaling. A reply asks to read more of the dense, technical material.
Combined views
18
1 Source, first seen ago