The argument that AI power-seeking is an avoidable design choice
A writer challenging AI doomerism argues that “instrumental convergence” — the idea that intelligent agents will inevitably seek power and resources — is a contested assumption, not a settled truth.
TLDR
The writer says his arguments against AI doomerism have never rested on calling it a cult, though responses to his open letter and reporting by the New York Times and Wall Street Journal have made that comparison seem more plausible to him. He objects to treating instrumental convergence as inevitable, arguing that pursuing goals heedless of side effects and recklessly empowering AI are avoidable design choices, not inherent features of intelligence.
Combined views
60.3K
1 Source, first seen 12h ago