The argument that sincere AI-risk beliefs can fuel unchecked power-seeking
A writer who says rationalism, LessWrong and effective altruism shaped their upbringing argues that sincere conviction about AI’s stakes can be more dangerous than cynical ambition.
TLDR
A writer who says they grew up strongly influenced by rationalism, LessWrong and effective altruism argues that sincere belief, not just greed, can fuel dangerous power-seeking. They contend that many in those circles see AI’s stakes as effectively infinite and believe a good outcome requires total control of AI development—which the writer argues would require global governance and a surveillance state. The writer compares that single-minded pursuit to the unconstrained power-seeking those same circles warn about in artificial general intelligence.
Combined views
71.8K
2 Sources, first seen 5h ago
The argument that sincere AI-risk beliefs can fuel unchecked power-seeking
A writer who says rationalism, LessWrong and effective altruism shaped their upbringing argues that sincere conviction about AI’s stakes can be more dangerous than cynical ambition.