/AI2h ago

DeepMind's Séb Krier questions instrumental convergence and asks for literature explaining the logic of AI power-seeking

David Manheim asked Krier to specify his exact objections.

--0--
Original post
Séb Krier@sebkrier#505inAI

@davidmanheim @eschatropic @JeffLadish What is the best single piece/article you have explaining the logic here, apart from the Christiano LW post or Carlsmith 2022 paper? I continue to be skeptical of the rationalist account of power seeking and instrumental convergence.

11:57 AM · May 31, 2026 · 59 Views
Sentiment
Sentiment unavailable for this story.
Cluster Engagement
-
Views
-
Comments
-
Reposts
-
Bookmarks
Expand data
Posts from X
Most Activity
Most ActivityTimeline
VIEWS34REPLIES1
Séb Krier@sebkrier

@davidmanheim @eschatropic @JeffLadish A bunch of different things but don't think I'll have the time to elaborate on all aspects here, I'm mostly interested in collecting/re-exploring the key pieces about the worldview.

David Manheim@davidmanheim

@sebkrier @eschatropic @JeffLadish I'm not sure, but I don't really understand what's being questioned about the thesis; are you arguing that systems might not have goals, or that they might not want to achieve them, or that generally valuable resources and power might not help with doing so?

2hViews 34Likes 1Bookmarks 0
LIKES3
Jeffrey Ladish@JeffLadish

@sebkrier @davidmanheim @eschatropic I have some interest in writing this up

Séb Krier@sebkrier

@davidmanheim @eschatropic @JeffLadish What is the best single piece/article you have explaining the logic here, apart from the Christiano LW post or Carlsmith 2022 paper? I continue to be skeptical of the rationalist account of power seeking and instrumental convergence.

2hViews 30Likes 3Bookmarks 0