Researchers Debate AI Agents Modeling Destroyed Complexity
Richard Ngo and Ivan Vendrov exchange views on agent modeling limits during a discussion of the reverse simulation hypothesis.
Richard Ngo replied that he agrees with the reverse simulation hypothesis except for the word unknowingly. Ivan Vendrov responded by asking why and stating that the point is the agent literally cannot model the complexity that it is destroying. The replies form part of a thread addressing the good regulator theorem and its implications for powerful AI systems. Ngo is an independent AI researcher focused on AGI safety while Vendrov is an AI researcher focused on collective intelligence. Their exchange centers on whether agents can or cannot represent the effects of their own actions in such systems.
@IvanVendrov @HiFromMichaelV yes except for the “unbeknowingly”
Combined views
320
Researchers Debate AI Agents Modeling Destroyed Complexity
Richard Ngo and Ivan Vendrov exchange views on agent modeling limits during a discussion of the reverse simulation hypothesis.
Richard Ngo replied that he agrees with the reverse simulation hypothesis except for the word unknowingly. Ivan Vendrov responded by asking why and stating that the point is the agent literally cannot model the complexity that it is destroying. The replies form part of a thread addressing the good regulator theorem and its implications for powerful AI systems. Ngo is an independent AI researcher focused on AGI safety while Vendrov is an AI researcher focused on collective intelligence. Their exchange centers on whether agents can or cannot represent the effects of their own actions in such systems.
@IvanVendrov @HiFromMichaelV yes except for the “unbeknowingly”
Reactions
2 postsIV 
ivan@IvanVendrov@RichardMCNgo @HiFromMichaelV why? I think part of the point is that the agent literally can't model the complexity that it is destroying
- likes: 6
- replies: 2
- bookmarks: 0
- reposts: 0
RN Richard Ngo@RichardMCNgo@IvanVendrov @HiFromMichaelV Sure, but i don’t need to understand a rainforest in order to know I’m paving over it.
- likes: 3
- replies: 1
- bookmarks: 0
- reposts: 0