7h ago

Pope's New Encyclical Adds Nuance to Binary AI Debate

0
Original post

.@Willob on @Pontifex's "Magnifica Humanitas" encyclical, from NEWER THINGS: "One thing I’m very happy about is the depth that this is bringing to the AI debate. "In my opinion, the AI debate here in San Francisco has been reasonably flat so far. It’s been AI Doomer versus AI Optimist. Acceleration versus Risk. Go slower versus Go faster. "Everyone weighing in on it has skin in the game. They run a lab, they invest in a lab, they’re trying to win an election, they’re trying to stop a data center in a district. "The Pope doesn’t. He is very explicit in advocating that he’s really grounded in the common good here. "I think it’s a great gift to humanity that we have this institution with a 2,000-year-plus track record of weighing in on topics relating to the human condition, that really doesn’t have any skin in the game, that can guide us at this moment in time. "Obviously, there have been many callbacks to Rerum Novarum, but in that instance, Pope Leo walked into a similarly flat debate: capital versus labor, Marxism versus unconstrained capitalism. He refused the binary and introduced a nuance that neither side was offering. "My hope is that Magnifica Humanitas does the same for AI."

1:33 PM · May 26, 2026 View on X

As noted elsewhere, I disagree with a bunch of claims made in paragraph 99 of the encyclical but I also agree with @kvallier that that was not the key part.

The key thing I take away is a strong warning about concentration of power and hubris, which could not be more timely.

3:08 AM · May 27, 2026 · 1.1K Views

In some ways the situation (hubris wise and power wise) is much worse than the encyclical contemplates precisely *because* AIs do really think, contra p. 99*, but the larger message is valid anyway.

*as I initially read it, at least. Some view the first sentence as a key caveat

Miles BrundageMiles Brundage@Miles_Brundage

As noted elsewhere, I disagree with a bunch of claims made in paragraph 99 of the encyclical but I also agree with @kvallier that that was not the key part. The key thing I take away is a strong warning about concentration of power and hubris, which could not be more timely.

3:08 AM · May 27, 2026 · 1.1K Views
3:14 AM · May 27, 2026 · 361 Views

Even if "real" AGI/superintelligence aren't possible or imminent, calling attention to the insularity/lack of accountability around "merely" civilization-shaping AI is good.

And I predict at least some evolution in the Catholic Church's view on the nature of AI later.

Miles BrundageMiles Brundage@Miles_Brundage

In some ways the situation (hubris wise and power wise) is much worse than the encyclical contemplates precisely *because* AIs do really think, contra p. 99*, but the larger message is valid anyway. *as I initially read it, at least. Some view the first sentence as a key caveat

3:14 AM · May 27, 2026 · 361 Views
3:19 AM · May 27, 2026 · 270 Views

I hope many folks involved in AI development -- who are addressed directly in at least one passage I can recall -- read + consider it.

Miles BrundageMiles Brundage@Miles_Brundage

Even if "real" AGI/superintelligence aren't possible or imminent, calling attention to the insularity/lack of accountability around "merely" civilization-shaping AI is good. And I predict at least some evolution in the Catholic Church's view on the nature of AI later.

3:19 AM · May 27, 2026 · 270 Views
3:23 AM · May 27, 2026 · 185 Views

Best way to read it btw

clare ❤️‍🔥clare ❤️‍🔥@clarejtbirch

Made a reader edition of Magnifica Humanitas, Pope Leo XIV's encyclical on AI bc the Vatican site is hard to nav. It includes Tufte-style marginalia for the Vatican's footnotes + 78 Claude editorial annotations w/ Wikipedia links, and an optional silly little attention overlay.

11:14 PM · May 26, 2026 · 59.2K Views
3:32 AM · May 27, 2026 · 428 Views

P.S. It's not the point of this thread or the encyclical IMO but briefly on p. 99, my beef with it is that that lumping all of [humanness, intelligence, learning, consciousness, etc.] together in a brief para begs the key Q, which is whether and how they might be "unbundled."

Miles BrundageMiles Brundage@Miles_Brundage

Best way to read it btw

3:32 AM · May 27, 2026 · 428 Views
3:45 AM · May 27, 2026 · 158 Views