Pope's New Encyclical Adds Nuance to Binary AI Debate
As noted elsewhere, I disagree with a bunch of claims made in paragraph 99 of the encyclical but I also agree with @kvallier that that was not the key part.
The key thing I take away is a strong warning about concentration of power and hubris, which could not be more timely.
In some ways the situation (hubris wise and power wise) is much worse than the encyclical contemplates precisely *because* AIs do really think, contra p. 99*, but the larger message is valid anyway.
*as I initially read it, at least. Some view the first sentence as a key caveat
As noted elsewhere, I disagree with a bunch of claims made in paragraph 99 of the encyclical but I also agree with @kvallier that that was not the key part. The key thing I take away is a strong warning about concentration of power and hubris, which could not be more timely.
Even if "real" AGI/superintelligence aren't possible or imminent, calling attention to the insularity/lack of accountability around "merely" civilization-shaping AI is good.
And I predict at least some evolution in the Catholic Church's view on the nature of AI later.
In some ways the situation (hubris wise and power wise) is much worse than the encyclical contemplates precisely *because* AIs do really think, contra p. 99*, but the larger message is valid anyway. *as I initially read it, at least. Some view the first sentence as a key caveat
I hope many folks involved in AI development -- who are addressed directly in at least one passage I can recall -- read + consider it.
Even if "real" AGI/superintelligence aren't possible or imminent, calling attention to the insularity/lack of accountability around "merely" civilization-shaping AI is good. And I predict at least some evolution in the Catholic Church's view on the nature of AI later.
See also:
Best way to read it btw
Made a reader edition of Magnifica Humanitas, Pope Leo XIV's encyclical on AI bc the Vatican site is hard to nav. It includes Tufte-style marginalia for the Vatican's footnotes + 78 Claude editorial annotations w/ Wikipedia links, and an optional silly little attention overlay.
P.S. It's not the point of this thread or the encyclical IMO but briefly on p. 99, my beef with it is that that lumping all of [humanness, intelligence, learning, consciousness, etc.] together in a brief para begs the key Q, which is whether and how they might be "unbundled."
Best way to read it btw