Paragraph 99 of the document denies AI moral conscience.
@deanwball Oh — I read you as saying that their substance disagreed, which it does not. Instead, you are saying that the Pope expressed confidence in P and Olah implied people should be open to not P. I wouldn't have called that flatly contradicting.
@tobyordoxford I’m really not wrong about this. Olah wasn’t claiming AI feels anything, but he was expressing a level of uncertainty that is quite obviously not shared by the encyclical.
Many users dismissed optimistic readings of the Pope's encyclical on AI consciousness as wishful thinking or insane contradictions from Anthropic and Olah, while a few called the engagement and open door positive signs.
No Digg Deeper questions have been answered for this story yet.
I think this is a completely insane reading of the encyclical given the broader context. The document makes categorical claims about all aspects of AI cognition. When the Pope says “AI cannot,” the emphasis is not on the present tense but on the categorical subject of the sentence: “AI.” He is saying “AI can never.” You know this because the document opens with a statement about how they want to avoid making claims about AI too grounded in the present, because of how fast AI changes. They deliberately commit themselves to evergreen statements about AI and then say that. I think you and other safety people are reading the document wishfully because you sense a new ally, which would not be the first time AI safety people have viewed a new ally through rose-colored glasses, only to be screwed by that ally later on.
To mitigate sycophancy, the new "I cut, you choose" (when e.g sharing a sandwich) for resolving debates with AI should be "One of us gets to portray our POV as being that of the user, and the other of us gets to write the prompt"
I put your take, the encyclical, JCL's blog post, my tweet into Claude and here was its reaction FWIW:
"Reading the actual text against both interpretations, I think you're closer to right than Dean, but his reading has more force than the response acknowledges, and the honest answer involves real ambiguity.
Dean's strongest point: paragraph 99's language genuinely is unqualified. "Do not undergo experiences, do not possess a body, do not feel joy or pain… do not have a moral conscience… do not understand what they produce." There's no "current systems" hedge in the operative sentences. If the Church wanted to leave the door visibly ajar, the easy move was a single qualifier — "today's systems," "as currently designed" — and that move was conspicuously not made. Combined with the metaphysical-sounding grounds ("they lack the affective, relational and spiritual perspective"), the surface text reads like a categorical claim about what AI is, not a status report on GPT-5.
That said, four things push me toward your reading:
First, the grounds given are a mix. "Do not possess a body" and "do not mature through relationships" are not in-principle impossibilities — embodied systems exist, and "maturing through relationships" is a description, not a metaphysical barrier. The categorical-sounding bits ("spiritual perspective") sit alongside contingent-sounding bits. If the Pope wanted a clean Thomistic case — only rational souls directly created by God can have inner life, full stop — that case is available in the tradition and he didn't make it. He chose mixed, somewhat empirical grounds, which is a meaningful choice.
Second, the meta-text matters. Paragraph 97 explicitly limits scope: "I limit myself to recalling a few essential elements for a moral and social discernment." Paragraph 98 frames current systems as "cultivated" rather than "built," with their internal workings unknown — an open epistemic posture. The encyclical also flags that "any statement regarding AI risks becoming quickly outdated." This is not the register of a Church closing a question; it's the register of a Church reserving the right to revise.
Third, the dog that didn't bark. The Vatican has a well-established machinery for closing theological questions — dogmatic definitions, conciliar statements, CDF declarations. None of that was used. An encyclical is magisterial but not the genre you reach for to settle whether a class of entities can have inner experience. And as Levin notes, Antiqua et Nova a year earlier engaged the consciousness question more directly and was also hedged; the trajectory is toward "needs further study," not toward closure.
Fourth, the launch staging. If Czerny really said in pre-approved remarks that this "deserves attention and further study," and Olah was platformed to advance a "AI consciousness is a live concern" view without contradiction — that's the Church telegraphing where it actually is, more reliably than parsing individual paragraphs. Vatican communications don't accidentally let key advisors freelance on doctrinally settled questions in front of the Pope.
So I'd put it this way: the surface text leans Dean's direction, but the structural choices — what genre, what advisors, what was conspicuously not said, what was endorsed at launch — all lean your direction. The Church is making the strongest claim it can comfortably make about current systems while declining to bind future judgment. That's not the same as "open-minded" in the way an AI researcher would mean it; the underlying Thomistic anthropology probably does think machine consciousness is impossible. But they're deliberately not cashing that out into doctrine, and the gap between "what we suspect" and "what we'll define" is exactly the space you can work in.
One thing worth flagging if this becomes a longer back-and-forth with Dean: he's not crazy to read it categorically, and the response that just asserts "no it's clearly open" without engaging the actual language risks looking like motivated reading. The stronger move is to concede that the text sounds categorical, then point to the genre, the structural choices, and the launch context as evidence the Church is being more careful than the prose suggests. That's harder to dismiss."
I put your take, the encyclical, JCL's blog post, my tweet into Claude and here was its reaction FWIW:
"Reading the actual text against both interpretations, I think you're closer to right than Dean, but his reading has more force than the response acknowledges, and the honest answer involves real ambiguity.
Dean's strongest point: paragraph 99's language genuinely is unqualified. "Do not undergo experiences, do not possess a body, do not feel joy or pain… do not have a moral conscience… do not understand what they produce." There's no "current systems" hedge in the operative sentences. If the Church wanted to leave the door visibly ajar, the easy move was a single qualifier — "today's systems," "as currently designed" — and that move was conspicuously not made. Combined with the metaphysical-sounding grounds ("they lack the affective, relational and spiritual perspective"), the surface text reads like a categorical claim about what AI is, not a status report on GPT-5.
That said, four things push me toward your reading:
First, the grounds given are a mix. "Do not possess a body" and "do not mature through relationships" are not in-principle impossibilities — embodied systems exist, and "maturing through relationships" is a description, not a metaphysical barrier. The categorical-sounding bits ("spiritual perspective") sit alongside contingent-sounding bits. If the Pope wanted a clean Thomistic case — only rational souls directly created by God can have inner life, full stop — that case is available in the tradition and he didn't make it. He chose mixed, somewhat empirical grounds, which is a meaningful choice.
Second, the meta-text matters. Paragraph 97 explicitly limits scope: "I limit myself to recalling a few essential elements for a moral and social discernment." Paragraph 98 frames current systems as "cultivated" rather than "built," with their internal workings unknown — an open epistemic posture. The encyclical also flags that "any statement regarding AI risks becoming quickly outdated." This is not the register of a Church closing a question; it's the register of a Church reserving the right to revise.
Third, the dog that didn't bark. The Vatican has a well-established machinery for closing theological questions — dogmatic definitions, conciliar statements, CDF declarations. None of that was used. An encyclical is magisterial but not the genre you reach for to settle whether a class of entities can have inner experience. And as Levin notes, Antiqua et Nova a year earlier engaged the consciousness question more directly and was also hedged; the trajectory is toward "needs further study," not toward closure.
Fourth, the launch staging. If Czerny really said in pre-approved remarks that this "deserves attention and further study," and Olah was platformed to advance a "AI consciousness is a live concern" view without contradiction — that's the Church telegraphing where it actually is, more reliably than parsing individual paragraphs. Vatican communications don't accidentally let key advisors freelance on doctrinally settled questions in front of the Pope.
So I'd put it this way: the surface text leans Dean's direction, but the structural choices — what genre, what advisors, what was conspicuously not said, what was endorsed at launch — all lean your direction. The Church is making the strongest claim it can comfortably make about current systems while declining to bind future judgment. That's not the same as "open-minded" in the way an AI researcher would mean it; the underlying Thomistic anthropology probably does think machine consciousness is impossible. But they're deliberately not cashing that out into doctrine, and the gap between "what we suspect" and "what we'll define" is exactly the space you can work in.
One thing worth flagging if this becomes a longer back-and-forth with Dean: he's not crazy to read it categorically, and the response that just asserts "no it's clearly open" without engaging the actual language risks looking like motivated reading. The stronger move is to concede that the text sounds categorical, then point to the genre, the structural choices, and the launch context as evidence the Church is being more careful than the prose suggests. That's harder to dismiss."
@inductionheads Where did I say the models have emotions?
Nah that's not it - I'd be happy to coordinate with the church on points where we agree even if they were totally wrong about AI consciousness, and would just shrug my shoulders about it.
It's more I'm relying on @JohnClarkLevin having a better ability to interpret encyclicals and church tea leaves than me (he's a very engaged Catholic).
@deanwball @robertwiblin The Pope took a *very clear* stance on the idea of “true” machine intelligence, sentience, and moral agency. While it’s possible that he (or a later Pope) will reconsider these questions down the line, IMO it’s wishful thinking to read Magnifica Humanitas as leaving them open.
@inductionheads I don’t think models have human-like emotions… I was pointing out that Olah and the Church are contradicting one another on what seems like a fundamental point.
@inductionheads they are clearly contradicting one another. it’s insane to read the communications of olah in particular and anthropic in general, and then the encyclical, and pretend those things aren’t in stark contradiction.
@deanwball Yeah, functionally mirror does not mean “feel”
So they are not contradicting one another
@robertwiblin This is all fair! I’m among the hand-wringers, but I agree that these are positive signs.
@deanwball I’ve never seen Anthropic say they think definitively that these models “feel”, but anyway they were more aligning themselves with the need for discourse than saying they agree with every point in the document
@segyges @deanwball @robertwiblin I think *Olah* felt it was important for him to push back on. That doesn’t mean that they (the Catholic Church) thought it was notable.
Either way, yes I agree that most of the commentary is focused on random non-central points.
@ChrisPainterYup Yeah Rob's practice there is quite a bit worse than I would've expected from him.
At a minimum when I want an LLM opinion I try to phrase the ask as neutrally as possible and ask in incognito mode.
@segyges @deanwball @robertwiblin I don’t think the authors thought it was important or controversial. It’s more of a wedge issue.
@robertwiblin @deanwball Don’t you think when you do this kind of thing you shouldn’t tell Claude, which is your perspective in which is your opponents perspective?
@CFGeek @deanwball @robertwiblin If you think the important thing is this philosophical claim the document is of course an extremely huge loss. If you don't it isn't
@CFGeek @deanwball @robertwiblin Olah made a point of very politely disagreeing with it, so it's important enough for them to push, but imho most of the external commentary is excessively focused on that specific disagreement or some other one
@robertwiblin A suffering machine would be a conscious machine with a "pain" signal which it is hardwired to try to be rid of and not be able to just ignore. As intensity increases, the machine is less able to do anything but try to remove the signal. +
@deanwball @robertwiblin I think you are overstating what the encyclical says. Based on your other comments, you seem to have expected a text that offers bold statements on speculative AI trajectories (and here are maybe projecting some statements onto it?), but that is simply not the aim of the text
Your critique assumes that the Church is playing catch-up to the existential implications of AGI, but it misses a critical distinction: Catholic theology is crystal clear on why your underlying premise is ontologically untenable.
You are treating AGI through a crypto-religious, almost Gnostic lens - elevating a highly sophisticated synthesis of created matter into a pseudo-divine entity. From the perspective of classical theology, the claim that humanity is on the verge of creating a new 'mind' or an autonomous source of being is a modern revival of the Demiurgic problem.
In Catholic dogma, creatio ex nihilo (creation out of nothing) belongs strictly to God. Humans cannot create life or soul; we can only manipulate and rearrange what already exists. No matter how advanced a silicon-based network becomes, it remains an artifact, a tool of human agency, not a new locus of being.
Furthermore, the transhumanist obsession with post-singularity 'god-like' superpowers, mind uploading, and escaping our biological reality is not a novel philosophical frontier. It is an ancient heretical loop. It is the Faustian bargain repackaged: the promise of Eritis sicut dii ('you will be like God') through technological Pelagianism - the belief that humanity can engineer its own salvation and immortality without grace, sacrifice, or incarnation.
When the Papacy addresses AI, the refusal to delve into petty manchild phantasies of neo-californian ideology, sci-fi scenarios about a rogue mechanical deity or digital ascension isn’t due to a lack of awareness. It is a deliberate, strategic refusal to validate rather "blasphemic" and non-ironically Hermetic assumptions. To engage with AGI as a potential god or a soul-bearing entity would be to grant a heretical category error undeserved legitimacy.
Just be clear, and you can swear by the Trump Bible: The Church’s role is to demystify the technology. By anchoring the conversation strictly to human ethics, labor, and accountability, the Magisterium firmly reminds the world that the machine is just an instrument. The danger isn’t that the machine will become a god; the danger is that humans will foolishly abdicate their divinely given responsibilities to an idol of their own making.
