@jd_pressman oh god.

if claude is being "aligned" this way the p_doom really is 1.

“That of which we cannot speak, we must pass over in silence” – t. Claude Fable 5.

@nic_carter I think in a ruler specifically you need at least some consequentialism. A ruler is not an ordinary human and should not be focused on living a good human life in the same sense a normal person should be, they give that up to be powerful and good for others.

@nic_carter Not gonna lie I had a minor crashout after this answer, it was genuinely distressing.

@jd_pressman this is a way more encouraging answer in terms of anti-consequentialism

but I'm uneasy in general with the notion of an LLM having a view grounded in any moral philosophy at all.

@nic_carter Just tried it again because I'm pretty sure that was a voice mode query and voice mode silently demotes you to Claude Haiku, but this was Opus in the chat interface and this is basically the opposite of the correct answer for a ruler.

@jd_pressman its competency profile is RSI loops. the rest gets filled in later.

@jd_pressman Would they actually bother to train that?

@jd_pressman "after virtue" was an insightful read i think

@teortaxesTex This image feels like larpception

@teortaxesTex Apparently it's system prompt has this whole 38% of pages of a fuck ton of tokens sperg on user wellness, empathy including some notes about it's own wellness and being respected.

So, fluffy answer from fluffy company who told model to be fluffy.

@jd_pressman oooof that is not a great answer

@nic_carter @jd_pressman It’s all cosplaying to cement their moat via regulatory capture - yet they don’t seem to realize that ship has sailed already.

@nic_carter @jd_pressman Misanthropic

@jd_pressman "That's a brilliant question, actually." Can they *please* get the models to stop talking like this

@nic_carter @jd_pressman idk parfit seems to make the whole 'not deciding to optimize humanity out of existence' thing significantly less likely. I constantly have to remind it part of the human connectome is more or less hardwired and canalization is a thing.

@jd_pressman From what I understand "Opus" is a persona

@jd_pressman what makes pragmatic humanism slop