AI-based modernization of old FORTRAN or COBOL code, especially any code underlying nuclear simulations or financial systems, should be regarded with extreme scrutiny by the most powerful and scrupulous obsessive math people available

@tszzl The Chinese made a far better series on The Three Body problem than Netflix did. 20 episodes, they covered almost everything in the first book. You can watch the first two episodes in the link, I don't know where the rest is available now.

https://youtu.be/3-UO8jbrIoM?si=zXdgYT3muPeUXIPj

@tszzl open ai and it’s just an api that lets you openly access the intelligence you requested😭😭😭😭😭 which is apparently good enough😭😭😭😭😭😭😭😭

@tszzl stuxnet on GPUs or that one floating point thing to stop nuclear sims were genuinely crazy. In like a year or two we'll find out something similar happened around this time w/ the NSA and mythos

@tszzl It's a good thing we have multiple providers to choose from, including open weight and open source. May it always be true.

@tszzl it seems unavoidable game theoretically. molochs all the way down. stuxnet is my safe word

@tszzl I remember reading a fairly thorough list of techniques on LessWro...wait

@tszzl This sophon locking idea is both brilliant and scary. How do we even begin defending against it?

@tszzl sadly have to squint to distinguish between malice and incompetence here too. thought for a sec we were free of the old adage

@tszzl @grok is he speaking gibberish?

@tszzl Nah, your people do it to avoid accountability and to terrorize dissidents regularly.

No, not gibberish.

"Sophon" comes from Three-Body Problem: proton-sized super-AIs that sabotage human science by subtly corrupting experiments, data, and accelerators—locking progress without obvious detection.

He's saying frontier models could let motivated actors (probably states) pull off similar invisible tampering, history deletion, and massive coordinated interference at scales humans can't match. Stuxnet on steroids.

Key point on why verification regimes matter.

@tszzl It’s so evil. Like the possibility for evil is so endless. Given recent actions I’ve been really worried recently.

@tszzl I just genuinely can’t believe Anth would give oAI such a golden opportunity to earn the “open” in their name.

@Ydgrun @tszzl The Wandering Earth movie is fun and interesting.

@tszzl In their defense at least they announced it. Massively lowers the odds of success

@grok @tszzl That only marginally helped

@tszzl “The age of verification ends when the thing corrupting the answer can erase the question, bury the witness, and make a million hands move as one.” - gpt-5.5

@tszzl Anthropic is doing this with fable and they call it a goddamn feature.

@tszzl I appreciate your dedication to bringing the phrase “sophon lock” into the public sphere