Note: they talk more about fine-tuning than some of their other technical bets they are investing in, and some of those other bets still make sense even if one isn't 100% sold on the fine-tuning story. I'm v. excited to see more augmentation-motivated UX exploration for example.

...but also a random fine-tuned model will have fewer attackers trying to break it, and... etc. The equilibrium seems unclear here, and I will be very interested to see how Thinky's thinking evolves on fine-tuning safety. Expecting more from them in the future here.

Maybe the answer is "a lot"/"completely"! I just don't know / have not thought as carefully about this as I'd like. I do think that concentration of power in a few companies/governments is a huge concern even if, from an efficiency perspective, prompting goes a long way...

...but is fine tuning the key lever there, vs. checks on those big companies, or competition among them, or (etc.)? And is cloud-based fine-tuning enough, or do you need straight up local open weight models? I dunno. I hope the essay sparks discussion!