Builder Urges Hugging Face To Add Cryptographic Signing For Open Models
Reactions from ranked influencers
2 posts
I think the most likely way this occurs is delivering a poisoned copy of an open model to an unsuspecting party, and you don't need to be China to do it. @ClementDelangue please build hf infrastructure for cryptographically signing models thx
I doubt we see Manchurian Candidate open weight models from China. It's technically possible and has the potential for short term advantage. But interpretability is coming along in leaps and bounds and there is every chance of failure and shame.
Cc @RisingSayak I see you guys were just exploring some stuff like this for kernel signing. Can you extend this to models? Threat model is different, but helps resolve at least some concerns about models modified to insert backdoors.