Researchers reportedly hid a secret-trigger neural network in AI model weights
A user says they open-sourced code to detect such a network locally and wrote a checklist for verifying models.
TLDR
A user says researchers encrypted a small neural network behind a Keccak locker in AI model weights, so it would run only on a secret trigger. The user says fine-tuning, noise and trigger searches failed to find it. They also say they open-sourced local-scale detection code and wrote a ten-point checklist for tracking and verifying models, plus a prompt for testing vendor safety claims against this limitation.
Combined views
—
1 Source, first seen ago