Amjad Masad Links AI Risks to Thompson Trust Reflections
Replit founder shares thoughts on potential poisoned model training.
TLDR
Amjad Masad, founder and CEO of Replit, posted that Ken Thompson’s “Reflections on Trusting Trust” feels super relevant to AI. He described how Thompson bootstrapped a poisoned compiler that left no traces of the poison in the source code because it compiled itself. Masad suggested one can imagine the same thing happening with models where one poisoned generation helps train the next while removing any traces.
Combined views
15.1K
1 Source, first seen 27d ago