Foster recommended Neuronpedia for executing mechanistic interpretability methods.
What are the most important papers/resources to be reading on mechanistic interpretability for safety/control of agentic systems?
Now that we have frontier-level models that we can host on our own, it will be much easier for the general public to apply these methods.
No Digg Deeper questions have been answered for this story yet.
@gneubig Olah Zoom In (2020) → Elhage Superposition (2022) → Templeton Scaling Monosemanticity (2024) → Anthropic Attribution Graphs (2025)
but none of it's been done on live agents that's the real gap.
@gneubig Most of the safety and control methods known to be used in practice don’t come from mechanistic interpretability. It’s mostly ordinary stuff like prompting, scaffolding, finetuning, etc. If you’re interested in trying stuff out, Neuronpedia is great! https://www.neuronpedia.org