Announcement
Neuron Lens database debuts for Gemma 4 12B and Qwen 3 8B
Neuron Lens's creators report thousands of Gemma 4 12B neurons firing for the same concept across text, images and sound.
TLDR
The creators say their database covers every neuron and attention head in Gemma 4 12B and Qwen 3 8B, with the tools used to build it available online. They say their R-lens qualitatively predicts the result of steering over 90% of the time, though its accuracy falls in early layers. Their S-lens is more accurate in those layers, while mid-lenses help decipher attention outputs and MLP inputs.
Combined views
4.8K
7 Sources, first seen ago
