Announcement
A new paper proposes a scientific theory of atomic features
The authors say their experiments found that SAEs of different sizes and training data share many features.
TLDR
The authors say their paper mathematically derives testable predictions about atomic features. They report that SAEs of different sizes and training data share many features, and that large SAEs recover both parent and child features—results they say challenge conventional wisdom.
Combined views
—
2 Sources, first seen ago
