Claude Proposes Spline-Based SAE Variant With Curved Manifold Features

Claude came up with the idea of a SAE, except decomposed into many splines instead of standard 1D features. Each feature would then be its own possibly curved manifold