HOPE Framework Quantifies Neuron Capacity in Deep Networks
Reactions from ranked influencers
2 posts
Excited to share about what I’ve been working on over the past year: quantifying the capacity of a neuron😅 This led to a mathematical framework we call HOPE, which lets us rigorously deconstruct what deep networks might have learned. Paper: https://arxiv.org/abs/2607.21366
7/13 Usually, you would approximate the integral using finite data by passing massive datasets through the network. But HOPE evaluates it analytically in closed form! Since neurons perceive inputs as 1D Gaussians (by the Central Limit Theorem), we can build an exact continuous surrogate using BatchNorm stats.