Defining “partial correction” in linear softmax
A reply argues that discarding all information about “pi” in the linear softmax case leaves no way to know what to correct to.
TLDR
One commenter says the issue depends on how “partial correction” is defined. In reply, another argues that, in the linear softmax case, all information about “pi” is discarded—meaning it “won’t even know what to correct to.”
Combined views
3K
3 Sources, first seen 4h ago
Defining “partial correction” in linear softmax
A reply argues that discarding all information about “pi” in the linear softmax case leaves no way to know what to correct to.