Transluce's Neil Chowdhury initiated the debate on autoencoder utility.
@aryaman2020 what are your thoughts on natural language autoencoders?
Fable system card has 0 mentions of circuits, 1 mention of SAEs saying they didn't work for measuring grader awareness, and many mentions of contrastive probing (esp. emotions?) and natural language autoencoders
@ChowdhuryNeil they seem pretty cool but I'm sure the reason they're being used heavily is not bc they are more reliable than other methods but bc existing CoT monitoring techniques can probably be simply mapped onto them
@aryaman2020 what are your thoughts on natural language autoencoders?
Transluce's Neil Chowdhury initiated the debate on autoencoder utility.
@aryaman2020 what are your thoughts on natural language autoencoders?
Fable system card has 0 mentions of circuits, 1 mention of SAEs saying they didn't work for measuring grader awareness, and many mentions of contrastive probing (esp. emotions?) and natural language autoencoders