The phenomenon occurs via steering vector distillation.
Belinda Li#782
Subliminal learning is when LLMs transmit traits (e.g. loving cats) through seemingly meaningless data. What’s going on?
We find a simple explanation: it's just steering vector distillation.
We explain which traits transfer and why subliminal learning fails across models.
In our new paper, we find an explanation of why subliminal learning occurs. As ever, steering vectors!
Subliminal learning is when LLMs transmit traits (e.g. loving cats) through seemingly meaningless data. What’s going on?
We find a simple explanation: it's just steering vector distillation.
We explain which traits transfer and why subliminal learning fails across models.
The phenomenon occurs via steering vector distillation.
Belinda Li#782Subliminal learning is when LLMs transmit traits (e.g. loving cats) through seemingly meaningless data. What’s going on?
We find a simple explanation: it's just steering vector distillation.
We explain which traits transfer and why subliminal learning fails across models.
Many users praised researchers Camila and Agam for their work explaining subliminal learning in LLMs via steering vector distillation, highlighting its surprising results and helpful visualizations.