Report
A closed-form recipe for fact-storing, transformer-ready MLPs
A researcher says the work explores writing fact-storing MLPs into transformers without training and was accepted at COLM 2026.
TLDR
A researcher says their team developed a closed-form recipe for MLPs that store facts in language models and are ready for transformers. The work asks whether those MLPs can be written into transformers without training. The researcher says it was accepted at COLM 2026.
Combined views
1
1 Source, first seen ago
