@amosaurusrex
MSc student at Tel-Aviv University working on ML/DL
AI
A post introducing the preprint says LIFT uses teacher-supervised training to tackle a bottleneck in how language models pass information between layers.