Yann LeCun details JEPA architecture mechanics and anti-collapse techniques in self-supervised learning
The 90-minute technical discussion also covered SIGReg and LeJEPA.
Story Brief
The 90-minute technical discussion also covered SIGReg and LeJEPA.
Commentary on X
Highest ranked
Yann LeCun@ylecunTECH
Super-fun in-depth discussion 🙏🙏🙏 World models, JEPA vs generative architectures, anti-collapse methods for JEPA SSL including contrastive, distillation, and information maximization methods, an explanation of SIGReg/LeJEPA/LeWM. Plus some bits on AMI Labs, Project Tapestry, as well as Lisp and homoiconic languages 😅
Laurent Denoue@ldenoueTECH
