Loading activity…
@songlinyang4
pretraining @thinkymachines. Prev. PhD @MIT_CSAIL. INTP 🐱. she/her/hers.
AI
A poster says they've figured out how to use zeroth-order optimization for transformer pretraining and argues that many core assumptions in optimization research are wrong.
AI
A critic says KLPO has 50-plus pages of prose and formulas, plus code on GitHub—but no experiments.
AI
@aliteracy shares a finding on knowledge distillation between similar and distant model architectures.
AI
The researcher credits extensive GPU resources from the AI lab in his announcement.
AI
Compact multimodal model matches original performance at quarter the size.
AI
Horace He proposes that effective ML techniques increase operational demands on infrastructure teams.
AI
Co-founder announces exit citing health toll from startup demands and highlights key model milestone.
