@TianzheC
Continual learning | PhD student @hkudatascience | Intern @amilabs. Previous @ShanghaiTechUni, visited @UCBerkeley.
AI
The researchers report lower held-out loss than MoE and dense baselines at scales from 100M to 1B active parameters.
AI
X
