Loading activity…
@xinyu2ml
Building open frontier intelligence. Opinions are my own. They/Them
AI
Xinyu2ML puts prefill at roughly 4× a same-size standard Transformer’s cost, with per-token decoding close to parity.
AI
The researchers report lower held-out loss than MoE and dense baselines at scales from 100M to 1B active parameters.
X
