TLDR

A researcher whose lab produced the work says Muon appears better than AdamW after pretraining but performs worse after fine-tuning as pretraining data scales up. Catherine Li was set to present the findings at MOSS on October 10. A separate MOSS invitation pointed to discussion about what people can meaningfully contribute without huge resources, including in academia.

Announcement

Muon appears better than AdamW after pretraining but worse after fine-tuning as pretraining data scales up

A lab researcher said Catherine Li would present the new Muon–AdamW work at MOSS on October 10.

1 Source, 1h ago, first seen 1h ago

TLDR

Today's Rank

—

Not ranked yet

Combined views

—

1 Source, first seen 1h ago

— likes— comments— saves— reposts

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.