/Tech4h ago

Rohan Anil and Lucas Beyer defend the historical DALL-E mini optimizer debate as a constructive, empirical exchange

It compared the performance of Adam, Adafactor, and Distributed Shampoo

7661148.2K
rohan anil
Lucas Beyer (bl16)#72
Original post
rohan anil@_arohan_#102inTech

This post is older than my oldest kid.

Yes, there was drama some created by others on the edges.

There was a technical disagreement, there was technical conversation of substance, including training runs, logs and bugs filed and as far was I know.

The 25 people on earth who care about muon, shampoo, psgd, kfac, spectral descent learned something new or was reminded of something old

Yassine Yousfi@yassineyousfi_

TB to some good old days of drama free ML twitter collaboration dalle-mini🥑 @_arohan_ @borisdayma and others...

10:39 AM · Jun 11, 2026 · 7.5K Views
Sentiment

Users praise the respectful exchange around Rohan Anil's early DALL-E Mini optimizer experiments because it highlights dedication to open and reproducible science.

Pos
100.0%
Neg
0.0%
3 comments with sentiment.
Cluster Engagement
Posts from X
Most Activity
Most Activity
VIEWS874BOOKMARKS2LIKES5
Lucas Beyer (bl16)@giffmana

@_arohan_ @zacharynado I think it was a good and respectful back sand forth on both sides. Definitely entertaining to watch :)

rohan anil@_arohan_

This post is older than my oldest kid.

Yes, there was drama some created by others on the edges.

There was a technical disagreement, there was technical conversation of substance, including training runs, logs and bugs filed and as far was I know.

The 25 people on earth who care about muon, shampoo, psgd, kfac, spectral descent learned something new or was reminded of something old

2hViews 874Likes 5Bookmarks 2
Yassine Yousfi@yassineyousfi_

@_arohan_ Those 25 people also care deeply about open and reproducible science. And that's gold.

4hViews 392Likes 3
Invincible@InvincibleEdge

@_arohan_ 25 people on earth who were actually in the trenches know that was a real one

4h
Blissy@BlissyOnX

@_arohan_ "the 25 people on earth who" got cut off but honestly that missing end is the best part of the post

4h
Rugbist@rugbist_

@_arohan_ idk 25 ppl on earth remember it but the ones who do bring receipts every time

4h