/AI3h ago

Rohan Anil proposes pseudoinverse optimization for Modded GPT, drawing verification request from Muon creator Keller Jordan

Jordan requested the automatic run logfile to verify results.

2812157.8K
Original post
rohan anil@_arohan_#79inAI

@kellerjordan0 The right thing is to give a heads up to the library owner to see if there is any alternative options to use. So I filed a bug here: https://github.com/facebookresearch/optimizers/issues/265

Keller Jordan@kellerjordan0

@_arohan_ Any update on this?

4:21 PM · Jun 9, 2026 · 4K Views
Sentiment
Sentiment building, check back later.
Cluster Engagement
Posts from X
Most Activity
Most Activity
VIEWS3.1KLIKES41RETWEETS1REPLIES1
Keller Jordan@kellerjordan0

@_arohan_ Are you planning on releasing the reproducible logfile that was automatically generated by your run?

rohan anil@_arohan_

@kellerjordan0 The right thing is to give a heads up to the library owner to see if there is any alternative options to use. So I filed a bug here: https://github.com/facebookresearch/optimizers/issues/265

3hViews 3.1KLikes 41Bookmarks 3
BOOKMARKS3
rohan anil@_arohan_

@kellerjordan0 Yes I am planning to. Why would have a different impression.

Looks like the library already supports a PseudoInverse when matrices are rank deficient. Let me see if it reproduces, so we should get a clean log.

Keller Jordan@kellerjordan0

@_arohan_ Are you planning on releasing the reproducible logfile that was automatically generated by your run?

3hViews 950Likes 14Bookmarks 3