Le conditionneur fat
Vlado Boza@bozavlado
If you really want to push it, Shampoo (with exponent -1/3 and 0.95 momentum for all accumulators) is 100-150 steps better than Muon.
8:19 AM · Jun 15, 2026 · 3.1K Views
Le conditionneur fat
If you really want to push it, Shampoo (with exponent -1/3 and 0.95 momentum for all accumulators) is 100-150 steps better than Muon.
Excuse my french, I meant
Le gros revitalisant
Le conditionneur fat

@_arohan_ avoid shampoo