Free us from sloptimizers -- a work in progress
Rohan Anil, CoreAutoAI co-founder, releases Optimizer Mines, a retro web game for learning machine learning optimizer formulas
Players reconstruct mathematical update rules through retro quiz mechanics
Users are excited about the interactive retro slot machine game for teaching machine learning optimizers, suggesting fun enhancements like sound effects.
No Digg Deeper questions have been answered for this story yet.
Most Activity
Best viewed on a desktop computer
Keep the feedback coming.
https://rohan-anil.github.io/optimizer-mines/
Free us from sloptimizers -- a work in progress
this is super fun, also a good way to learn new optimizer (there is also a quizz if you want to test your optimizer knowledge 🫡)
Best viewed on a desktop computer
Keep the feedback coming.
https://rohan-anil.github.io/optimizer-mines/
Here it is
Best viewed on a desktop computer
Keep the feedback coming.
https://rohan-anil.github.io/optimizer-mines/
@eliebakouch Adding sound effects for forging!
this is super fun, also a good way to learn new optimizer (there is also a quizz if you want to test your optimizer knowledge 🫡)

@_arohan_ shipped systems optimized to perfection.
every one broke in ways we never tested for.
the optimizer was fine. we just measured the wrong thing.

@eliebakouch The wild part is how few of these optimizer tricks survive contact with a real training run. Half the gains vanish once you tune the LR schedule properly.