8h ago

Lucas Nestler, HeavyBall creator, benchmarks six automated hyperparameter optimizers and finds none can replicate manually tuned baseline speedrun settings

The analysis spanned more than 1,000 individual tuning trials

——0——
Original post
OPLucas Nestler#1709Lucas Nestler@CLASHLUKE

After over 1000 tuning trials using various hyperparameter optimizers, the comparison remains meaningless. No algorithm gets close to rediscovering the speedrun's hyperparameters. Tested were: * HEBO * PROTEIN * BOHB * TPE * CMA-ES * HEBO-PROTEIN

2:11 AM · May 29, 2026 View on X
Reposted by
Aaron Defazio#755@AARON_DEFAZIO
Lucas Nestler, HeavyBall creator, benchmarks six automated hyperparameter optimizers and finds none can replicate manually tuned baseline speedrun settings · Digg