Neural MMO creator Joseph Suarez argues hyperparameter-free optimizers fail in practice, disputing Vikhyat's proposal to prioritize them
Suarez says hyperparameter tuning algorithms work in practice
āā0āā
Suarez says hyperparameter tuning algorithms work in practice
Positive users hail hyperparameter-free optimizers as the holy grail worth pursuing, while negative users call the focus a waste of time on marginal gains and insist existing tuning methods work better.
3 comments with sentiment.
