Neural MMO creator Joseph Suarez argues hyperparameter-free optimizers fail in practice, disputing Vikhyat's proposal to prioritize them
Suarez says hyperparameter tuning algorithms work in practice
āā0āā
Suarez says hyperparameter tuning algorithms work in practice
Positive users hail hyperparameter-free optimizers as an achievable holy grail for AI training, while negative users dismiss the concept as ineffective compared to existing hyperparameter tuning methods.
2 comments with sentiment.