At first, I was skeptical that autoresearch would do more than overfit to a validation set. Although it did overfit my new architecture to the specific dataset it was applied to, it also discovered many generalizable things I would not have thought to try. More to come...