Llms have made it easy to now spam methodological improvements that are largely bordering noise.
I don’t know what the phenomena is called:
Sometimes the field mines improvements near a local neighborhood.
Like Adam -> (badam, dadam, madam), Shampoo -> Muon -> (Duon, Buon, Luon), last few made up instead of questioning whether the original formulation itself is the right question. You get so much math explaining these variants bordering slop. Same happened with Transformers too.
Mathematically sophisticated but solving the wrong problem.

