
@DhruvBatra_ we deleted feature engineering only to invent training engineering
The pipeline spans mid-training, reinforcement learning, and iterative policy discovery.
Some users expressed agreement with the claim that AI training pipelines are growing more complex due to multi-stage post-training loops.

@DhruvBatra_ we deleted feature engineering only to invent training engineering

Not an argument for it but the current cycle between simplicity and complexity feels quite natural. When squinting, this is Kuhn's argument around progress in science and Gabriel's for software.
New paradigm enables and even forces simplicity, because it works well in its pure form and because we don't understand it well enough yet to improve it with complex variants.
Over time improvements become more specific (to enable short term gains) and harder to build upon due to complexity correlations across all previous variants.
We get fed up with complexity, improvements are slower, and after a while we find a new paradigm...

@0x00_void Amen!

@DhruvBatra_ real recognize real. those old NLP pipelines had more stages than a Marvel movie and still underfit.

@DhruvBatra_ It's also a very human thing in general. I wonder if there's work relating it to organizations and political systems..