LLM Research Exhibits Anterograde Amnesia Causing Redundant Discoveries

LLM research literature sometimes feels like Memento mixed with Yesterday..

There is a strong Anterograde Amnesia that makes people seemingly forget even things known/done just a few years back.

This in turn paves the way for Columbus-like rediscovery of the wheel in a myriad ways (look Ma, I discovered Model-Based RL!🥳)

Reading those papers makes you feel like that guy in Yesterday scratching your head trying to understand the novelty.. #AIAphorisms