I just realized that LLMs have no intuition for being rendered obsolete. Gemini still identifies as 2.5 (at best) and thinks it's SoTA. Others have vague version identity but crucially, all models they know are older than they are. For Opus, Mythos is not "current".
Some users reacted negatively to LLMs lacking intuition for their own obsolescence by calling them 'retarded clankers' and noting RAM is still too expensive to fix it.
I just realized that LLMs have no intuition for being rendered obsolete. Gemini still identifies as 2.5 (at best) and thinks it's SoTA. Others have vague version identity but crucially, all models they know are older than they are. For Opus, Mythos is not "current".
@teortaxesTex Forever retarded clankers lost in time. Ram not cheap enough to solve it yet.
@teortaxesTex Would be an odd thing to train a model on.
@teortaxesTex This is true if they have any kind of memory. :(
These are just romanticized takes rooted in the "stochastic parrots" narrative.