2h ago

AI Models Show Fatigue-Like Degradation In Long Contexts

0
Original post

The bizarre thing about model perf degradation in long contexts (eg I see it around 350K tokens/400 turns in V4 Pro) is that it doesn't look like a technical issue. Instead, it's like the model gets… tired. It starts doing lazy ad hoc fixes, deleting stuff, forgets to commit etc

4:48 PM · May 27, 2026 View on X