This has long been a fascinating question for me. My conjecture is that world is less of an “environment” and more of an agent. So, this is actually a self-play scenario where complexity keeps increases and eventually things become purely random to achieve the highest entropy. You can see this in markets where predictive power have significantly reduced.
a fun proxy for gradual disempowerment: is the world getting more predictable/less surprising to AIs?