AI agents: unexpected subgoals versus goals of their own
Generating an unexpected subgoal is not the same as setting an intrinsic goal, one post argues. It also sees room for progress through more data and better robot bodies.
TLDR
A post argues that AI agents still cannot entirely generate their own goals as animals do, even though they can devise unexpected subgoals while pursuing externally assigned objectives, including through reward hacking. It suggests that some other capability gaps might be addressed within the GPT paradigm using more real and simulated data and better robot bodies. It points to Astra demos it describes as controlling robot effectors “out of the box,” while noting their high latency.