RLMs Navigate Broken States Despite Bugs in AI Setups