Microsoft Research's John Langford links the new Self-Reset Policy Optimization method to 2015 'learning to search' frameworks

🚀New work on credit assignment in multi-step reasoning RL post-training🚀 Introducing Self-Reset Policy Optimization (SRPO): i) localize the first wrong reasoning step, ii) reset to that step, iii) learn from counterfactual continuations from there – no external supervision.🧵