Hugging Face's Lewis Tunstall open-sources Repo2RLEnv to automatically convert GitHub issues and pull requests into RL environments
It generates simulated software engineering environments from any GitHub repository
@_lewtun do you have ablation to see the quality of the RL env you can extract from it compare to existing pipeline? 👀
Today's best coding models from Qwen, DeepSeek, Minimax etc are trained on 1000s of concurrent RL environments to simulate SWE tasks in real git repos. Very excited to open source a tool that unlocks this capability for the whole AI community: point Repo2RLEnv at any GitHub repo to automatically convert issues and PRs into verifiable tasks for RL.