Developer ports Old School RuneScape challenges to fast C RL environments

Developer ports Old School RuneScape challenges to fast C RL environments · Digg

The Conversation on X

2 posts

7:50 AM · Jul 16, 2026

1691TECH

Awesome work! Valo has been porting OSRS content to high-perf C RL envs in PufferLib. Inferno and Colosseum are both end-game challenges that take the top few % of players days or weeks to complete for the first time. Here's a tiny model taking down Sol with no supplies. OSRS holds a special place for me both as my favorite game and as a major source of inspiration for RL developments throughout my PhD and the early days of PufferLib. These envs are going to be a great benchmark for our algo work over the next few major updates! Note: this is for research. We are not botting the live game. Don't ruin old school!

valo@ValtteriValo

15 minutes of training on a single 4090, 0 scaffolding. 87% win rate against Sol Heredit, not great not terrible fight here was an easier RL problem than inferno boss. probably mostly for the same reason why in the real game clearing inferno was harder than colosseum for me; i did inferno first and spent the bulk of the time learning there looks like i forgot to add surge pot cooldown lol anyway obs is 3000 floats and most of it is two sets, items and NPCs. flat mlp over those worked like shit and i was stuck for a week but @jsuarez suggested a shared per entity mlp with maxpool over each set and of course immediately it got sota and every sweep picked it over baseline unanimously ever since it's annoying since he solves problems i've been staring at for 50 hours in a single sentence that took him 8 seconds to type but it is what it is

JS Joseph Suarez 🐡@jsuarez

7:50 AM · Jul 16, 2026

valo@ValtteriValo