Gen Intuition's Pim De Witte says video games provide the action-to-outcome loops needed to train physical AI

it does seem like utilizing text & video to scale up to physics understanding of the real world is likely not enough. google is doing a bit of this with street view + maps data + simulation for this but the video game unlock seems absolutely legit esp if you have the full end to end loop of consequence mapping for ai to learn from that’s insanely rich (e.g. controller input → camera movement → game state transition → physics/collision response → npc reaction → player choice → reward/failure/social outcome).

i personally grew up playing a ton of videogames as a kid including one of the first games to ever have open ended world simulation (it was called shenmue, absolutely pioneering, look it up).

these guys seem to have a good understanding that these feedback loops in actual game play is the best data set for ai to behave in human contexts because that’s precisely how we learn & explore when we are young (like watch a kid play around).

it does seem like utilizing text & video to scale up to physics understanding of the real world is likely not enough. google is doing a bit of this with street view + maps data + simulation for this but the video game unlock seems absolutely legit esp if you have the full end to end loop of consequence mapping for ai to learn from that’s insanely rich (e.g. controller input → camera movement → game state transition → physics/collision response → npc reaction → player choice → reward/failure/social outcome).

i personally grew up playing a ton of videogames as a kid including one of the first games to ever have open ended world simulation (it was called shenmue, absolutely pioneering, look it up).

these guys seem to have a good understanding that these feedback loops in actual game play is the best data set for ai to behave in human contexts because that’s precisely how we learn & explore when we are young (like watch a kid play around).

if this is all true then gta 5 & take two could be valued as a mercor++++ for real data generation in an ai world.