The benchmark utilizes 2D Material Point Method simulations.
Kosta Derpanis (sabbatical in Zurich)#908
How well can a model watch a short video of some physical dynamics and actually predict what happens next?
Introducing MPMWorlds: a new dataset and benchmark to evaluate how well models can reconstruct and extrapolate physical dynamics from video.
https://zzigak.github.io/mpmworlds/
🧵👇 (1/n)
Really creative work comparing VLMs and diffusion models on predicting the future of physical simulations!
How well can a model watch a short video of some physical dynamics and actually predict what happens next?
Introducing MPMWorlds: a new dataset and benchmark to evaluate how well models can reconstruct and extrapolate physical dynamics from video.
https://zzigak.github.io/mpmworlds/
🧵👇 (1/n)
The benchmark utilizes 2D Material Point Method simulations.
Kosta Derpanis (sabbatical in Zurich)#908How well can a model watch a short video of some physical dynamics and actually predict what happens next?
Introducing MPMWorlds: a new dataset and benchmark to evaluate how well models can reconstruct and extrapolate physical dynamics from video.
https://zzigak.github.io/mpmworlds/
🧵👇 (1/n)