Turn Real Videos Into Digital Physics Simulations

A new project called Code-as-World translates real world video into code for MuJoCo, a physics simulation platform. This process allows the computer to understand how objects behave in real space by recreating them in a digital environment.

Once the video is converted into code, the simulation becomes fully interactive. You can modify the physics or change how objects move within the scene to test different outcomes.

This tool helps machines learn to reason about the physical world. By training on these verified virtual scenes, AI models can better predict how things will react in real life.