mira-wm/mira

MIRA is a research project that builds an AI model able to simulate a video game in real time. Specifically, it recreates Rocket League, a soccer game played with rocket powered cars, using a large diffusion model that generates each video frame on the fly based on what all four players in a match are doing with their controls. A full two versus two match can be played entirely inside this simulated model at twenty frames per second on a single graphics card, and there is a live demo online where people can try it. The project is a joint release from three organizations working together on AI research, and it comes with a technical paper describing how the system was built. Under the hood it combines a video encoder, called a representation autoencoder, with a diffusion model that predicts what the next frame should look like given the players' actions. The repository includes code to install the project using a tool called pixi, which sets up the environment and installs dependencies automatically, though it requires an NVIDIA graphics card. It also provides access to the training dataset used for the project, hosted on Hugging Face, which consists of four second clips from real matches, each with synchronized video from every player, their keyboard inputs, and the underlying game state such as ball position, car positions, and score. There is a small tool to explore this dataset interactively. Beyond just using the released model, the code lets researchers train their own version from scratch, including a single player version and a four player version that builds on it. Training the video encoding step requires a separate frozen model, DINOv3, whose weights must be downloaded from Meta directly under Meta's own terms. This is a research codebase aimed at machine learning researchers and engineers who are comfortable with Python and GPU training pipelines, not a ready-to-use consumer application. The code itself is released under the Apache License 2.0, a permissive open source license that allows free use, including commercial use.