--- title: "Google Genie 4: DeepMind's Playable AI Worlds Now Have Sound" url: https://syntaxradar.com/radar/google-genie-4-world-model-explained author: "Abdul Rehman, Lead Systems Architect and Technical Director" publishedAt: 2026-10-28T06:12:34.222Z dateModified: 2026-10-28T06:12:34.222Z category: "#FUTURE-COMPUTE" topic: "google genie 4" primarySource: https://deepmind.google/blog/genie-4-a-new-generation-of-world-simulation/ summary: "Google Genie 4 explained: what a world model is, how it differs from an LLM, what changed since Genie 3, and when Project Genie users may get access." --- # Google Genie 4: DeepMind's Playable AI Worlds Now Have Sound **Short answer:** On October 27, 2026, Google DeepMind announced Genie 4, a real-time world model it says is the first to generate audio natively. It is a research preview for trusted testers, coming first to Google AI Ultra subscribers in Project Genie, with no firm date. **Takeaway:** Genie 4 turns a text prompt into a world you can walk through and hear, but it is a trusted-tester preview with no published specs, and its real prize is training robots, not entertaining people. **Key figures (as reported by the source):** - Genie 1 speed (March 2024): 1 frame per second - Genie 3 real-time output (Aug 2025): 720p at 24 fps - Project Genie exploration cap: 60 seconds Type "a rainy harbour town at dusk" and moments later you are standing in it. You walk with the arrow keys, the camera follows, and now you can hear the rain on the cobblestones and gulls somewhere off to the left. Nothing here was filmed and nothing was built by a game studio. A model is making up every frame and every sound as you move. That is the pitch for **Google Genie 4**, which Google DeepMind [announced on October 27, 2026](https://deepmind.google/blog/genie-4-a-new-generation-of-world-simulation/). DeepMind calls it the first real-time world model that generates audio natively: ambient sound, music and even spoken dialogue, made alongside the picture instead of pasted on afterwards. You probably cannot try it yet, and some of the most interesting parts have nothing to do with entertainment. By the end of this piece you will know what a world model actually is, how it differs from ChatGPT-style chatbots and video generators, what changed from Genie 3, and when ordinary people might get access. ### What Google Genie 4 is, in plain English Google Genie 4 is a research preview from Google DeepMind, credited to Raia Hadsell, Diego Rivas and Hang Qi. It is open only to trusted testers for now, not the public. The basic idea is the same as earlier versions. You describe a place, and the model generates an explorable scene you can steer with standard keyboard controls. While you are inside it, you can type natural-language prompts to change things on the fly: switch the weather, move the camera, or drop in new people and objects. What Genie 4 adds, according to [DeepMind's announcement](https://deepmind.google/blog/genie-4-a-new-generation-of-world-simulation/), falls into three buckets: - **Native sound.** Ambient noise, music and interactive dialogue generated in real time with the visuals. - **A Gemini guide.** Gemini 3.8 Flash watches the frames as they are generated, breaks your goal into steps, checks whether each step worked, and adjusts its plan. A separate model, Gemini Omni, keeps the simulation anchored to how things look and behave in the real world. - **Robot rehearsal.** A demo pairs Genie 4 with Google's robotics models: the task is broken into steps and Genie 4 shows them in a simulated scene. Every frame of video and every second of audio carries SynthID, Google's invisible watermark for AI-generated media. ### What is a world model in AI? A world model is an AI system that learns how an environment behaves, so it can predict what happens next when something acts inside it. Think of how you catch a ball. You do not solve physics equations. Your brain has a rough internal model of the world: thrown things arc, then fall. You run that model forward in your head and put your hand where the ball will be. A world model AI tries to learn the same kind of intuition from huge amounts of video. The key word is *interactive*. A world model does not just produce a clip. It takes an action from you (step forward, turn left, open the door) and produces the next moment of the world in response. Then it does it again, many times per second. That loop is why people describe Genie as a "playable" world rather than a video. It is also why AI labs care about world models far beyond games. If a model can reliably imagine what happens when a robot arm reaches for a cup, the robot can practise in that imagined world thousands of times without breaking a single real cup. ### From 1 frame per second to real time: Genie 1 to Genie 3 The jump to Genie 4 makes more sense once you see how fast each Google Genie AI release moved. These figures come from the [Wikipedia summary of the Genie models](https://en.wikipedia.org/wiki/Genie_(world_model)):
VersionReleasedWhat it could do
Genie 1March 20242D only, trained on video game footage, 1 frame per second
Genie 2December 20242D and 3D at 360p, worlds lasting 10 to 20 seconds
Genie 3August 2025Real time at 720p and 24 fps, with one minute of memory
Genie 4October 2026Adds native audio, a Gemini guiding agent and robot planning demos; no resolution or frame rate published
Genie 1 was closer to a flipbook than a game. Genie 2 added depth, but each world lasted only 10 to 20 seconds. **Google Genie 3** was the moment it started to feel real: smooth enough to walk around in, and able to remember what was behind you for about a minute. That memory point matters more than resolution. If you look away from a red car and look back, a weak model may show you a blue one, or no car at all. Holding a world steady over time is the hard part. Genie 3 also had critics. Fast Company's Thomas Smith called 24 fps too choppy for real-world use. And the Genie 3 world model has already been put to work outside Google DeepMind's lab: the Waymo World Model, from February 2026, is built on Genie 3 and, per the same summary, outputs lidar (the laser-based depth data self-driving cars rely on) four times faster than Genie 3. ![Staircase timeline of Google Genie versions: Genie 1 in March 2024 at 1 FPS, Genie 2 in December 2024 at 360P, Genie 3 in August 2025 at 720P and 24 FPS, and Genie 4 in October 2026 with native audio](/uploads/blog/google-genie-4-world-model-explained/img1-v2.webp) ### What Genie 4 adds: sound, a co-pilot and robot rehearsals #### Sound that belongs to the scene DeepMind says Genie 4 generates ambient sound, music and interactive dialogue natively, alongside the picture. Anyone who has played a game with the sound off knows how much flatter it feels. Sound is a big part of why a place feels like a place. #### A Gemini agent steering the generation The more technical change is the guiding agent. Instead of the world model simply reacting to your keystrokes, Gemini 3.8 Flash observes the generated frames, splits a goal into smaller steps, checks each one succeeded, and changes course if not. In practice, that should make it easier to ask for something with several parts ("walk to the market, then have a vendor greet me") and get a coherent result. #### Rehearsing robot tasks The robotics demo is the most telling part of the announcement. DeepMind shows Gemini 4 Argon working with Gemini Robotics to break a task into steps, while Genie 4 renders each step as real-time text captions in the simulated scene. The example is Apptronik's Apollo humanoid playing checkers. That is the long-term business case. Robots are slow and expensive to train in the physical world, a theme we covered in our look at [humanoid robots moving into homes](/radar/humanoid-robots-daily-life-figure-02-tesla-optimus-homes). A world model that can imagine the next few seconds of a task gives the robot a place to think before it moves. #### What still breaks DeepMind is upfront about the limits. Visual details and object permanence can drift over long sessions, after several prompt edits, or while you move around. Readable text, spatial accuracy, audio accuracy and long-term consistency are all listed as open research areas. The announcement gives no resolution, frame rate or session length, so anyone claiming Genie 4 runs at a specific spec is guessing. ![Three cards showing what Genie 4 adds: native sound, a Gemini guide that plans steps and checks each one, and robot rehearsal shown in a simulated scene](/uploads/blog/google-genie-4-world-model-explained/img2-v2.webp) ### What is a world model vs an LLM? This is the comparison most people trip over, so here it is directly. A **large language model** (LLM), like the one behind ChatGPT or Gemini, learns patterns in text. It predicts the next word. It can describe a kitchen beautifully, but it has no picture of the kitchen and no sense of what happens if you push a glass off the counter, beyond what people have written about it. A **world model** learns patterns in how scenes change over time. It predicts the next frame given an action. It does not need words at all to know that a pushed glass falls and that walls stop you. So the world model AI vs LLM split is roughly *words* versus *worlds*. And Genie 4 shows they work better together: Gemini (the language side) plans and checks the steps, while Genie (the world side) renders what those steps look and sound like. What about AI video generators? They are cousins, not twins. A video generator produces a fixed clip from a prompt, and you watch it. As we explained in our piece on [AI video generation and Hollywood](/radar/ai-video-generation-hollywood-revolution-sora-kling-creators), that is great for making a scene. A world model lets you act inside the scene and keeps generating in response, which is a harder problem, because it has to stay consistent with choices it could not see coming. ### Can you use Genie 4 today? Not unless you are one of DeepMind's trusted testers. The plan, per the announcement, is a staged rollout: 1. First to Google AI Ultra subscribers inside **Project Genie**. 2. Then to early-access partners through the Gemini API and Google AI Studio. There is no firm date for either step. Project Genie is the consumer app that already exists for the previous generation. It launched on January 29, 2026 for AI Ultra subscribers through Google Labs, with each exploration capped at 60 seconds, and gained Street View integration on May 19, 2026. That Street View link hints at where this could go: stepping into a generated version of a real street rather than an invented one. If you are not on Google's top consumer plan, the realistic route to Google Genie 4 is the API stage, and that will matter more for developers building games, training tools or robot software than for casual users. ### What to watch next Three things will tell you whether Google Genie 4 is a demo or a platform. **Published specs.** DeepMind has not said how sharp, how fast or how long Genie 4 worlds run. Genie 3's 720p and 24 fps were criticised as choppy. If Genie 4 ships without beating that, the audio and agent features carry the whole story. **Consistency over minutes, not seconds.** DeepMind itself says details drift over long sessions. The first hands-on reports from Project Genie users will show whether a world holds together long enough to be useful. **Robotics partners.** The Apptronik checkers demo is a single example. Watch for more robot makers, or a Waymo-style product built on Genie 4, as the signal that world models are becoming training infrastructure and not just a party trick you can hear. ## Frequently asked questions ### Can I use Google Genie 4 right now? Not yet. Genie 4 is a research preview limited to trusted testers. Google DeepMind says it will come first to Google AI Ultra subscribers inside Project Genie, then to early-access partners through the Gemini API and Google AI Studio. The company has not given a firm date for either stage, so treat any launch date you see online with caution. ### What is new in Genie 4 compared with Genie 3? DeepMind describes Genie 4 as the first real-time world model to generate audio natively, including ambient sound, music and dialogue. It also uses Gemini 3.8 Flash as a guiding agent that plans and checks steps, and a robotics demo shows task steps inside a simulated scene. Genie 3 ran at 720p and 24 fps with one minute of memory; Genie 4's specs are unpublished. ### What is a world model in AI? A world model is an AI system that learns how an environment behaves so it can predict what happens next when something acts inside it. You give it an action, such as walking forward, and it generates the next moment of the scene. That interactive loop makes it useful for games, simulation and training robots safely before they act in the physical world. ### How is a world model different from an LLM? A large language model predicts the next word in text, so it can describe a scene but has no picture of it. A world model predicts the next frame of a scene in response to an action, learning how things move and collide. In Genie 4 the two work together: Gemini plans and checks the steps, and Genie renders what they look and sound like. ## Source Based on Google DeepMind's Genie 4 announcement. https://deepmind.google/blog/genie-4-a-new-generation-of-world-simulation/ --- Published on SyntaxRadar (https://syntaxradar.com). Canonical URL: https://syntaxradar.com/radar/google-genie-4-world-model-explained. Last modified 2026-10-28T06:12:34.222Z.