跳到正文
DEV Community· NeurAITool·· 21 天前AI 評分63

Google DeepMind 的 Genie 4 世界模型支援運行期間即時編輯

Google Genie 4: A World Model You Can Edit While It Runs

AI 導讀

Google DeepMind 於 2026 年 10 月 27 日以研究預覽形式推出 Genie 4,這款世界模型可即時模擬可互動場景,並支援在運行期間以自然語言修改場景。它原生生成音訊,場景連貫性最長可維持兩分鐘,是 Genie 3 約一分鐘上限的兩倍。目前僅限受信測試者使用;DeepMind 列出的缺口包括長時間運行時的視覺漂移、未解的音訊準確度問題,以及尚無法生成清晰可讀的場景內文字。

正文

Google Genie 4: A World Model You Can Edit While It Runs

Google DeepMind's Genie 4, released as a research preview on 27 October 2026, is the most convincing world model shown publicly so far. Not a video clip — an interactive, navigable, photorealistic world, simulated in real time, with sound generated natively and a steering wheel you can grab mid-run.

What's new

Native audio. Genie 4 is DeepMind's "first real-time world model to generate audio natively." Music, ambient noise, and interactive dialogue are generated simultaneously with the visuals, in one unified pass — not layered on afterward. Wind through trees, waves, background chatter, plus dialogue that reacts to the scene.

Real-time steering. Type a natural-language command mid-simulation — change the weather, move the camera, add a person or an object — without restarting. If you've used generative video tools, you know the pain: one wrong detail means regenerating everything. Here, iteration happens inside the running scene.

Longer coherence. Scenes hold together for up to two minutes, double Genie 3's roughly one-minute limit, with more photorealistic worlds and substantially better human motion.

Gemini is the director. A hybrid pipeline: Gemini Omni anchors each world in real-world appearance and behavior, Genie 4 renders the pixels, and Gemini 3.8 Flash acts as a guiding agent — breaking goals into steps, monitoring frames, and steering coherence. Research director Tejas Kulkarni told the briefing to expect more of "these hybrid world models."

The honest caveats

DeepMind listed its own gaps: visual drift over longer sessions, unresolved audio accuracy, no legible in-world text yet. There is no technical report, no benchmark, no public measure of physical accuracy — the two-minute figure comes from a press briefing. No independent hands-on exists; everything we know is Google's account.

Access: trusted testers only for now. Wider rollout goes to Google AI Ultra subscribers via Project Genie, then Gemini API and Google AI Studio early partners. A waitlist is open; dates and pricing unannounced. Everything generated carries SynthID watermarks.

Why builders should watch

The Gemini Robotics experiment is the tell: a Gemini 4 Argon model broke a task into steps that Genie 4 simulated in real time — the language model planning, the world model acting as its eyes. That's the trajectory: robots rehearsing in generated worlds before touching the real one. Games, film pre-production, and robotics all get a concrete new tool here, once access opens.

For context, Runway shipped its GWM Worlds 2 a couple of months earlier — world models are now a race, not a Google solo project.


This is a condensed explainer. The full breakdown — Genie 4 vs Genie 3, access routes, the gaps, and FAQ — is on NeurAITool: Google Genie 4: AI Worlds You Can Edit Live (2026).

來源:DEV Community · dev.to