Google’s Genie world model can now simulate real streets with Street View

Google is revolutionizing the way we interact with Street View on Google Maps, introducing a new dimension of immersion and interactivity through its Project Genie. This innovative feature, unveiled at the Google I/O developer conference, enables users to not only explore familiar streets but to customize their experiences by simulating various environmental conditions, such as weather changes or even hypothetical scenarios like a post-apocalyptic world. Jack Parker-Holder, a research scientist at DeepMind, highlighted the dual applicability of this technology for both robotics and human users. For instance, a robot deployed in a sunless area like London can benefit from Genie’s ability to simulate rare sunny days, ensuring the robot is prepared for real-world conditions. This capability allows users to visualize a location in different seasons or weather patterns, enhancing the overall experience. Over the past two decades, Google has amassed an impressive collection of Street View imagery, capturing over 280 billion images from 110 countries. This vast database, combined with Genie’s simulation capabilities, offers unprecedented potential for creating realistic and interactive environments. Launched as a research preview last August and made available to Google AI Ultra subscribers earlier this year, Genie 3 is already being utilized in applications like Waymo’s simulator, which trains self-driving cars on infrequent scenarios, such as tornadoes. By incorporating Street View data, Waymo can prepare for broader city launches. Currently, Google is rolling out access to the new Street View integration within Genie to Ultra users in the U.S., with plans for global availability in the coming weeks. While the technology is still experimental and has room for improvement—particularly in achieving photorealistic quality and understanding physics—the potential for educational, gaming, and robotics applications is immense. Jonathan Herbert, director of Google Maps, acknowledged the challenges ahead, noting that while Genie can simulate familiar environments, it has yet to perfectly reconstruct a street scene. However, the AI's ability to maintain spatial continuity promises a future where virtual explorations become increasingly lifelike. With ongoing developments, Google aims to harness Maps Data for innovative AI research and applications.