Google DeepMind Lead Researchers on Genie 3 & the Future of World-Building

Genie 3 can generate fully interactive, persistent worlds from just text, in real time.In this episode, Google DeepMind’s Jack Parker-Holder (Research Scientist) and Shlomi Fruchter (Research Director) join Anjney Midha, Marco Mascorro, and Justine Moore of a16z, with host Erik Torenberg, to discuss how they built it, the breakthrough “special memory” feature, and the future of AI-powered gaming, robotics, and world models.They share:How Genie 3 generates interactive environments in real timeWhy its “special memory” feature is such a breakthroughThe evolution of generative models and emergent behaviorsInstruction following, text adherence, and model comparisonsPotential applications in gaming, robotics, simulation, and moreWhat’s next: Genie 4, Genie 5, and the future of world models This conversation offers a first-hand look at one of the most advanced world models ever created. Timecodes: 0:00 Introduction & The Magic of Genie 30:41 Real-Time World Generation Breakthroughs1:22 The Team’s Journey: From Genie 1 to Genie 35:03 Interactive Applications & Use Cases8:03 Special Memory and World Consistency12:29 Emergent Behaviors and Model Surprises18:37 Instruction Following and Text Adherence19:53 Comparing Genie 3 and Other Models21:25 The Future of World Models & Modality Convergence27:35 Downstream Applications and Open Questions31:42 Robotics, Simulation, and Real-World Impact39:33 Closing Thoughts & Philosophical Reflections Resources:Find Shlomi on X: https://x.com/shlomifruchterFind Jack on X: https://x.com/jparkerholderFind Anjney on X: https://x.com/anjneymidhaFind Justine on X: https://x.com/venturetwinsFind Marco on X: https://x.com/Mascobot Stay Updated: Let us know what you think: https://ratethispodcast.com/a16zFind a16z on Twitter: https://twitter.com/a16zFind a16z on LinkedIn: https://www.linkedin.com/company/a16zSubscribe on your favorite podcast app: https://a16z.simplecast.com/Follow our host: https://x.com/eriktorenbergPlease note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Stay Updated:Find a16z on XFind a16z on LinkedInListen to the a16z Podcast on SpotifyListen to the a16z Podcast on Apple PodcastsFollow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

There are no comments yet.

Please log in to write the first comment.