Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Demis Hassabis

πŸ‘€ Speaker
See mentions of this person in podcasts
3240 total appearances

Appearances Over Time

Podcast Appearances

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And then of course that gets monitored.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And then at the end of the pre-training, then there's all the post-training.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

There's many different ways of doing that, different ways of patching it.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

So there's a whole experiment and phase there, which you can also get a lot of gains out.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And that's where you see the version numbers usually referring to the base model, the pre-trained model.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And then the interim versions of 2.5, you know, and the different sizes and the different little additions, they're often patches or post-training ideas that can be done afterwards.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

off the same basic architecture.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And then of course, on top of that, we also have different sizes, pro and flash and flashlight that are often distilled from the biggest ones, you know, the flash model from the pro model.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And that means we have a range of different choices.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

If you are the developer of, do you want to prioritize performance or speed, right?

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And cost.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And we like to think of this Pareto frontier of, on the one hand, the y-axis is like performance, and then the x-axis is cost or latency and speed, basically.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And we have models that completely define the frontier.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

So whatever your trade-off is that you want as an individual user or as a developer, you should find one of our models satisfies that constraint.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

Exactly.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And then you're constantly this process of converging upstream.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

We call it, you know, ideas from the, from the product surfaces or, or, or from the post-training and, and even further downstream than that, you, you kind of upstream that into the, the core model training for the next run.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

So then the main model, the main Gemini track becomes more and more general.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

And eventually, you know, AGI.

Lex Fridman Podcast
#475 – Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games

One hero run at a time.