Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
And then, of course, with the advent of transformers invented by our colleagues at Google, you know, research and brain, that was the then, you know, the type of deep learning that allowed us to ingest masses of amounts of information.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
And that, of course, is really turbocharged where we are today.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
So I think that's all part of the same lineage.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
You know, we couldn't have predicted every twist and turn there.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
But I think the general direction we were going in was the right one.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
So we had these things called out.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
And actually, we had some early attention papers, but they weren't as elegant as Transformers in the end.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
Neural Turing machines and things like this.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
And then Transformers was the nicer and more general architecture of that.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
Yeah, look, I would love, you know, I think that this has to be, this is so consequential, this technology.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
I think it's much bigger than any one company or even industry in general.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
I think it has to be a big collaboration with many stakeholders from civil society, academia, government.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
And the good news is, I think with the popularity of the recent chatbot systems and so on, I think that has woken up.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
many of these other parts of society that this is coming and what it will be like to interact with these systems.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
And that's great.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
So it's opened up lots of doors for very good conversations.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
I mean, an example of that was the safety summit in the UK hosted a few months ago, which I thought was a big success to start getting this international dialogue going.
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
And I think the whole of society needs to be involved in deciding what do we want to deploy these models for?
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
How do we want to use them?
Dwarkesh Podcast
Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
What do we not want to use them for?