Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Of course, there is learning that will require external data, but probably maybe we can just have this thing talk to itself and make itself smarter.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
It's a good question.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Because I think probably...
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
We did need to see the size of the opportunity often reflected in what other companies are doing.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
And also, it's not a fixed pie.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
This is like the current state of the world is...
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
pretty much as far from fixed pie as you can get.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
I think we're going to see orders of magnitude of improvements in GDP, health, wealth, and anything else you can think of.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
So I think it's definitely been nice that Transformer has got around.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Thank God Google is doing well as well.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
So these days we do publish a little less of what we're doing.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
I'd say, like, probably a big thing is, like, humility.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Like, I'd say I'm, like, the most carnival ever.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
But seriously, you know, there's...
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
To say, hey, what I just did is nothing compared to what I can do or what can be done.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
And to be able to drop an idea as soon as you see something better, like you hear somebody with some better idea and you see how maybe what you're thinking about, what they're thinking about, or something totally different can...
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
it could conceivably work better.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Because I think there is a drive, in some sense, to say, hey, the thing I just invented is awesome.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Particularly if there's a lot of top-down resource assignment.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
But I think we also need to incentivize people to say, hey, this thing I am doing,