Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
But then, yeah, it turned out to be...
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
be really, really fun, looked like a bunch of smart people doing good stuff.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
And they had this really nice crayon chart on the wall of the daily number of search queries that somebody had just been maintaining.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
And yeah, it looked very exponential.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
I was like, these guys are going to be very successful.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
And it looks like they have a lot of good problems to work on.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
So I was like, OK, maybe I'll go work there for a little while and then have enough money to just go work on AI for as long as I want after that.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
FRANCESC CAMPOY FLORES- Yeah, it totally worked out exactly according to my- MARK MANDELMANN- Sorry, you were thinking about AI in 1999?
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Yeah, this was like 2000.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
I remember in grad school, a friend of mine at the time had told me that his New Year's resolution for 2000 was to live to see the year 3000 and that he was going to achieve this by inventing AI.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
I was like, that sounds like a good idea.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Then
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
You know, I didn't get the idea at the time that, oh, like, you could go do it at a big company.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
But, you know, I figured, hey, you know, a bunch of people seem to be making a ton of money at startups.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Maybe I'll just make some money and then I'll have, you know, enough to live on and just work on AI research for a long time.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
But, yeah, it actually turned out that Google was a terrific place to work in AI.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Yeah, yeah.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
I mean, it feels like the algorithms are following the hardware.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
Basically, what's happened is that at this point, arithmetic is very, very cheap.
Dwarkesh Podcast
Jeff Dean & Noam Shazeer โ 25 years at Google: from PageRank to AGI
And moving data around is comparatively much more expensive.