Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Dwarkesh Patel

πŸ‘€ Speaker
15656 total appearances
Voice ID

Voice Profile Active

This person's voice can be automatically recognized across podcast episodes using AI voice matching.

Voice samples: 1
Confidence: Medium

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And then two, the end is not here yet.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

I'm curious to bounce two other ways in which the analogy might be different.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And the reason I'm especially curious about this is because I think the question of how fast AI is deployed, how valuable it is when it's early on is like potentially the most important question in the world right now, right?

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Like if you're trying to model what the year 2030 looks like, this is the question you want to have some understanding of.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

So another thing you might think is, one, you have this latency requirement with self-driving where you have – I have no idea what the actual models are, but I assume like tens of millions of parameters or something, which is not the necessary constraint for knowledge work with LLMs.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Or maybe it might be with computer use and stuff.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

But anyways, the other big one is – maybe more importantly, on this CapEx question –

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Yes, there is additional cost to serving up an additional copy of a model, but the sort of OPEX of a session is quite low and you can amortize the cost of AI into the training run itself, depending on how inference scaling goes and stuff.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

But it's certainly not as much as like building a whole new car to serve another instance of a model.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

So it just, the economics of deploying more widely are much more favorable.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

The latency requirements and the implications for model size.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Yeah.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Do you have any opinions on whether this implies that the current AI build-out, which would like 10x the amount of available compute in the world in a year or two, and maybe like 100, more than 100x by the end of the decade, if the use of AI will be lower than some people naively predict, does that mean that we're overbuilding compute?

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Or is that a separate question?

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Yeah, that's right.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Let's talk about education in Eureka and stuff.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

One thing you could do is start another AI lab and try to solve those problems.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Yeah, curious what you're up to now.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And then, yeah, why not AI research itself?

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And so what are you working on there?