Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Dwarkesh Patel

👤 Person
12212 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

So another thing you might think is, one, you have this latency requirement with self-driving where you have – I have no idea what the actual models are, but I assume like tens of millions of parameters or something, which is not the necessary constraint for knowledge work with LLMs.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

Or maybe it might be with computer use and stuff.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

But anyways, the other big one is – maybe more importantly, on this CapEx question –

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

Yes, there is additional cost to serving up an additional copy of a model, but the sort of OPEX of a session is quite low and you can amortize the cost of AI into the training run itself, depending on how inference scaling goes and stuff.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

But it's certainly not as much as like building a whole new car to serve another instance of a model.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

So it just, the economics of deploying more widely are much more favorable.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

The latency requirements and the implications for model size.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

Yeah.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

Do you have any opinions on whether this implies that the current AI build-out, which would like 10x the amount of available compute in the world in a year or two, and maybe like 100, more than 100x by the end of the decade, if the use of AI will be lower than some people naively predict, does that mean that we're overbuilding compute?

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

Or is that a separate question?

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

Yeah, that's right.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

Let's talk about education in Eureka and stuff.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

One thing you could do is start another AI lab and try to solve those problems.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

Yeah, curious what you're up to now.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

And then, yeah, why not AI research itself?

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

And so what are you working on there?

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

A category of questions I have for you is just explaining

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

how one teaches technical or scientific content well, because you are one of the world masters at it.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

And then I'm curious both about how you think about it for content you've already put out there on YouTube, but also to the extent it's any different, how you think about it for Eureka.

Dwarkesh Podcast
Andrej Karpathy — AGI is still a decade away

But you are building it, right?