Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Andrej Karpathy

πŸ‘€ Speaker
3433 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And LLMs, the way they're trained on the internet, love text.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And so they're perfect text processors, and there's all this data out there, and it's just a perfect fit.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And also we have a lot of infrastructure pre-built for handling code and text.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

So, for example, we have Visual Studio Code or, you know, your favorite IDE showing you code.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And an agent can plug into that.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

So for example, if an agent has a diff where it made some change, we suddenly have all this code already that shows all the differences to a code base using a diff.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

So it's almost like we've pre-built a lot of the infrastructure for code.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Now contrast that with some of the things that don't enjoy that at all.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

So as an example, like there's people trying to build automation, not for coding, but for example, for slides.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Like I saw a company doing slides.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

That's much, much harder.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And the reason it's much, much harder is because slides are not text.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Slides are little graphics, and they're arranged spatially, and there's visual components to it.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And slides don't have this pre-built infrastructure.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Like, for example, if an agent is to make a different change to your slides, how does a thing show you the diff?

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

How do you see the diff?

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

There's nothing that shows diffs for slides.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Someone has to build it.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

So it's just some of these things are not amenable to AIs as they are, which is text processors.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And code, surprisingly, is.