Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Andrej Karpathy

๐Ÿ‘ค Speaker
3419 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

Like, I don't know, like ranking is kind of AI, right?

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

At some point, Google was like, even early on, they were thinking of themselves as an AI company doing Google search engine, which I think is totally fair.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

And so I kind of see it as a lot more of a continuum than I think other people do, and I don't, it's hard for me to draw the line.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

And I kind of feel like, okay, we're now getting a much better autocomplete.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

And now we're also getting some agents which are kind of like these loopy things, but they kind of go off rails sometimes.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

And what's going on is that the human is progressively doing a bit less and less of the low-level stuff.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

For example, we're not writing the assembly code because we have compilers, right?

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

Like compilers will take my highlight language in C and write the assembly code.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

Yeah.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

So we're abstracting ourselves very, very slowly.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

And there's this what I call autonomy slider of like more and more stuff is automated of the stuff that can be automated at any point in time.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

And we're doing a bit less and less and raising ourselves in the layer of abstraction over the automation.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

Yeah, maybe the way I would put it is humans don't use reinforcement learning is maybe what I, as I've said it all.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

I think they do something different, which is, yeah, you experience.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

So reinforcement learning is a lot worse than I think the average person thinks.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

Reinforcement learning is terrible.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

It just so happens that everything that we had before is much worse.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

Because previously, we were just imitating people, so it has all these issues.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

So in reinforcement learning, say you're working with, you're solving a math problem.

Dwarkesh Podcast
Andrej Karpathy โ€” AGI is still a decade away

This is very simple.