Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Andrej Karpathy

πŸ‘€ Speaker
3433 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

It's about booting up a brain.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And I think physics uniquely boots up the brain the best because some of the things that they get you to do in your brain during physics is extremely valuable later.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

The idea of building models and abstractions and understanding that there's a first order of approximation that describes most of the system, but then there's a second order, third order, first order terms that may or may not be present.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And the idea that you're observing like a very noisy system, but actually there's like these fundamental frequencies that you can abstract away.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

Like when a physicist walks into the class and they say, assume there's a spherical cow and dot, dot, dot.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And everyone laughs at that, but actually it's brilliant.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

It's brilliant thinking.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

That's very generalizable across the industry because, yeah, cows can be approximated as a sphere, I guess, in a bunch of ways.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

There's a really good book, for example, Scale.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

It's basically from a physicist talking about biology.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And maybe this is also a book I would recommend reading.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

But you can actually get a lot of really interesting approximations and chart scaling laws of animals.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And you can look at their heartbeats and things like that, and they actually line up with the size of the animal and things like that.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

You can talk about an animal as a volume, and you can actually derive a lot of...

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

You can talk about the heat dissipation of that because your heat dissipation grows as the surface area, which is growing a square, but your heat creation or generation is growing as a cube.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And so I just feel like physicists have all the right cognitive tools to approach problem solving in the world.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

So I think because of that training, I always try to find the first order terms or the second order terms of everything.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

When I'm observing a system or a thing, I have a tangle of a web of ideas or knowledge in my world, in my mind.

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

And I'm trying to find what is the thing that actually matters?

Dwarkesh Podcast
Andrej Karpathy β€” AGI is still a decade away

What is the first order component?