Andrej Karpathy

So I think that's a pretty broad topic.

I do feel like there's basically, I almost feel like there are 10, 20 tips and tricks that I kind of semi-consciously probably do.

But I guess like on a high level, I always try to, I think a lot of this comes from my physics background.

I really, really did enjoy my physics background.

I have a whole rant when I think how everyone should learn physics in early school education, because I think early school education is not about

crumbling knowledge or memory for tasks later in the industry.

It's about booting up a brain.

And I think physics uniquely boots up the brain the best because some of the things that they get you to do in your brain during physics is extremely valuable later.

The idea of building models and abstractions and understanding that there's a first order of approximation that describes most of the system, but then there's a second order, third order, first order terms that may or may not be present.

And the idea that you're observing like a very noisy system, but actually there's like these fundamental frequencies that you can abstract away.

Like when a physicist walks into the class and they say, assume there's a spherical cow and dot, dot, dot.

And everyone laughs at that, but actually it's brilliant.

It's brilliant thinking.

That's very generalizable across the industry because, yeah, cows can be approximated as a sphere, I guess, in a bunch of ways.

There's a really good book, for example, Scale.

It's basically from a physicist talking about biology.

And maybe this is also a book I would recommend reading.

But you can actually get a lot of really interesting approximations and chart scaling laws of animals.

And you can look at their heartbeats and things like that, and they actually line up with the size of the animal and things like that.

You can talk about an animal as a volume, and you can actually derive a lot of...