Andrej Karpathy

You're chaining.

It's a recursive application of chain rule to derive the gradient, which allows you to optimize any arbitrary differential function.

So I love finding these, like, you know, the smaller terms and serving them on a platter and discovering them.

And I feel like education is, like, the most intellectually interesting thing because you have a tangle of understanding, and you're trying to lay it out in a way that creates a ramp

where everything only depends on the thing before it.

And I find that this, like, you know, untangling of knowledge is just so intellectually interesting as a cognitive task.

And so I love doing it personally, but I just have fascination with trying to lay things out in a certain way.

Maybe that helps me.

Yeah, yeah.

Yeah, you're presenting the pain before you present a solution.

And how clever is that?

And you want to take the student through that progression.

So there's a lot of other small things like that that I think make it nice and engaging and interesting.

And always prompting the student.

There's a lot of small things like that that I think are important and a lot of good educators will do.

Like, how would you solve this?

Like, I'm not going to present a solution before you're going to guess.

That would be wasteful.

That's a little bit of a...

I don't want to swear, but, like, it's a dick move towards you to present you with the solution before I give you a shot to try to come up with it yourself.