Dwarkesh Patel

Yeah.

I think you also made a point that was subtle, so just to spell it out.

I think what's happened so far with online courses is that why haven't they already enabled us to... enabled every single human to know everything?

And I think they're just so motivation-laden because there's not obvious on-ramps, and it's so easy to get stuck.

And if you had...

Instead, this thing, basically like a really good human tutor.

It would just be such an unlock from a motivation perspective.

Yeah, I think so.

Can I ask some questions about teaching well?

If you had to give advice to another educator in another field that you're curious about to make the kinds of YouTube tutorials you've made, maybe it might be especially interesting to talk about domains where you can't test somebody's technical understanding by having them code something up or something.

What advice would you give them?

It also just makes a learning experience so much more motivated.

Your tutorial on the Transformer begins with...

It's literally like a lookup table from here's the word right now, or here's the previous word, here's the next word, and it's literally just a lookup table.

Yeah, it's the essence of it, yeah.

I mean, it's such a brilliant way.

Like, okay, start with a lookup table and then go to a transformer, and then each piece is motivated.

Why would you add that?

Why would you add the next thing?

You couldn't memorize this sort of attention formula, but just like having an understanding of why every single piece is relevant, what problem it solves.