Andrej Karpathy

So that's why we're still early.

Somehow remarkably, again, some of these analogies work and they shouldn't, but somehow remarkably they do.

A lot of the smaller models or the dumber, like the smaller models somehow remarkably resemble like a kindergarten student or then like a elementary school student or high school student, et cetera.

And somehow we still haven't like graduated enough where this stuff can take over.

Like it's still mostly like my cloth coat or codex, they still kind of feel like this elementary grade student.

I know that they can take PhD quizzes, but they still cognitively feel like a kindergarten or an elementary school student.

Interesting.

So I don't think they can create culture because they're still kids, you know, like they're savant kids.

They have perfect memory of all this stuff, et cetera.

And they can convincingly create all kinds of slop that looks really good.

But I still think they don't really know what they're doing and they don't really have the cognition across all these little checkboxes that we still have to collect.

Yeah.

So I would say one thing I will almost instantly also push back on is this is not even near done.

So in a bunch of ways that I'm going to get to.

I do think that self-driving is very interesting because it's definitely like where I get a lot of my intuitions because I spent five years on it.

And it has this entire history where actually the first demos of self-driving go all the way to the 1980s.

You can see a demo from CMU in 1986.

There's a truck that's driving itself on roads.

But OK, fast forward.

I think when I was joining Tesla, I had a very early demo of Waymo.