Andrej Karpathy
๐ค SpeakerAppearances Over Time
Podcast Appearances
And I think it's a realm of research.
But I think I haven't seen anything that convincingly like claims both of those, like multi-agent improvements.
I still think we're mostly in the realm of a single individual agent.
But I think, I also think that will change.
And in the realm of culture also, I would bucket also organizations.
And we haven't seen anything like that convincingly either.
So that's why we're still early.
Somehow remarkably, again, some of these analogies work and they shouldn't, but somehow remarkably they do.
A lot of the smaller models or the dumber, like the smaller models somehow remarkably resemble like a kindergarten student or then like a elementary school student or high school student, et cetera.
And somehow we still haven't like graduated enough where this stuff can take over.
Like it's still mostly like my cloth coat or codex, they still kind of feel like this elementary grade student.
I know that they can take PhD quizzes, but they still cognitively feel like a kindergarten or an elementary school student.
Interesting.
So I don't think they can create culture because they're still kids, you know, like they're savant kids.
They have perfect memory of all this stuff, et cetera.
And they can convincingly create all kinds of slop that looks really good.
But I still think they don't really know what they're doing and they don't really have the cognition across all these little checkboxes that we still have to collect.
Yeah.
So I would say one thing I will almost instantly also push back on is this is not even near done.
So in a bunch of ways that I'm going to get to.