Andrej Karpathy
๐ค SpeakerAppearances Over Time
Podcast Appearances
what I would say is like kind of a softer component of like diffusing knowledge or like, but I actually have something very hard and technical in mind.
And so in my mind, education is kind of like the very difficult technical like process of building ramps to knowledge.
So in my mind, NanoChat is a ramp to knowledge because it's a very simple, it's like the super simplified full stack thing.
If you give this artifact to someone and they like look through it, they're learning a ton of stuff.
Yeah.
And so it's giving you a lot of what I call Eurekas per second, which is like understanding per second.
That's what I want.
Lots of Eurekas per second.
And so to me, this is a technical problem of how do we build these ramps to knowledge.
And so I always think of Eureka as almost like a, it's not like maybe that different, maybe through some of the frontier labs or some of the work that's going to be going on, because I want to figure out how to build these frontier, these ramps very efficiently so that people are never stuck.
And everything is always not too hard or not too trivial.
And you have just the right material to actually progress.
I mean, I think you always have to be calibrated to what the capability, what capability exists in the industry.
And I think a lot of people are going to pursue like, oh, just ask Chachi PT, et cetera.
But I think like right now, for example, if you go to Chachi PT and you say, oh, teach me AI, there's no way.
I mean, it's going to give you some slop, right?
Like when I, AI is never going to write nano chat right now, but nano chat is a really useful, I think, intermediate point.
So I still, I'm collaborating with AI to create all this material.
So AI is still fundamentally very helpful.
Earlier on, I built a CS231 at Stanford, which was one of the earlier, actually, sorry, I think it was the first deep learning class at Stanford, which became very popular.