Andrej Karpathy
๐ค SpeakerAppearances Over Time
Podcast Appearances
You're right.
I think, yeah, they're not very good at code that has never been written before.
Maybe it's like one way to put it, which is like what we're trying to achieve when we're building these models.
It's tough.
I think they kind of know, but they don't fully know.
And they don't know how to fully integrate it into the repo and your style and your code and your place and some of the custom things that you're doing and how it fits with all the assumptions of the repository and all this kind of stuff.
So I think they do have some knowledge, but...
they haven't gotten to the place where they can actually integrate it, make sense of it, and so on.
I do think that a lot of the stuff, by the way, continues to improve.
So I think currently probably state-of-the-art model that I go to is the GPT-5 Pro.
And that's a very, very powerful model.
So if I actually have 20 minutes, I will copy-paste my entire repo and I go to GPT-5 Pro, the Oracle, for like some questions.
And often it's not too bad and surprisingly good compared to what existed a year ago.
Yeah.
But I do think that overall the models are โ they're not there.
And I kind of feel like the industry, it's over โ it's making too big of a jump.
And it's trying to pretend like this is amazing.
And it's not.
It's slop.
And I think they're not coming to terms with it.