Andrej Karpathy
π€ SpeakerAppearances Over Time
Podcast Appearances
Yeah, exactly.
I think the way we are programming these computers now, like GPTs, is converging to how you program humans.
I mean, how do I program humans via prompt?
I go to people and I prompt them to do things.
I prompt them from information.
And so natural language prompt is how we program humans, and we're starting to program computers directly in that interface.
It's pretty remarkable, honestly.
Yeah.
So I had a blog post on Software 2.0, I think several years ago now.
And the reason I wrote that post is because I kind of saw something remarkable happening in
software development and how a lot of code was being transitioned to be written not in sort of like C++ and so on, but it's written in the weights of a neural net.
Basically just saying that neural nets are taking over software, the realm of software, and taking more and more tasks.
And at the time, I think not many people understood this deeply enough, that this is a big deal, this is a big transition.
Neural networks were seen as one of multiple classification algorithms you might use for your dataset problem on Kaggle.
Like,
This is not that.
This is a change in how we program computers.
And I saw neural nets as, this is going to take over.
The way we program computers is going to change.
It's not going to be people writing software in C++ or something like that and directly programming the software.