Andrej Karpathy
π€ SpeakerAppearances Over Time
Podcast Appearances
You're just specifying the architecture.
And the architecture has tons of fill-in-the-blanks, which is all the knobs.
And you let the optimization write most of it.
And so this transition is happening across the industry everywhere.
And suddenly we end up with a ton of code that is written in neural net weights.
And I was just pointing out that the analogy is actually pretty strong.
And we have a lot of developer environments for software 1.0.
Like we have IDEs, how you work with code, how you debug code, how do you run code, how do you maintain code.
We have GitHub.
So I was trying to make those analogies in the new realm.
Like what is the GitHub of software 2.0?
Turns out it's something that looks like Hugging Face right now.
And so I think some people took it seriously and built cool companies.
And many people originally attacked the post.
It actually was not well received when I wrote it.
And I think maybe it has something to do with the title, but the post was not well received.
And I think more people sort of have been coming around to it over time.
Yeah.
The way by which you program the computer and influence its algorithm is not by writing the commands yourself.
You're changing mostly the data set.