Andrej Karpathy
👤 SpeakerAppearances Over Time
Podcast Appearances
There's just too many options.
And it's too sparse of a reward signal.
And you're starting from scratch at the time.
And so you don't know how to read.
You don't understand pictures, images, buttons.
You don't understand what it means to make a booking.
But now what's happened is it is time to revisit that.
And OpenAI is interested in this.
Companies like Adept are interested in this and so on.
And the idea is coming back because the interface is very powerful.
But now you're not training an agent from scratch.
You are taking the GPT as an initialization.
So GPT is pre-trained on all of text.
And it understands what's a booking.
It understands what's a submit.
It understands quite a bit more.
And so it already has those representations.
They are very powerful.
And that makes all of the training significantly more efficient and makes the problem tractable.
So today, all of this interaction is mostly on the level of HTML, CSS, and so on.