Ilya Sutskever
👤 PersonAppearances Over Time
Podcast Appearances
Yeah.
But if people exhibit great ability, reliability, robustness, ability to learn in a domain that really did not exist until recently, then this is more an indication that people might have just better machine learning, period.
So this is where, you know, one of the things that you've been asking about is how can, you know, the teenage driver kind of self-correct and learn from their experience without an external teacher?
And the answer is, well, they have their value function, right?
They have a general sense, which is also, by the way, extremely robust in people, like...
whatever it is the human value function whatever the human value function is with a few exceptions around addiction it's actually very very robust and so for something like a teenager that's learning to drive they start to drive and they already have a sense of how they're driving
immediately how badly they're unconfident and then they see, okay.
And they, and then of course the, the learning speed of any teenager is so fast after 10 hours, you're good to go.
And it's a question I have a lot of opinions about.
But unfortunately, we live in a world where not all machine learning ideas are discussed freely, and this is one of them.
So there's probably a way to do it.
I think it can be done.
The fact that people are like that, I think it's a proof that it can be done.
There may be another blocker though, which is there is a possibility that the human neurons actually do more compute than we think.
And if that is true, and if that plays an important role, then things might be more difficult.
But regardless, I do think it points to the existence of some machine learning principle that I have opinions on.
But unfortunately, circumstances make it hard to discuss in detail.
So one consequence of the age of scaling is that there was this
scaling sucked out all the air in the room and so because scaling sucked out all the air in the room
everyone started to do the same thing.