Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Ilya Sutskever

👤 Person
766 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

Yeah.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

But if people exhibit great ability, reliability, robustness, ability to learn in a domain that really did not exist until recently, then this is more an indication that people might have just better machine learning, period.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

So this is where, you know, one of the things that you've been asking about is how can, you know, the teenage driver kind of self-correct and learn from their experience without an external teacher?

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And the answer is, well, they have their value function, right?

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

They have a general sense, which is also, by the way, extremely robust in people, like...

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

whatever it is the human value function whatever the human value function is with a few exceptions around addiction it's actually very very robust and so for something like a teenager that's learning to drive they start to drive and they already have a sense of how they're driving

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

immediately how badly they're unconfident and then they see, okay.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And they, and then of course the, the learning speed of any teenager is so fast after 10 hours, you're good to go.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And it's a question I have a lot of opinions about.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

But unfortunately, we live in a world where not all machine learning ideas are discussed freely, and this is one of them.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

So there's probably a way to do it.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

I think it can be done.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

The fact that people are like that, I think it's a proof that it can be done.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

There may be another blocker though, which is there is a possibility that the human neurons actually do more compute than we think.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And if that is true, and if that plays an important role, then things might be more difficult.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

But regardless, I do think it points to the existence of some machine learning principle that I have opinions on.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

But unfortunately, circumstances make it hard to discuss in detail.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

So one consequence of the age of scaling is that there was this

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

scaling sucked out all the air in the room and so because scaling sucked out all the air in the room

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

everyone started to do the same thing.