Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Ilya Sutskever

👤 Person
766 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

But I think there are some big differences as well.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

The amount of pre-training data is very, very staggering.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

Yes.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And somehow a human being after even 15 years with a tiny fraction of that pre-training data, they know much less.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

But whatever they do know, they know much more deeply somehow.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And the mistakes, like already at that age, you would not make mistakes that REIs make.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

There is another thing you might say, could it be something like evolution?

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And the answer is maybe.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

But in this case, I think evolution might actually have an edge.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

Like there is this, I remember...

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

reading about this case where some you know that one thing that neuroscientists do or rather one way in which neuroscientists can learn about the brain is by studying people with brain damage to different parts of the brain and and so and some people have the most strange symptoms you could imagine it's actually really really interesting and there was one case that comes to mind that's relevant

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

I read about this person who had some kind of brain damage that took out I think a stroke or an accident that took out his emotional processing.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

So he stopped feeling any emotion.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And as a result of that, you know, he still remained very articulate and he could solve little puzzles and on tests he seemed to be just fine.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

But he felt no emotion.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

He didn't feel sad.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

He didn't feel angry.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

He didn't feel animated.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

And he became somehow extremely bad at making any decisions at all.

Dwarkesh Podcast
Ilya Sutskever – We're moving from the age of scaling to the age of research

It would take him hours to decide on which socks to wear and he would make very bad financial decisions.