Judea Pearl

And the problem is that we don't know how to control it.

And whoever says 20% or 5% is just talking.

We cannot put a number there because we don't have a theoretical or technical instrument to predict whether or not we can control it.

We do not know what's going to happen, what's going to develop.

I don't know what I mean by 20%.

Look at me.

I am...

Fairly sure.

All I'm saying is there's no theoretical impediment for creating such a species, dominating species.

That is true.

And at the same time, I'm working toward that indirectly.

Not toward that in order to create it, but to understand the capabilities of intelligence in general.

Because I want to understand ourselves because I'm curious.

No.

I don't think we can imagine an effective alignment or an effective architecture that will assure us of alignment with our survival.

Does that seem like a frame that... It's a nice frame, but I don't see any impediment for the new species to overcome and bypass those guidelines and play.

I don't know why I have different intuitions than LeCron.

Look, once you want a system that will explore its environment, that's required for any intelligent system.

We want it to play like a baby in a crib and find out why this toy makes noise and this doesn't, okay?

So it has to play around in order to get control over the environment, to understand the environment, okay?