Stuart Russell

So you can imagine that a few million years ago, the human line branched off from the gorilla line in evolution.

And now the gorillas are looking at the human line and saying, yeah, was that a good idea?

And they have no say in whether they continue to exist.

Because we have a... We are much smarter than they are.

If we chose to, we could make them extinct in a couple of weeks.

And there's nothing they can do about it.

So that's the gorilla problem, right?

Just the problem a species faces when there's another species that's much more capable.

Yes, intelligence is the ability to bring about...

what you want in the world.

Because it seems like a crazy thing to want to… Because they think that if they create this technology, it will have enormous economic value.

They'll be able to use it to replace all the human workers in the world, to develop new…

products, drugs, forms of entertainment, anything that has economic value, you could use AGI to create it.

And maybe it's just an irresistible thing in itself, right?

I think we as humans place so much store on our intelligence, how we think about what is the pinnacle of human achievement.

If we had AGI, we could go way higher than that.

So it's very seductive for people to want to create this technology.

And I think people are just fooling themselves if they think it's naturally going to be controllable.

I mean, the question is, how are you going to retain power forever over entities more powerful than yourself?

Yeah, it's sort of funny.