Stuart Russell

Yes.

The other problems...

are, roughly speaking, misuse, right?

So even if we solve the control problem, we make perfectly safe, controllable AI systems, well, why?

Why does Dr. Evil going to use those, right?

He wants to just take over the world and he'll make unsafe AI systems that then get out of control.

So that's one problem, which is sort of a, you know, partly a policing problem, partly a sort of cultural problem for the profession of how we teach people what kinds of AI systems are safe.

There's another topic I'm happy to talk about.

I just want to mention what I see is the third major failure mode, which is overuse.

Not so much misuse, but overuse of AI.

that we become overly dependent.

So I call this the Wally problems.

If you've seen Wally, the movie, all right, all the humans are on the spaceship and the machines look after everything for them.

And they just watch TV and drink big gulps.

And, uh, they're all sort of obese and stupid and, and they sort of totally lost any notion of human autonomy.

And, um,

So in effect, this would happen like the slow-boiling frog.

We would gradually turn over more and more of the management of our civilization to machines, as we are already doing.

And if this process continues, we sort of gradually switch from sort of being the masters of technology to just being the guests of

So we become guests on a cruise ship, which is fine for a week, but not for the rest of eternity.