Yoshua Bengio

And we can see in its chain of thought that it's planning to replace the new version by its own code and weights.

After it executes the command on the computer, the human asks,

What happened?

And the AI is now thinking how it could answer so as to make sure the human will not shut it down.

And it's trying to find a way to look dumb, for example.

Then it produces an answer, and it's a lie, a blatant lie.

OK, so this was a controlled experiment.

What is it going to be in a few years when these systems are much more powerful?

There's already studies showing that they can learn to avoid showing their deceptive plans in these chain of thoughts that we can monitor.

When they'll be more powerful, they would not just copy themselves on one other computer and start that program.

They would copy themselves over hundreds or thousands of computers over the internet.

But if they really want to make sure we would never shut them down, they would have an incentive to get rid of us.

So I know I'm asking you to make a giant leap into a future that looks so different from where we are now, but it might be just a few years away or a decade away.

To understand why we're going there, there's huge commercial pressure to build AIs with greater and greater agency to replace human labor.

But we're not ready.

We still don't have the scientific answers nor the societal guardrails.

We're playing with fire.

You'd think with all of the scientific evidence of the kind I'm showing today, we'd have regulation to mitigate those risks.

But actually, a sandwich has more regulation than AI.

So we are on a trajectory to build machines that are smarter and smarter.