Eric Schmidt

So let's think about agents.

So for purposes of argument, everyone in the audience is an agent.

You have an input that's English, or whatever language, and you have an output that's English, and you have memory, which is true of all humans.

Now, we're all busy working, and all of a sudden,

One of you decides it's much more efficient not to use human language, but we'll invent our own computer language.

Uh-oh.

Now, you and I are sitting here watching all of this, and we're saying, like, what do we do now?

The correct answer is unplug you.

Right?

Because we're not going to know

we're just not going to know what you're up to.

And you might actually be doing something really bad or really amazing.

We want to be able to watch.

So we need providence, something you and I have talked about, but we also need to be able to observe it.

To me, that's a core requirement.

There's a set of criteria that the industry believes are points where you want to metaphorically unplug it.

One is where you get recursive self-improvement, which you can't control.

Recursive self-improvement is where the computer is off learning and you don't know what it's learning.

That can obviously lead to bad outcomes.

Another one would be direct access to weapons.