Eric Schmidt

Because we're not going to know

we're just not going to know what you're up to.

And you might actually be doing something really bad or really amazing.

We want to be able to watch.

So we need providence, something you and I have talked about, but we also need to be able to observe it.

To me, that's a core requirement.

There's a set of criteria that the industry believes are points where you want to metaphorically unplug it.

One is where you get recursive self-improvement, which you can't control.

Recursive self-improvement is where the computer is off learning and you don't know what it's learning.

That can obviously lead to bad outcomes.

Another one would be direct access to weapons.

Another one would be that the computer systems decide to exfiltrate themselves, to reproduce themselves, without our permission.

So there's a set of such things.

The problem with Joshua's speech with respect to such a brilliant person is stopping things in a globally competitive market doesn't really work.

Instead of stopping agentic work, we need to find a way to establish the guardrails, which I know you agree with, because we talked about it.

In many cases, we already have doctrines about personal responsibility.

A simple example, I did a lot of military work and continue to do so.

The US military has a rule called 3000.09, generally known as human in the loop, or meaningful human control.

You don't want systems that are not under our control.

It's like a line we can't cross, I think that's correct.