Satya Nadella

And then the UI side of it is presence.

Stafford uses that term.

In fact, he's used that term more recently around this new species.

The way I come at it is you definitely need trust.

I think the one thing that before we kind of claim it is something...

as big as a species.

The fundamental thing that I think that we've got to get right is that there is real trust, whether it's personal or societal level trust that's baked in.

That's the hard problem.

Because I think the one biggest rate limiter to the power here will be how does our legal, call it infrastructure, we're talking about all the compute infrastructure, how does the legal infrastructure evolve to deal with this?

Like, entire world is constructed with things like humans owning property, having rights, and being liable.

Like that's the fundamental thing that one has to sort of first say, okay, what does that mean for anything that now humans are using as tools?

And if humans are going to delegate more authority to these things, then how does that structure evolve?

Like until that really gets resolved, I think just talking about sort of the tech capability, I don't think it's going to happen.

Because at the end of the day, there is no way.

Like, today you cannot deploy these intelligences unless and until there's someone indemnifying it as a human.

To your point, that's one of the reasons why I think about, like, even the most powerful AI is essentially working with some delegated authority from some human.

You can sort of say, oh, that's all alignment, this, that, and the other.

And that's why I think you have to sort of really get these alignments to actually work and be verifiable in some way.

But I just don't think that you can deploy intelligences that are out.

So, for example, this AI takeoff problem may be a real problem.