Salim Ismail

And when you see the, uh, the, the, the AIs simulating or acting that way, he goes from it from that perspective.

I do disagree with the concept of this because, uh,

I think they're mimicking consciousness.

That's a very different thing than actually being conscious.

But a bigger point, though, is not about whether AI is conscious, but is it operationally autonomous, right?

Because discussing the philosophical aspect of this is fascinating and great, but CEOs and governments need much more worried about the agents that can

plan, execute, negotiate, code, persuade, et cetera, all of that stuff that happens.

So it becomes a non sequitur and an orthogonal discussion to the real important conversation.

I think the recursive self-improvement is the really big deal though.

That one, when we hit that, holy crap.

I'm going to move.

I need to say something real quick.

Last comment.

I think the AGI consciousness discussion is the wrong question.

It's really a question about agency.

That's the threshold that we should be looking at.

And if you can get to agency, then we have to deal with the whole thing.

The problem is if AI becomes conscious, you have a moral rights problem.

If it becomes agentic, you have a governance problem.

The governance problem comes first.