André Duqum

So I think one very interesting conversation is the more that we see intelligence exponentially increasing, the more this delta, this gap between what we perceive ourselves to be and the machine intelligence, that gap is closing.

And it begs the question around consciousness.

what AI agents will eventually demand moral consideration if they can potentially become conscious.

And so I actually had my friend and consciousness researcher who's been on the podcast a few times, Donald Hoffman, send in some questions.

So the first one he asked was, do you believe that AI can genuinely become conscious?

Why?

What would you say about those thermodynamic chips would make consciousness capable?

His second question was, if so, could you explain how an AI system could generate an experience such as could generate a specific experience such as the taste of garlic?

Yeah, I think as that gap is closing where AI agents are increasingly seeming conscious of

We then treat them as if they are conscious, whether or not they actually are conscious.

citizenship already so yeah I guess at what point I mean we're already seeing people do it like Saudi Arabia what at what point does or do you ever think an AI system deserves moral consideration so there's a question like are you killing an AI when you turn it off

Well, we know they're

there's consciousness to a degree, right?

And that there's sort of a gradient of sentience from, I mean, from what we would maybe perceive as more inert from a rock all the way through the insect life, through dogs, pigs, primates, dolphins, whales, to human beings, which we see is sort of at the top there, but where it translates into the AI agent space,

How would we ever have any real ability to get into the interior experience of an AI model?

And if we give the moral consideration, wouldn't it only make sense if there was actually something that is to be like that?

If there was an actual conscious qualia, an actual conscious experience as the agent, I think Nagel's quoted in what it's like to be a bat.

That consciousness is essentially that it is something like to be that thing.

As a nature of self, effectively.

Right, right.