Will Douglas Heaven

It is not sentient.

I mean, you will find people who say it is, but I am going to sit here now and say it is not sentient.

And I think it's so easy to be misled by a lot of the things that these models tell you.

So in that particular case,

I think it's not surprising at all that it role-played in that way.

One good way to think of what LLMs do is role-play.

You give them a role, you give them scripts almost, all those emails with things it could draw on.

You press go and it'll do a really good job of mimicking what someone might say.

But mimicking what someone might say is a world apart from...

an entity actually itself saying these things or having these desires or motivations.

Maybe both.

I mean, for me, I think 100% less scary.

But maybe as we see that they're stranger than us and they don't work like us, maybe they will also feel a bit more alien.