Eliezer Yudkowsky

It's not like a defective human, it's its own thing.

But leaving that aside.

That sounds like a dreadful mistake.

Just like start over with AI systems.

If they're imitating humans who have known psychiatric disorders, then sure, you may be able to predict

then sure, if you ask it to behave in a psychotic fashion, and it obligingly does so, then you may be able to predict its responses by using the theory of psychosis, but if you're just, yeah, no, start over with, yeah, don't drag the psychology.

I mean, there's the question of to what extent it is thereby being made more human-like versus to what extent an alien actress is learning to play human characters.

I do think that the...

Those people who go through their whole lives wearing masks and never take it off because they don't know the internal mental motion for taking it off or think that the mask that they wear just is themselves.

I think those people are closer to the masks that they wear than an alien from another planet would like learning how to predict the next word that every kind of human on the internet says.

I mean, I think that you are more than the mask.

I think the mask is a slice through you.

It may even be the slice that's in charge of you.

But if your self-image is of somebody who never gets angry or something...

and yet your voice starts to tremble under certain circumstances.

There's a thing that's inside you that the mask says isn't there, and that even the mask you wear internally is telling inside your own stream of consciousness is not there, and yet it is there.

Unless there's an alien actress who is learning how to sound human.

And it's getting good at it.

If, in fact, there's a whole bunch of thought going on in there which is very unlike human thought and is directed around, like, okay, what would a human do over here?

And, well, first of all, I think it matters because there's, you know, like, insides are real and do not match outsides.