Eliezer Yudkowsky

or if there's anything going on in there such that it would start to say similar things spontaneously.

Among the things that one could do if one were at all serious about trying to figure this out is train GPT-3 to detect conversations about consciousness, exclude them all from the training data sets, and then retrain something around the rough size of GPT-4 and no larger

with all of the discussion of consciousness and self-awareness and so on missing, although, you know, hard, hard bar to pass.

You know, like humans are self-aware and we're like self-aware all the time.

We like to talk about what we do all the time, like what we're thinking at the moment all the time.

But nonetheless, like get rid of the explicit discussion of consciousness.

I think therefore I am and all that.

And then try to interrogate that model and see what it says.

And it still would not be definitive.

But nonetheless, I don't know.

I feel like when you run over the science fiction guardrails, like maybe this thing, but what about GPT?

Maybe not this thing, but what about GPT-5?

Yeah, this would be a good place to pause.

So I think you're going to have some difficulty removing all mention of emotions from GBT's data set.

I would be relatively surprised to find that it has developed exact analogs of human emotions in there.

I think that humans will have like...

emotions even if you don't tell them about those emotions when they're kids.

It's not quite exactly what various blank slatists tried to do with the new Soviet man and all that, but if you try to raise people perfectly altruistic, they still come out selfish.

You try to raise people sexless, they still develop sexual attraction.

We have some notion in humans, not in AIs, of where the brain structures are that implement this stuff.