Stephen Wolfram

Okay, they can maybe figure out a way to achieve that objective.

We say, what objective would you like to achieve?

The AI has no intrinsic idea of that.

It's not a defined thing.

That's a thing which has to come from some other entity.

And insofar as we are in charge, so to speak, or whatever it is, and our kind of web of society and history and so on,

is the thing that is defining what objective we want to go to.

That's the thing that we humans are necessarily involved in, so to speak.

From on what basis?

I mean, if they say, look, here's the terrible thing that could happen, okay?

They're taking the average of the internet and they're saying, you know, from the average of the internet, what do people want to do?

I haven't heard that one from him yet.

Right.

So I mean, this question of what, you know, if you say to the AI, you know, what does the species want to achieve?

Yes.

There'll be an answer, right?

There'll be an answer.

It'll be what the average of the internet says the species wants to achieve.

No, but I mean, in the end, it's a reflection back of what we've already said.

Maybe.