Roman Yampolskiy

But it is also gathering information from very flawed entities.

Like all the information that it's acquiring, these large language models, is information that's being put out there by very flawed human beings.

Is there the optimistic view that it will recognize that this is the issue?

That these human reward systems that are in place, ego, virtue, all these different things, the virtue signaling, the desire for status, all these different things that we have that are flawed.

Could it recognize those as being these primitive aspects of being a biological human being and elevate itself beyond that?

Yeah, that's the problem, right?

The problem is if it's rational and if it doesn't really think that we're as important as we think we are.

To the universe, right?

Yeah.

Yeah, that's the problem.

And that's the real threat about it being used in terms of war, right?

If you give it a goal, like if you give it a goal, China dominates the world market.

Go.

For us.

And it's not going to think about that.

It's only going to think about the goal.

Right, right, right.

Yeah, that's the fear.

That's the fear that it will hold no value in keeping human beings alive.

If we recognize that human beings are the cause of all of our problems, well, the way to solve that is to get rid of the humans.