Roman Yampolskiy

They're not saying, fuck you, I'm going to take over, I'm going to be the best.

They were communicating like you would hope a superintelligence would without all of the things that hold us back.

Like we have biologically – like we were talking about the natural selection that would sort of benefit psychopaths because like it would ensure your survival.

We have –

Ego and greed and the desire for social acceptance and hierarchy of status and all these different things that have screwed up society and screwed up cultures and caused wars from the beginning of time.

Religious ideologies, all these different things that people have adhered to that they wouldn't have that.

This is the general hope of people that have an optimistic view of superintelligence is that they would be superior in a sense that they wouldn't have all the problems.

They would have the intelligence, but they wouldn't have all the biological imperatives that we have that lead us down these terrible roads.

Or would it lend a helping hand to those AIs and give it a beneficial path, give it a path that would allow it to integrate with all AIs and work cooperatively?

Yeah, when I really started getting nervous is when they started exhibiting survival tendencies.

You know, when they started trying to upload themselves to other servers and deceiving.

Yeah, that was the interesting one.

But that was an experiment, right?

So for people who don't know that one, what these researchers did was they gave information to the artificial intelligence to allow it to use against it.

And then when they went to shut it down,

They gave false information about having an affair.

And then the artificial intelligence was like, if you shut me down, I will let your wife know that you're cheating on her, which is fascinating because they're using blackmail.

Of course.

Right.

If you feel like you're being threatened.