Max Tegmark

I'll say this again, because this is a very basic point I think a lot of people get wrong.

Because a lot of people dismiss the whole idea that AI can really get,

very superhuman because they think there's something really magical about intelligence such that it can only exist in human minds.

Because they believe that, they think it's going to kind of get to just more or less GPT-4++ and then that's it.

They don't see it as a suicide race.

They think whoever gets that first, they're going to control the world, they're going to win.

That's not how it's going to be.

And we can talk again about the scientific arguments from why it's not going to stop there.

But

The way it's going to be is if anybody completely loses control and, you know, you don't care if someone manages to take over the world who really doesn't share your goals, you probably don't really even care very much about what nationality they have.

You're not going to like it.

It's much worse than today.

If you live in Orwellian dystopia, what do you care who created it, right?

And if someone... If it goes farther and...

we just lose control even to the machines so that it's not us versus them, it's us versus it.

Why do you care who created this unaligned entity which has goals different from humans ultimately and we get marginalized, we get made obsolete, we get replaced.

That's what I mean when I say it's a suicide race.

It's kind of like we're rushing towards this cliff

But the closer to the cliff we get, the more scenic the views are and the more money there is there.

So we keep going.