Max Tegmark

Well, also, you know...

Another example we can all relate to of why it doesn't have to be a terrible thing to be in the presence of people who are even smarter than us all around is when you and I were both two years old, I mean, our parents were much more intelligent than us, right?

Worked out okay.

Because their goals were aligned with our goals.

And that, I think, is really the number one key point.

issue we have to solve.

The value alignment problem, exactly.

Because people who see too many Hollywood movies with lousy science fiction plot lines, they worry about the wrong thing, right?

They worry about some machine suddenly turning evil.

It's not malice that is the concern, it's competence.

By definition,

Intelligent makes you very confident.

If you have a more intelligent Go playing, computer playing is the less intelligent one.

And when we define intelligence as the ability to accomplish Go winning, right?

It's going to be the more intelligent one that wins.

And if you have a human and then you have an AGI that's more intelligent in all ways, and they have different goals, guess who's going to get their way, right?

So I was just reading about this...

particular rhinoceros species that was driven extinct just a few years ago.

Bummer, I was looking at this cute picture of a mommy rhinoceros with its child.

Why did we humans drive it to extinction?