Stuart Russell

Well, okay, so let's look on the bright side and say that the CEOs all decide to pause their AGI development, figure out how to make it safe, and then resume in whatever technology path is actually going to be safe.

What does that do to human life?

If they pause?

No, if they succeed in creating AGI and they solve the safety problem.

And they solve the safety problem.

Because if they don't solve the safety problem, then you should probably be finding a bunker or...

going to Patagonia or somewhere in New Zealand.

Do you mean that?

Do you think I should be finding a bunker?

No, because it's not actually going to help.

It's not as if the AI system couldn't find you.

I mean, it's interesting.

So we're going off on a little bit of a digression here from your question, but I'll come back to it.

So people often ask, well, okay, so how exactly do we go extinct?

And of course, if you ask the gorillas or the dodos, how exactly do you think you're going to go extinct?

they haven't the faintest idea.

Humans do something and then we're all dead.

So the only things we can imagine are the things we know how to do that might bring about our own extinction, like creating some carefully engineered pathogen that infects everybody and then kills us.

Or starting a nuclear war, presumably as something that's much more intelligent than us, would have much greater control over physics than we do.

We already do amazing things, right?