Stuart Russell

Just realizing that further progress in the capabilities of AI, you know, if we succeeded in creating real superhuman intelligence, that it was potentially a catastrophe.

And so I pretty much switched my focus to work on how do we make it so that it's guaranteed to be safe.

That's an understatement.

I'm appalled, actually, by the lack of attention to safety.

I mean, imagine if someone's building a nuclear power station in your neighbourhood.

And you go along to the chief engineer and you say, okay, these nuclear things, I've heard that they can actually explode, right?

There was this nuclear explosion that happened in Hiroshima.

So I'm a bit worried about this.

You know, what steps are you taking to make sure that we don't have a nuclear explosion in our backyard?

And the chief engineer says, well, we thought about it.

We don't really have an answer.

Yeah.

What would you say?

I think you would use some expletives.

And you'd call your MP and say, you know, get these people out.

I mean, what are they doing?

You read out the list of projected dates for AGI, but notice also that those people...

I think I mentioned Dara Amadei says a 25% chance of extinction.

Elon Musk has a 30% chance of extinction.

Sam Altman says basically that AGI is the biggest risk to human existence.