Yoshua Bengio

Bingo.

The best case is what I'm working on.

The best case is finding a technical solution.

Actually, I think that it is possible to build AI that will behave well.

And I think, ideally, it would be the most important project of humanity until we figure it out.

Because if we don't, then there are these risks.

And I don't know, I don't have a lot of confidence one way or the other.

It's just I don't accept the 1% risk.

There are these polls where the median machine learning researcher thinks that there's more than 10% or 20% probability that AI will be catastrophic up to extinction.

Well, that's not even 1%.

It's like 10, 20, whatever.

I mean, that is completely unacceptable.

So the case I'm making is if we're careful, and I think we can do it,

we can actually solve those technical problems and we can build AI that will have safety by design, as some people call it.

Yeah, so we actually just previously discussed the reasons why AIs might have these bad goals emerging.

It's very likely that we won't be able to stop the train of AI capability.

In other words, that they know more, they can reason better.

My thinking is where we can intervene is their intentions.

They're going to be smart, but how do we make sure they're smart and don't want to kill us or something like that?

As a computer scientist, I like to think about, let's think about the extreme case of this.