Yoshua Bengio

So let's say that 20 of the richest nations on earth, instead of the U S and China come together and say, we have to be careful better than that.

Um,

They could invest in the kind of technical research and preparations at a societal level.

so that we can turn the tide.

Let me give you an example which motivates Law Zero in particular.

Law Zero is, sorry, yeah, it is the nonprofit R&D organization that I created in June this year.

And the mission of Law Zero is to develop a different way of training AI that will be safe by construction, even when the capabilities of AI go to potentially superintelligence.

The companies are focused on that competition.

But if somebody gave them a way to train their system differently, that would be a lot safer.

there's a good chance they would take it because they don't want to be sued.

They don't want to have accidents that would be bad for their reputation.

So it's just that right now, they're so obsessed by that race that they don't pay attention to how we might be doing things differently.

So other countries could contribute to these kinds of efforts.

In addition, we can prepare for days when, say, the US and Chinese public opinions have shifted sufficiently.

so that we'll have the right instruments for international agreements.

One of these instruments being what kind of agreements would make sense, but another is technical.

How can we change the software and hardware level, these systems, so that even though the Americans won't trust the Chinese and the Chinese won't trust the Americans, there is a way to verify each other that is acceptable to both parties.

And so these treaties can be not just based on trust, but also on mutual verification.

So there are things that can be done so that if at some point we are in a better position in terms of governments being willing to really take it seriously, we can move quickly.

Yes.