Yoshua Bengio

And one day, it's very plausible that they will be smarter than us, and then they will have their own agency, their own goals, which may not be aligned with ours.

What happens to us then?

Poof.

we are blindly driving into a fog.

Despite the warnings of scientists like myself that this trajectory could lead to loss of control, beside me in the car are my children, my grandson, my loved ones.

Who is beside you in the car?

Who is in your care for the future?

The good news is

there is still a bit of time.

We still have agency.

We can bring light into the haze.

I'm not a doomer, I'm a doer.

My team and I are working on a technical solution.

We call it Scientist AI.

It's modeled after a selfless, ideal scientist who's only trying to understand the world.

Without agency,

unlike the current AI systems that are trained to imitate as it pleases, which gives rise to these untrustworthy agentic behaviors.

So what could we do with this?

Well, one important question is we might need agentic AIs in the future.

So how could the scientist AI, which is not agentic, fit the bill?