Yoshua Bengio

speaker

2,216 appearances 5 recordings 5 series first heard Oct 2018 last heard 7 May

Yoshua Bengio’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 3 in all, peaking in May 2026 with 1.

Appearances

newest first · ▶ plays the moment

80,000 Hours Podcast · #243 – 'Godfather of AI' Yoshua Bengio: "I now see a path" to safe superintelligent AI · 7 May 2026 podcast

We have this condition in the scientist AI requirements for the theorem that we call consequence invariance.

What it means is you're only allowed to use how well you're fitting the past data in order to train your causal model.

You're not allowed to choose those predictions with respect to either what could happen in the future as a consequence of those predictions.

Yeah, so first you have to understand that the same predictor that is trained in a unified way can be used to both answer user questions

and answer safety questions.

And the safety questions are those that you care about for the guardrail.

So it's not like there's a separate neural net that does the guardrail and another one that makes predictions.

The guardrail is using the same prediction neural net.

It's just a different kind of question you're asking.

You're asking what's the probability of particular kind of harm given that I put out this prediction or in the case of the agentic system that the AI puts out a particular action.

So training is fully the predictor.

Now, once it's trained, there are a number of things you can do to construct the system that includes the scaffold.

So what is the scaffold doing?

Well, for example, when a user comes with a question, it will construct the question, put it in the form for the predictor to produce a probability, but it will also call the predictor with a different question, which is the probability of harm.

So that's the guardrail question.

And then it will look at the answer in order to decide whether to produce an answer or not.

For example, if the question is about, you know, how do I build a bomb?

Then the guardrail will say the probability that this is dangerous is high.

And I mean, high enough.

And so the guardrail will use a threshold

Showing 461–480 of 2,216 · page 24 of 111