Yoshua Bengio
speaker
2,216 appearances
5 recordings
5 series
first heard Oct 2018
last heard 7 May
Yoshua Bengio’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 3 in all, peaking in May 2026 with 1.
Appearances
of its predictions.
Okay, let's start with a predictive model.
It's easier to understand, right?
So imagine you do have a really good climate model.
The climate model, if you run a simulation of it or train a neural net to approximate those simulations, will give you honest answers.
And it doesn't care if, you know, the answer make us do something stupid.
So that's how you get honest answers, essentially, by building understanding, explanatory understanding of the world that is completely indifferent to how the predictions are going to be used.
Now, once you have this, you can use it in a kind of agentic way.
So for example, the guardrail is a kind of agentic thing, right?
It's taking a binary decision.
Do I accept this prediction?
Do I put out this prediction in the real world or not?
And it is a decision.
It is an agentic choice.
But in this case, it's a choice that has a unique goal, which is to avoid dangerous actions, right?
So we are already entering the agentic world once we install the guardrail.
And yeah, so bottom line, to summarize my answer, there's a way to train a predictor that will not require reinforcement learning in the sense that it will not require optimizing with respect to
future events in the world, including future good prediction errors.
And here I want to make a parenthesis about previous work in AI safety on AI oracles.
So one of the, of course, people have thought about this, like, why don't we just train an oracle that's a good predictor?
Showing 421–440 of 2,216 · page 22 of 111
← Previous
Next →