Yoshua Bengio
speaker
2,216 appearances
5 recordings
5 series
first heard Oct 2018
last heard 7 May
Yoshua Bengio’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 3 in all, peaking in May 2026 with 1.
Appearances
I also believe that the scientist AI could even be more capable than the current approach.
And it has to do with a number of design features.
So it is trained to explicitly reason in a structured way about the statements that it's asked to make a prediction over.
This is different from the current chain of thought where
it could produce some kind of bullshit that we believe and tends to pass the tests that we have during training, but it's not constrained to actually have arguments that can be decomposed in the same way that like a proof of a mathematical theorem is decomposed.
And there are other approaches that follow that direction.
So of course, a lot of the work on trying to do Safe by Design AI, but also the debate work, for example, is trying to enforce some kind of coherence
in how the AI is thinking.
So I believe that in addition to the kind of epistemic humility that comes with the training objective that we are proposing, the way that the system is producing those probabilities by invoking structured latents that form a chain of reasoning is something that could actually provide even a capability advantage to the companies.
Okay.
I have an assumption about how the world works that basically states that reasoning about the actual properties of the world, in other words, the truth, even when you're uncertain, so you have to use probability,
gives you a very strong edge in making better predictions and better actions.
And that is actually part of the arguments as to why the training procedure for the scientist AI will create latent variables that are preferentially going towards the actual beliefs.
And that is very useful because now we can query those latent variables
and get answers about what the AI actually believes, because that's how it constructs its internal reasoning and produces an answer, not some potential bullshit that comes in the chain of thought.
So it doesn't completely solve the ELK challenge, the challenge of eliciting latent knowledge.
because the only guarantees we get are about these natural language statements that can be latent variables that we can query.
Can you explain the elk problem?
Yeah, sorry.
The elk problem comes from the issue you were raising that even though the AI may internally know the truth of something, or at least have some internal beliefs about something,
Showing 361–380 of 2,216 · page 19 of 111
← Previous
Next →