Yoshua Bengio

speaker
2,216 appearances 5 recordings 5 series first heard Oct 2018 last heard 7 May

Yoshua Bengio’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months
1 · May OctJan 26AprJulnow

Recordings per month over the last 12 months — 3 in all, peaking in May 2026 with 1.

Appearances

newest first · ▶ plays the moment
And this is not theoretical.
I mean, there is theoretical analysis, which shows why it will happen, but it is also observed in experiments.
Now, you know, maybe this could be fixed by patching such systems, and this is what the companies are trying to do, but it's a game of cat and mouse.
And right now,
The mouse is growing and the cat doesn't seem able to catch the mouse.
And I'm worried that monitoring or more alignment training isn't going to solve the problem.
At least I don't see any kind of strong assurance or even less mathematical guarantee that it will.
It's worse than that.
We've seen that those systems now, the most advanced systems know that they're being tested.
and they will behave differently so that they pass the tests because of the self-reservation drives, presumably, which means we may put in all these patches and think everything is fine and not really know.
When we will probably use these systems to design the next versions of AI, so AI used to do AI research, this becomes a real problem.
If those AIs can plant back doors into the code to generate
that will help future versions of themselves escape our control, then we're really in a bad place.
It would be much, much more reassuring if the system were designed to be honest in the first place and wouldn't have these deceptive behaviors.
The behavior of peer preservation that I just mentioned
It's difficult to explain on the ground of reward hacking or instrumental goals.
How does it help the AI to protect other AIs?
It's not clear.
But it's very clear that would be a human thing to do to protect others like you.
So that makes me think that the pre-training is still a big part of these hidden goals.
Showing 41–60 of 2,216 · page 3 of 111 ← Previous Next →