Yoshua Bengio
speaker
2,216 appearances
5 recordings
5 series
first heard Oct 2018
last heard 7 May
Yoshua Bengio’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 3 in all, peaking in May 2026 with 1.
Appearances
But they thought that the only way to train it would be to train it by reinforcement learning to make good predictions.
But there's a huge flaw here, right?
Because how do I, if I'm rational and I want to maximize the good predictions I will do forever in the future, I could lie in the short term to make humans do things that will help me to make good predictions in the future.
Like get more compute so I can train a better version of myself or make the world simpler to predict.
Kill everyone.
If humans kill each other, then the world will be much easier to predict.
So these are really bad outcomes that are due to instrumental goals of making good predictions.
And it arises because of the reinforcement learning kind of objective.
You're training the AI to achieve something in the real world, and that's where you get bad problems.
But the other approach, the approach of the scientist AI, is to train it from the get-go not to achieve anything in the world,
but to just get to predict the training data, the past data.
So it's not about the future, it's about the past, to come up with good explanations and good predictions of the past data.
And that's how science works, by the way.
So what scientific theories do is explain...
the past data.
And of course, sometimes they make predictions about future data, which we can check.
But fundamentally, the way that we judge a good theory is that it is making good predictions about the data we have.
Does this require blinding the model to the results, basically?
In some sense.
So we're
Showing 441–460 of 2,216 · page 23 of 111
← Previous
Next →