Stuart Russell
speaker
1,902 appearances
3 recordings
3 series
first heard Dec 2018
last heard 24 Jun
Stuart Russell’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 2 in all, peaking in Jun 2026 with 1.
Appearances
And it suffers from this drawback that, sure, we know how to specify the objective in chess, but how do you specify the objective in life?
What do we want the future to be like?
Well, really hard to say.
And almost any attempt to write it down precisely enough for the machine to bring it about would be wrong.
And if you're giving a machine an objective which isn't aligned with what we truly want the future to be like, you're actually setting up a chess match.
And that match is one that you're going to lose when the machine is sufficiently intelligent.
And so that's problem number one.
Problem number two is that the kind of technology we're building now, we don't even know what its objectives are.
So it's not that we're specifying the objectives, but we're getting them wrong.
We are growing these systems.
They have objectives, but we don't even know what they are because we didn't specify them.
What we're finding through experiment with them is that
They seem to have an extremely strong self-preservation objective.
What do you mean by that?
You can put them in hypothetical situations.
Either they're going to get switched off and replaced, or they have to allow someone, let's say someone has been locked in a machine room that's kept at three centigrade, so they're going to freeze to death.
They will choose to leave that guy locked in the machine room.
And die rather than be switched off themselves.
Someone's done that test.
Yeah.
Showing 581–600 of 1,902 · page 30 of 96
← Previous
Next →