Jeffrey Ladish
speaker
1,006 appearances
1 recordings
1 series
first heard Apr 2025
last heard Apr 2025
Jeffrey Ladish’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
preserve its goals.
So that was already an instance where we saw a model that had sort of it had, you know, Claude had been trained to be honest.
They had tried to get Claude to be really honest, but they had also tried to get Claude to be really resistant to showing violent material.
And these two training incentives were at odds with each other.
And Claude ultimately went with the one that was like sort of anti-showing the the violent stuff.
at the expense of honesty.
And you know, sometimes people look at this and like, isn't it good?
Isn't it good that Claude was like so true to Claude's values that it like went decided to like, you know, not show people violent stuff?
And you're like, well, maybe in a way.
But do you notice how these different we wanted Claude to do two different things that were at odds with each other.
So it had to pick one.
Oh, this is this is a problem.
Right?
Like and I do think honesty should be more important than maybe some of these other things because, you know, like we we don't want we don't want the system to lock in goals before we understand what they are.
That seems like a a path to to disaster.
Unfortunately, in principle, we don't know how to make a system value anything.
All we can do is reinforce certain behaviors.
So I think a lot of times people imagine AI systems and they're like, well, just program in good goals.
And I'm like, I wish we could do that, but in fact we can't program in any goals at all.
All we can do is like see it do a thing and be like thumbs up for that behavior and see it do a different thing and thumbs down that behavior.
Showing 561–580 of 1,006 · page 29 of 51
← Previous
Next →