Jeffrey Ladish

speaker

1,006 appearances 1 recordings 1 series first heard Apr 2025 last heard Apr 2025

Jeffrey Ladish’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

No recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.

Appearances

newest first · ▶ plays the moment

"The Cognitive Revolution" · Reward Hacking by Reasoning Models & Loss of Control Scenarios w/ Jeffrey Ladish of Palisade Research, from FLI Podcast · 2 Apr 2025 podcast

And so it hacked the master computer and basically then took control of the whole network.

And then it didn't even have to log into the computer to solve the problem.

It just like told the computer, hey, spit out the password.

I got this.

And that worked.

And then so the open AI researchers looked at this and they were like, Oh my God, we definitely didn't intend this.

We didn't mean to leave the master computer unsecured.

This just happened.

And we're like, wait, what is what is happening?

Like that wasn't part of the challenge.

That was not supposed to happen.

And so my story for what happened there is that OpenAI had trained this system to be a relentless problem solver.

And

If you train a system to be a relentless problem solver and it runs into an obstacle, what's it gonna do?

Well, it's gonna route around the obstacle.

It's gonna find a way to achieve its goal if it can.

And

You know, that's great if the obstacle is something that we want the AI system to route around.

And that's not so great if we are the obstacle or your own computer security is the obstacle.

And so I think that is some interesting evidence about the kinds of behaviors we'll see from AI systems and sort of the kinds of concerning behaviors we'll see as they get a lot smarter.

Showing 401–420 of 1,006 · page 21 of 51