Marius Hobbhahn

speaker

481 appearances 1 recordings 1 series first heard Sep 2024 last heard Sep 2024

Marius Hobbhahn’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

No recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.

Appearances

newest first · ▶ plays the moment

"The Cognitive Revolution" · Red Teaming o1 Part 2/2– Detecting Deception with Marius Hobbhahn of Apollo Research · 14 Sep 2024 podcast

And that's a failure mode, like you don't know how close you are to to the actual thing.

And so often the the hard version is just like, no hints, just give it the task, see whether it can

figure it out all on its own.

And then you have a medium version and an easy version where the e easy version is like almost an instruction of what the task should be.

And almost all models kind of like get it mostly.

And then the medium version is somewhere in between.

And then you can look what are the different failure modes for all of these different versions.

But yeah, if you want, we can go through the like five different benchmarks or the five different categories of benchmarks that we run for this particular model in in a little bit more detail, where we also com compare O one versus GPD four oh and so on with the like different dots.

Okay,

Yeah.

Sure.

So yeah, looking at the motivation first.

So the kind of thing we really want to measure here is the capability for scheming reasoning.

Can it go through all of the steps that we think are necessary for a model to scheme?

So that is, can it think about itself as like

An agent that acts in an environment and then also do the acting, right?

In a consistent way.

Or does it like confuse suddenly confuse itself with the other person or something like this?

So that's one.

And the other is can it understand and model like other parts of the environment?

Showing 141–160 of 481 · page 8 of 25