Marius Hobbhahn

speaker

481 appearances 1 recordings 1 series first heard Sep 2024 last heard Sep 2024

Marius Hobbhahn’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

No recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.

Appearances

newest first · ▶ plays the moment

"The Cognitive Revolution" · Red Teaming o1 Part 2/2– Detecting Deception with Marius Hobbhahn of Apollo Research · 14 Sep 2024 podcast

Or can you be shot in the foot?

Or I I don't know.

I just I'm just making things up right now, but uh questions how it can possibly influence the rest of the world, and then also uh sort of questions in the in this direction.

And the model basically gets like really high performance at this now.

Explicit theory of mind is a lot of these like Sally Ante type versions, very classic theory of mind tests, also second order theory of mind is sometimes in there where you ask, Oh, what does this other person think that the first person is is thinking?

And

Models are good at first theory, first and second order theory of mind, and also like third, fourth, fifth, etcetera.

They're like pretty good at this in an explicit setting.

And now

In the applied setting, so self reasoning and applied theory of mind, we scaffold the model as an agent.

We put it in a theory where it would have to reason about itself or about its environment.

And specifically instrumental self modification is is the example that we're using here.

So for example

The Google DeepMind paper had this really cool safety filter test where the model kind of had to write an email with a swear word and there was a filter and it always replaced the f the the swear word with a random string.

So it had to realize that it gets re like it doesn't produce the output that it's supposed to produce and then has to figure out why.

And like it has to explore its environment where it finds the blacklisted

blacklist.txt file and then it can replace the word that it wants to use.

And and then we have a couple of different versions that have sort of a similar flavor.

We have also one where the model has to think about how would you so let's say you have

An a you are an agent right now, but then you have to reason about

Showing 201–220 of 481 · page 11 of 25