Rohin Shah

speaker

1,071 appearances 1 recordings 1 series first heard Jun 2026 last heard 2 Jun

Rohin Shah’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Jun 2026 with 1.

Appearances

newest first · ▶ plays the moment

80,000 Hours Podcast · #245 – Rohin Shah on what it's really like to run AGI safety at Google DeepMind (and where I disagree with 'doomers') · 2 Jun 2026 podcast

And the real answer was just we hadn't even tried to stop the jailbreaks.

Now if people want to give us research on jailbreaks and how to defend against them, we will definitely use it.

Absolutely, yeah.

Lots of different theories of change for research.

I'm definitely only talking about if you want a company to use it now, basically now.

Anyway, so that was step one, do they actually care?

Step two is...

I call it, are you helping?

But it's like a very specific flavor of helping.

Specifically, I think you should either be proposing a solution or building an evaluation or a metric of some kind.

Now there is research that is not these things, right?

There is like research that does some sort of theory to like understand some phenomenon better, right?

that will give you some increased understanding of the phenomenon but doesn't solve a particular problem, doesn't produce a metric or eval that the company should care about.

There are lots of other examples of research like this.

I think basically most of that research we are unlikely to use unless it happens to really be on a core problem that we care about a lot.

Given that we are all busy and it takes a lot of work to incorporate any new thing, usually it needs to be a metric or an eval or some kind of solution.

so people are doing uh interesting theorizing or like preliminary empirical work to understand a phenomenon better you'll be like that's that's a well and good come back when you have a solution roughly yes and again i like i think this is good research to do and people should do it it like can help develop better solutions in the future i just don't think they should be thinking that this is like spend a lot of time reading it exactly um

Yeah.

All right.

Next thing after that, especially if you're going to be proposing a solution, the next thing to be doing is making sure that the solution, like evaluating your solution, or at least conceptually evaluating your solution, even if it's not by experiments, on the various metrics that companies care a lot about.

Showing 941–960 of 1,071 · page 48 of 54