Rob Wiblin

That flows through to politicians who are also really scared about things going wrong.

They provide, I guess, really quite significant resourcing.

And, you know, they hire very expensive experts to basically constantly be talking with and monitoring all of the banks.

They are like...

I think both the Bank of England and the Federal Reserve in the US are really heavily involved with all of the banks that, I guess, monitoring their books, basically in a constant conversation with them about whether things are going wrong and what risks are emerging.

And that would feel like a very natural way for things to go, I guess, especially if you're right that it's really not obvious what needs to be done.

You have to kind of be in the room, like understanding a lot of contextual specifics in order to say whether something is a good thing or a bad thing to change.

Maybe the most dominant approach that many people in AI safety and alignment are taking, at least within, actually maybe in both technical and policy areas, is trying to create and enforce pre-deployment evaluations.

So testing of what models are capable of doing and what they're inclined to do before they are deployed as products to the public.

Trying to test for ways that things could go really wrong.

You think that this is probably a misguided, not very effective high-level strategy.

Why is that?

Is there any good reason to think that we might, in the next couple of years, see a huge jump from one cycle to the next such that the model could become just way more unexpectedly capable or way more unexpectedly evil than the previous one?

you don't think that we need to do very much preparation ahead of time in order to be able to get future AGI or a future recursive self-improving AI to do a lot of safety and alignment research when the time comes, which I think might explain why I don't really hear very much at all about that broad approach from GDM.

But I guess by contrast, this at least a couple of years ago was the dominant approach that OpenAI would talk about all the time.

And you definitely hear things about it from Anthropic.

Yeah, why don't you think we need to be doing much prep now?

Yeah, I'm surprised you say that governance people aren't interested in using AI to accelerate their work.

I guess at least among the more AGI-pooled groups.

You know, I think forethought research is very much on board with this.