David Duvenaud

It's not, it's clearly just not within their scope.

Sure.

I mean, I think the best example of this is just all of the AI lab leaders being convinced by this story that like, Oh, this is an existential risk and question mark, question mark, question mark.

And now I need to join the race and build my own AI lab just to even matter.

Right.

And also, you know, I think a lot of people ask like, okay, in the, in the future, why are the oligarchs not coordinating?

And it's like, well, in particular, like the reason that XAI and, uh,

OpenAI and Anthropic all exist is because these particular oligarchs actually exactly failed to get along on exactly this topic.

Yeah.

Yeah, I mean, well, I don't know what their relationships are in much detail, but I guess I'll just say, like, these are the exact people that we were hoping will coordinate on exactly this issue, and they already exactly are failing to do so right now.

Yeah, I mean, we've thought a lot about this.

And like my co-author, David Kruger, wears t-shirts at like New Reps that say like, just don't build AGI and gives out stickers and stuff like that.

And I think...

People under-discuss this possibility because it's not very fun.

It's very wealth-destroying.

You're not part of the cool kids club if you're not building.

And I'm one of these people that just loves to build.

We mentioned this project on LLM forecasting, for instance.

But anyway, I think lately we've all agreed that we should make a habit of saying, if we could all coordinate to delay building much more powerful superhuman systems, that would be a good thing.

And I think the realistic way this would go is that this would end up...