David Duvenaud

And I'm like, actually, that's really cool, even though I don't get to be part of it.

But I guess I'm very parochial in the sense that I'm like,

Me and my family, if we all die, that's just so bad that I almost consider that doom.

If most of humanity is in a similar situation.

So if it is just that we have runaway competition and we get replaced by some

Relatively interesting gray goo.

I'm still like, that's kind of doom.

Uh, so it's, it's like very small, right?

Then the fear is the more like, like this is what Robin Hanson fears is that we end up locking in some like, like very parochial set of values.

And, you know, maybe it's just, it's a matter of taste, but I guess to me, it looks like competition is probably going to win at the top level.

So this really reduces to like, what's the, what's the probability that there ends up being this like stable hegemon that like mostly gets values wrong.

And I'd say that that's only probably like,

like 5% or 10%.

So my PDoom, if I think that just nature flourishing or competition flourishing was valuable, would probably be only like 5% or 10%.

That's a good question.

I guess I'll say this is wide open in my mind, and I have only just started thinking about this question of at the top level, what's likely to win?

I guess I'll just say historically, there's been lots of empires and attempts to lock in values, and they've always failed.

Obviously, we're going to have much stronger coordination mechanisms, but the more levels of scaffolding we add to our civilization, also the more levels of competition there are.

Again, I have very weak intuitions here, and I feel like no one should really take my answer very seriously on this question.

Yeah, although I will say this, like the global culture, it makes it sound like this is hegemony, but there's no one steering that culture, right?