Joe Carlsmith

And so that's what I mean there is I think there's a way in which we're sort of, nature is a little bit more on our side

then you might think because like part of who we are is like has been made by a kind of nature's way.

Um, and so, uh, that, that is like in us now, I don't think that's enough necessarily, uh, you know, for us to beat the gray goo, right?

Like we have some amount of like power built into our values, but that doesn't mean it's, it's kind of going to be such that it's kind of arbitrarily competitive.

Um, but I think it's still important to keep in mind that this is, and I think it's important to keep in mind in the context of,

of integrating AIs into our society that I think, you know, we've been talking a lot about the ethics of this, but I think there's also, there are like instrumental and kind of practical reasons to want to have like forms of social harmony and like cooperation with AIs with different values.

And I think we need to be

taking that seriously and thinking about what is it to do that in a way that's like genuinely kind of legitimate and, and kind of a project that is sort of a, a kind of just, um, incorporation of these beings into our civilization such that they can kind of all, or sorry, there's like the justice part.

And there's also the kind of, is it like kind of, um,

compatible with like people, you know, is it a good deal?

Is it a good bargain for people?

And I think this is, you know, this is often how, you know, to the extent we're kind of very concerned about AI is like kind of rebelling or something like that.

It's like, well, there's like a lot of, you know, part of a thing you can do is make civilization better for some, right?

So it's like, and I think that's an important feature of how we have in fact structured a lot of our political institutions and norms and stuff like that.

So that's the thing I'm getting at in that

in that quote.

Okay, I think that's an excellent place to close.

Great.