Joe Carlsmith

And I think it might require being thoughtful.

Um, and it might require being kind of having, uh, you know,

a kind of mature discourse about this before we start taking like irreversible moves.

But I'm optimistic that we can at least avoid like some of the connotations and a lot of the stuff at stake in that kind of binary.

I certainly think concerns in that vein are real.

I mean, I think if you, it is disturbing how easy many of the analogies with kind of

uh, human historical events and practices that we kind of deplore, or at least have a lot of wariness towards are as in the context of the kind of way you end up talking about, um, kind of AI maintaining controls over control over AI, like making sure that it doesn't rebel.

Like I think we should, we should be noticing that kind of, um,

reference class that some of that talk starts to conjure.

Um, and so basically just, yes, I think we should be very, we should really notice that.

Um, you know, part of what I'm trying to do in the series is to bring the kind of full range of considerations at stake and to play, right?

Like I think, um, uh, it is both the case that like

we should be quite concerned about like being kind of overly controlling or, you know, abusive or oppressive, or there's all sorts of ways you can go too far.

And I think, you know, there are concerns about the AIs being genuinely dangerous and genuinely, you know, acting, you know, killing us, finally overthrowing us.

And I think the moral of the situation is quite complicated.

And then I think in some sense,

So often when you're, if you imagine a sort of external aggressor who's coming in and invading you, you feel very justified in doing like a bunch of stuff to prevent that.

It's like a little bit different when you're like inventing the thing and you're doing it like incautiously or something.

And then you're also like, I think the sort of moral justification you have for like, there's a different vibe in terms of like the kind of overall,

yeah, justificatory stance you might have for various types of like more kind of power-exerting interventions.