Joe Carlsmith

And so like that's like one feature of the situation.

There's a concern here that I, you know, I really try to foreground in the series that I think is related to what you're saying, which is something like, you know, you might be worried that we will be very gentle and nice and free with the AIs, and then they'll kill us.

You know, they'll take advantage of that, and then it will have been like a catastrophe, right?

And

So I opened the series basically with an example that I'm really trying to conjure that possibility at the same time as conjuring the...

grounds of gentleness and the sense in which it is also the case that these AIs could be, they can be both be like others, moral patients, like this sort of new species in the sense of that should conjure like wonder and reverence and such that they will kill you.

And so I have this example of like, ah, this documentary, Grizzly Man, where there's this environmental activist, Timothy Treadwell, and he says,

aspires to approach these grizzly bears.

He lives, you know, in the summer he goes into Alaska and he lives with these grizzly bears and he aspires to approach them with this like gentleness and reverence.

He doesn't use bear mace or he doesn't like carry bear mace.

He doesn't use a fence around his camp.

And he gets eaten alive by the bears or one of these bears.

And, you know, and I kind of really wanted to foreground that

possibility in the series.

Like, I think we need to be talking about these things both at once, right?

And bears can be moral patients, right?

AIs can be moral patients.

Nazis are moral patients.

Enemy soldiers have souls, right?

And so I think we need to learn the art of kind of hawk and dove, both, like kind of, there's this like,