Joe Carlsmith

Take another step.

There's some like kind of organic process of growing and changing things.

which I do expect ultimately to lead to something quite different from, uh, biological humans.

Though I, you know, I think there's a lot of ethical questions we can raise about what that process involves.

Um, but I think, uh,

You know, I also... I do think we... Ideally, there would be some way in which we manage to grow via the thing that really captures what do we trust in... You know, there's something we trust about the ongoing processes of human civilization so far.

I don't think it's the same as, like, raw competition or...

I think there's like some rich structure to how we understand like moral progress do have been made and what it would be to kind of carry that thread forward.

And I don't have a formula.

I think we're just gonna have to bring to bear the full force of,

everything that we know about goodness and justice and beauty and every, we just have to, you know, bring ourselves fully to the project of like making things good and doing that collectively.

And I think that is, it is a really important part, I think, of our vision of like what was an appropriate process of like deciding, of like growing as a civilization is that there was this very inclusive kind of decentralized element of like people getting to think and talk and grow and change things and react rather than some more like

and now the future shall be like blah.

I think that's, I think we don't want that.

So I definitely share some intuition there that there's You know at a high level a lot of what's scary about the situation with AI has to do with concentrations of power and Whether that power is kind of concentrated in the hands of misaligned AI or in the hands of some human and

I do think it's very natural to think, OK, let's try to distribute the power more.

And one way to try to do that is to kind of have a much more multipolar scenario where lots and lots of actors are developing AI.

And this is something that people have talked about.

When you describe that scenario, you were like, some of which are aligned, some of which are misaligned.

That's key.