Max Tegmark

Because Moloch is a really powerful foe.

Well, OpenAI is very close with Microsoft now, of course.

And there are plenty of smaller players.

For example, Anthropic is very impressive.

There's Conjecture.

There's many, many, many players.

I don't want to make a long list, so leave anyone out.

And for that reason, it's so important that some coordination happens, that there's external pressure on all of them, saying you all need to pause.

Because then the people, the researchers in these organizations, the leaders who want to slow down a little bit, they can say to their shareholders, you know, everybody's slowing down because of this pressure.

And it's the right thing to do.

Absolutely.

Like human cloning, for example.

You could make so much money on human cloning.

Why aren't we doing it?

Because biologists thought hard about this and felt like this is way too risky.

They got together in the 70s in Asilomar and decided even...

to stop a lot more stuff also, just editing the human germline, gene editing that goes into our offspring, and decided, let's not do this because it's too unpredictable what it's going to lead to.

We could lose control over what happens to our species.

So they paused.

There was a ton of money to be made there.