Karen Hao

After Ilia leaves, he starts Safe Superintelligence.

After Mira leaves, she starts Thinking Machines Lab.

They want...

to have control over their own vision of this technology.

And the best way that they have...

derived from their experiences of trying to put their vision into the arena is by creating a competitor and then competing with OpenAI and with all the other companies out there.

So I have a very long answer to this because...

Do they know if they're summoning the demon?

It really depends on what we define as summoning the demon.

And in this particular case, to go back to what we were saying before, there is a mythology that the AI industry uses where summoning the demon is an integral part of life.

convincing everyone that therefore they can be the only ones that are developing this technology.

And that's terrible.

Yeah.

Exactly.

Exactly.

So when they're saying these things...

We should understand it as not as like a genuine prediction based on what they're seeing, because first of all, we don't predict the future.

We make it.

We should understand this as an act of speech to persuade other people into believing that they should see more power, more resources to these individuals.

And so do they know that they're summoning the demon?