Emad Mostaque

Yeah.

And it made them centrifuges spin around.

So they exploded.

Well, yeah, I mean, look, this is the thing like Elon Musk has just launched XAI as we kind of export AI as we kind of speak this.

And his thing is to create an AI that searches for truth.

So he wants to give it impulse, which is to search for the meaning of the universe and truth and other things like that.

then someone else might not give in an impulse and you might have someone downloading the weights of gpt4 or five so this is a tragedy of the commons thing on a usb stick and then they're like i want to take down america and they'll be like let's take a thousand gpt4s and tell it build stuxnets to take down america it's not intelligent yet it's still dangerous we don't know when this thing will become actually intelligent or self-aware or if it may never become

But we can see the probability of outcomes here.

It could be absolutely fine.

It could be very bad.

There are no standards.

So what you suggested, it could work.

Only if everyone does it.

We're never going to get anyone to do anything.

That's why one of the main things and proposals in alignment is let's build an AI first and tell that AI to stop any other AI from achieving sentience.

It's what's known as a pivotal action.

And that's the best of a lot of bad things.

My thing is let's build national data sets.

Let's represent diversity of humanity.

Let's give the AI the right food so it's raised in the right way.