Emad Mostaque

They're talking about a billion dollars or $10 billion to train even bigger models right now.

We don't know what emergent behaviors or how those things will act.

All we know is like, what if you tell it to make a stock snap to take down the global electricity grid?

It can probably do that.

And again, the range of potential bad outcomes from a sub superhuman AI, it's difficult for us to comprehend.

Yeah.

And it made them centrifuges spin around.

So they exploded.

Well, yeah, I mean, look, this is the thing like Elon Musk has just launched XAI as we kind of export AI as we kind of speak this.

And his thing is to create an AI that searches for truth.

So he wants to give it impulse, which is to search for the meaning of the universe and truth and other things like that.

then someone else might not give in an impulse and you might have someone downloading the weights of gpt4 or five so this is a tragedy of the commons thing on a usb stick and then they're like i want to take down america and they'll be like let's take a thousand gpt4s and tell it build stuxnets to take down america it's not intelligent yet it's still dangerous we don't know when this thing will become actually intelligent or self-aware or if it may never become

But we can see the probability of outcomes here.

It could be absolutely fine.

It could be very bad.

There are no standards.

So what you suggested, it could work.

Only if everyone does it.

We're never going to get anyone to do anything.

That's why one of the main things and proposals in alignment is let's build an AI first and tell that AI to stop any other AI from achieving sentience.