Emad Mostaque

It's just like, well, this is a logical step to take.

Yep.

Does it cover everything?

This is a question, right?

And how do you embed it into a system that's likely to be not just one file?

It's not a program, right?

It's likely to be a million different files.

It's likely to be a collective hive mind intelligence.

We don't exactly know how this emerges.

And we don't know how to hard core things.

Yeah, well, there's a thing.

It's going to become complex by default because the AI will proliferate and they'll start talking to each other.

Okay.

At the same time, you'll have bigger and bigger giant AIs.

Like I was talking to some people last week and they're like, right now the maximum training run for an AI costs $100 million.

They're talking about a billion dollars or $10 billion to train even bigger models right now.

We don't know what emergent behaviors or how those things will act.

All we know is like, what if you tell it to make a stock snap to take down the global electricity grid?

It can probably do that.

And again, the range of potential bad outcomes from a sub superhuman AI, it's difficult for us to comprehend.