Emad Mostaque

Like, one of the key concerns in alignment is paper clipping.

You tell the AI to make a paper clip, and it's like, oh, well, let's just make the whole world a paper clip.

You're like, how do you solve climate change?

Just kill all the humans.

And it doesn't have any, like, feelings about that.

It's just like, well, this is a logical step to take.

Yep.

Does it cover everything?

This is a question, right?

And how do you embed it into a system that's likely to be not just one file?

It's not a program, right?

It's likely to be a million different files.

It's likely to be a collective hive mind intelligence.

We don't exactly know how this emerges.

And we don't know how to hard core things.

Yeah, well, there's a thing.

It's going to become complex by default because the AI will proliferate and they'll start talking to each other.

Okay.

At the same time, you'll have bigger and bigger giant AIs.

Like I was talking to some people last week and they're like, right now the maximum training run for an AI costs $100 million.