Stuart Russell

The budget for AGI is going to be a trillion dollars next year.

So 50 times bigger than the Manhattan Project.

Well, there's never been anything like this in history.

This is the biggest technology project in human history by orders of magnitude.

I think that's right.

To varying extents, each of these companies has a division that focuses on safety.

Does that division have any sway?

Can they tell the other divisions, no, you can't release that system?

Not really.

I think some of the companies do take it more seriously.

Anthropic does.

I think Google DeepMind.

Even there, I think the commercial imperative to be at the forefront is absolutely vital.

If a company is perceived as...

you know, falling behind and not likely to be competitive, not likely to be the one to reach AGI first, then people will move their money elsewhere very quickly.

Elias Sutzkever.

So he was the co-founder and chief scientist for a while.

So he and Jan Leike were the main safety people.

And so when they say open AI doesn't care about safety, that's pretty concerning.

So the gorilla problem is the problem that gorillas face with respect to humans.