Max Tegmark

So we're getting the situation where the first kind of non, so I define artificial intelligence just as non-biological intelligence.

And by that definition, a company, a corporation is also an artificial intelligence because the corporation isn't, it's humans, it's a system.

If its CEO decides, the CEO of a tobacco company decides one morning, the CEO, he doesn't want to sell cigarettes anymore.

They'll just put another CEO in there.

it's not enough to align the incentives of individual people or align individual computers incentives to their owners, which is what technically AI safety research is about.

You also have to align the incentives of corporations

with a greater good.

And some corporations have gotten so big and so powerful very quickly that in many cases, their lobbyists instead align the regulators to what they want rather than the other way around.

It's a classic regulatory capture.

I think both, but I think that the vision, the path to success I see is first you give a breather actually to the people in these companies, their leadership who wants to do the right thing and they all have safety teams and so on on their companies.

Give them a chance to get together with the other companies and the outside pressure can also help catalyze that, right?

And work out what is it that's,

What are the reasonable safety requirements one should put on future systems before they get rolled out?

There are a lot of people also in academia and elsewhere outside of these companies who can be brought into this and have a lot of very good ideas.

And then I think it's very realistic that within six months,

you can get these people coming up.

So here's a white paper.

Here's what we all think is reasonable.

You know, you didn't, just because cars killed a lot of people, you didn't ban cars, but they got together a bunch of people and decided, you know, in order to be allowed to sell a car, it has to have a seatbelt in it.

There are the analogous things that you can start requiring a future AI systems so that they are safe.