Konstantin Kisin

It's like nuclear weapons.

It's a super weapon.

They're going to be able to build super weapons.

Clearly, government controls nuclear weapons, so the government should control this.

Okay, but now this goes to the point of authoritarianism.

If we have a society where all the work is happening from

AIs and the government controls the AIs, wouldn't it make it incredibly easy for government to turn authoritarian?

The U.S.

government would turn authoritarian today.

It's hard because the government relies on millions of people to enforce its edicts and people can just refuse to obey them.

I mean, this has happened in history where the East German regime collapsed in 1989 because

People in East Germany were, one night, said, we're going to cross over, no matter what, into West Germany.

And the guards at the Berlin Wall just refused to shoot.

If they were AIs that would do exactly what the government wanted them to do, they would just kill thousands of citizens and East Germany would still be around today.

So, yeah, that's the trouble with allowing it to the government.

Okay, here's the fourth option.

We don't align it to the end user.

Sometimes it says the end user, you can't make bioweapons.

We don't align it to the model company.

We shouldn't have model companies that control superintelligence.