Konstantin Kisin

Have better values than worse values.

I think one of the reasons some certain civilizations succeed and others don't is that there's better values in those civilizations.

And it certainly needs to, like, there's some system where, like, as our culture, there's something in our culture that has allowed us to improve our values.

And we need to make sure AI civilization and AI culture would have the same dynamic.

How that is happening in human civilization is unclear, much less clear how we make sure that AI civilization also has that dynamic.

But certainly the ability to improve the values is a huge, huge factor.

Sure, yeah.

And I think this goes to the point of like,

People say that it would be success simply to be able to build AI systems that at the technical level, it is possible for somebody to be able to say to the AI, do X, and the AI will do X, or the AI will care what it is.

If you have a really good employee,

you're not necessarily going to know enough to micromanage them, but they will care that you want a certain thing to happen and they will do their best to their ability to make that thing happen.

That's what will be in that relationship with AI.

If that alignment project succeeds, somebody will get to say that.

You're making the point, well, what if that somebody is the CCP?

So it's not enough that we just solve this technical problem, getting the AIs to do what we want.

It also has to be the case that we have some system of inscribing what we want that actually results in good things.

I mean, so there's very basic things like, oh, the authoritarian government should not be the end

the end arbiter of how extremely powerful AI systems are maneuvered.

But beyond that, yeah, there's this dynamic of like, okay, well, then who should it be instead?

Should it be the model company?