Konstantin Kisin

But the reason I think this values framework has, I like it, or I think it could be done well, is fundamentally,

Again, we are building more people.

These are just going to be the future people.

And I think civilization would run better if civilization is full of virtuous people who will... I'm not saying they have to be like monks who will... But it's better to have better people than worse people.

Have better values than worse values.

I think one of the reasons some certain civilizations succeed and others don't is that there's better values in those civilizations.

And it certainly needs to, like, there's some system where, like, as our culture, there's something in our culture that has allowed us to improve our values.

And we need to make sure AI civilization and AI culture would have the same dynamic.

How that is happening in human civilization is unclear, much less clear how we make sure that AI civilization also has that dynamic.

But certainly the ability to improve the values is a huge, huge factor.

Sure, yeah.

And I think this goes to the point of like,

People say that it would be success simply to be able to build AI systems that at the technical level, it is possible for somebody to be able to say to the AI, do X, and the AI will do X, or the AI will care what it is.

If you have a really good employee,

you're not necessarily going to know enough to micromanage them, but they will care that you want a certain thing to happen and they will do their best to their ability to make that thing happen.

That's what will be in that relationship with AI.

If that alignment project succeeds, somebody will get to say that.

You're making the point, well, what if that somebody is the CCP?

So it's not enough that we just solve this technical problem, getting the AIs to do what we want.

It also has to be the case that we have some system of inscribing what we want that actually results in good things.