Jason Calacanis

So if that's where the Pope is going with this, I very much agree with him.

Maybe where we end up in different places is he thinks that government regulation is the way to prevent this.

And I would just say that we have to be careful not to empower government too much.

Because if you give government the power to regulate or approve AI development,

If you create, say, an FDA for AI, as many people are calling on, that will give government the power to approve models and therefore give notes to model developers.

And very soon, this definition of safety

will expand because the government always takes an expansive view of its powers and we saw this during the social media wars where the definition of trust and safety expanded to issues like psychological safety microaggressions disinformation transphobia and so on that you know again these social media companies were told that they had to stamp out all of those threats to safety and it ended up becoming a censorship agenda

So I get very worried about what if some government agency can give notes to the model developers and they start telling the model developers that your definition of safety is not expansive enough.

You have to, again, protect the public from disinformation or psychological harms.

So again, I think we just have to be careful not to aggrandize government because that's going to be the most likely culprit in terms of the centralization of power.

And

I know the Vatican likes Latin.

This is a problem of political philosophy that goes all the way back to Socrates.

It's called quis custodiat ipsos custodes, which is who will guard the guardians.

In other words, if we entrust a set of guardians to protect us from a bunch of threats, what's to stop them

from becoming tyrannical and from becoming the new threat against us.

And I mean, this is the central dilemma of political power.

Who watches the watchers?

Yeah, who watches the watchers or who guards the guardians, meaning who's going to protect us against our guardians if they turn against us?

The genius of the American founding, by the way, is that it was a second order solution to this question.