Jason Calacanis

So you need a producer of the show to do that.

This is why people think, oh, is this going to wipe out all the jobs?

No, someone still has to supervise, iterate, validate, you know, all those kinds of things.

Well, I very much agree with the Pope that the biggest risk of AI is a centralization of power and then its misuse against us in some Orwellian way.

I think it's government that's going to do that, not necessarily an individual actor because it's governments that ultimately have the power.

So I do worry about the potential for AI to be used to surveil us, censor us, control us.

as Orwell described in 1984.

So if that's where the Pope is going with this, I very much agree with him.

Maybe where we end up in different places is he thinks that government regulation is the way to prevent this.

And I would just say that we have to be careful not to empower government too much.

Because if you give government the power to regulate or approve AI development,

If you create, say, an FDA for AI, as many people are calling on, that will give government the power to approve models and therefore give notes to model developers.

And very soon, this definition of safety

will expand because the government always takes an expansive view of its powers and we saw this during the social media wars where the definition of trust and safety expanded to issues like psychological safety microaggressions disinformation transphobia and so on that you know again these social media companies were told that they had to stamp out all of those threats to safety and it ended up becoming a censorship agenda

So I get very worried about what if some government agency can give notes to the model developers and they start telling the model developers that your definition of safety is not expansive enough.

You have to, again, protect the public from disinformation or psychological harms.

So again, I think we just have to be careful not to aggrandize government because that's going to be the most likely culprit in terms of the centralization of power.

And

I know the Vatican likes Latin.

This is a problem of political philosophy that goes all the way back to Socrates.