Cal Newport

Companies must preemptively establish the safety of frontier models, which you would define probably in terms of parameter size, before public release.

In these reviews, the communication of the companies itself should be taken into account.

So if you have gone around and talked about how terrifying your model is, or if, like, Anthropic did a couple weeks ago, and I talked about it last week on the podcast, where they came out with a report that's like, guys, we're looking at our own cloud code, and, like, this thing is getting close to recursively improving itself.

We might lose control of it.

But don't worry.

We have a white paper in which we're going to walk through the possible future.

So we're thinking about it at least.

You don't get to write that article.

and then release a new version of your cloud code.

The government should be like, okay, you said this is a technology get out of control.

Just like if you were a virology lab, I think this is the apt comparison.

If you were a virology lab talking about your gain of function research, writing reports about this research we're doing,

could lead to out of control pandemics, and we're going to write reports that walk through the possible ways like society could crumble when these out of control pandemics come, the government would have every right to say, you have to stop doing the gain of function research then.

If you think this is a possibility, well, you got to stop right away.

All right.

So I think you should have to put frontier models up for review.

How you talk about them is included in that review.

The government should have the ability to also retroactively go back and say this model we previously approved.

We are now seeing signs that is causing grave safety concerns and we can revoke its license.

safety is actually going to have to matter.