Arvind Narayanan

It's not just that, that you can't even prevent these models getting even better in the future unless, again, you have this authoritarian world government that stops even small teams of developers from acquiring consumer-grade hardware and doing research to improve the efficiency of those models and their capability.

For sure, yes.

And I think the AI safety and security institutes have been a wonderful thing.

I've strongly supported the work that they do.

No question on that.

And yes, I think transparency and knowledge are the most important thing for now, but I do think there is a lot more that can be done, that should be done.

One big area is developing AI for defense.

against these very risks that people are worried about.

And historically, this is always how it has worked.

We're acting as if AI is a new thing, but AI has been gradually improving out of the public eye, admittedly, for decades now.

And the reason that things have worked out is because of the attacker-defender balance.

and the efforts that we've taken to shift that balance in a healthy direction.

So when it comes to cybersecurity, for instance, automated tools have been in many ways superhuman at hacking for decades now.

and yet the world hasn't ended.

In fact, things have gotten a lot better, and that's because companies who are developing software use these very same automated tools to find and fix bugs before they put software out there, before attackers have a chance to take a crack at them.

And that's the critical thing.

When these AI models are now becoming even better at automatically finding vulnerabilities, do we have the right incentives in place to ensure that software developers, as well as mom and pop businesses who might be deploying software,

have the know-how, have the funding to use this to protect their cybersecurity.

Those kinds of things can benefit from government incentives and can be enormously beneficial.

I am not saying that we're in a good place right now with regard to regulation, both with regard to safety regulation in the sense of these catastrophic risks, as well as the kinds of safety issues we've already seen on a massive scale, some of the psychological issues that we've talked about, the use of AI models for making non-consensual nudes,