Anthony Aguirre

So I think there are parts of AI that I think probably we do want light or zero regulation of, you know, if you're making an image recognition system, like you should just make it.

If you're building a smarter-than-human superintelligence, you should have the government looking over your shoulder as if you were making a nuclear weapon.

Basically.

Very.

I mean, there are a lot of great things about social media, but the idea that right now, almost everything we consume as information about the world is being chosen for us by an algorithm that we don't control and don't even understand how it operates and is optimizing something beyond

that is not in our best interest necessarily, that's crazy.

We should not have let that system come into being.

We are currently sort of seeing a large-scale AI that is controlling us rather than being controlled by us as humanity.

It's being controlled at some level by a couple of companies, but their alignment with the rest of humanity is not so clear.

Well, I don't think it's so much who's in charge of the company so much as, like, what... That there is no... There's nothing other than what the companies are trying to optimize.

Like...

If your company and your opponent or one of your competitors is optimizing user growth or revenue growth or something, and you're optimizing those plus a bunch of let's be good about this thing or let's take care of people or whatever, you're going to competitively lose.

You're putting more constraints on.

Those constraints have to come from the outside.

They have to come from some sort of agreement that those things are important and we're going to require them of companies.

Otherwise, you just get a race to the bottom.

And I think social media has been in a race to the bottom and we're stuck at the bottom.

Absolutely not.

So but I think the first thing to do is decide that you want to do something.

Right.