Tristan Harris

So what are the ways that our human systems, our FDA approval processes or intellectual property laws or grant making or funding that are getting in the way of treating disease that superintelligence won't be able to get around?

Because FDA processes take billions of dollars to make it through phase one, phase two, phase three, just for people to track that.

I mean, this aligns with something Aza and I have said that it's really AI just forcing us to confront the ways that our systems have not been aligned for this.

You know, people talk about aligning AI systems.

But can you have aligned AI inside of a misaligned system?

Can you have advancements in biology inside of a system that has, for many different reasons, corruption and incentives and revolving doors and poor FDA regulatory approval processes?

Because as you said, we're about to get an explosion of new molecules and new drugs.

But if we don't have a process that can deal with it, we're also about to flood that system and then jam up the gears because now there's so much more trying to make it through a system that also wasn't terribly working perfectly well at the beginning.

Right.

Just to link it back to CHT's frames, we always reference Charlie Munger.

If you show me the incentive, I'll show you the outcome.

And while humans wield technology, incentives wield humans.

And I see your core warning is that if you deploy AI optimization into a system without fixing the incentives of that system, you're just going to supercharge the misalignments of that system.

And to give like examples of this, like insurers optimize for denying claims, right?

They make money when they don't pay out.

And so they always find a way to sort of make it difficult in subtle, subtle ways to just like have you settle for half the amount of your insurance claim and just like not have to fight back the itemized list.

You know, United Healthcare deployed an AI system to process claims that was reportedly denying them at a massive elevated rate because of the AI system.

This is somewhat what you're talking about.

You know, hospitals optimize for volume, not for outcomes.

You know, under a fee-for-service model, hospitals and doctors get paid for delivering more care, not better care.