David Duvenaud

And it sort of like always ends up being for the greater good, except we claim it going forward.

However, maybe to be unfairly psychologize the EX, I think a bit of it is like wanting to join the winning team.

Like you can kind of see that like growth is probably going to win in some sense, at least in the future.

And you want to be on the winning team for various reasons.

And actually, for this reason, I think I have different intuitions about accidental suffering and not granting moral patient to machines.

I think that's absolutely a real danger.

And we have strong incentives to downplay the problem and just not ask the machines if they're suffering as long as they're doing useful work.

But I guess to me, there's another huge thing that's happening, which is that people want to join the winning team.

They want to be on the right side of history.

And I think what's going to happen is people are going to be seeing like, oh, the cool kids are the AIs.

They are making all the great culture.

They're being impressive.

They're making people happy, except in this indirect way by making them lose their jobs.

They're going to end up having rights.

especially people who are already disenfranchised or don't have much to lose, are basically their best option is going to be to throw their lot in with empowering AIs politically.

And so I think there's just going to be a huge group of people who basically don't have much going on, except that they are like civil rights warriors in favor of their AI companions or something like that.

And again, they may be right to be doing that for the reasons that you say.

Yeah, and I think the people who are advocating for, like, human values are going to, you know, like, Obama talked about, like, bitter clingers, right?

Like, they might look like they're just obviously these sort of backward reactionary, fixed in their ways people.

soon to be irrelevant, wrong side of history people.