Dwarkesh Patel

I do think there's potential worlds with future humans that we would be quite concerned about.

That's what you're saying?

Something like that.

I'm basically taking the example you're giving of like, okay, even if you consider them part of humanity, I don't think that necessarily means that we should feel super comfortable.

Yeah.

Like Nazis were humans, right?

If we thought like, oh, the future generation will be Nazis, I think we'd be quite concerned about just handing off humanity.

power to them.

So I agree that this is not super dissimilar to worrying about more capable future humans.

But I don't think that that addresses a lot of the concerns people might have about this level of power being attained this fast with entities we don't fully understand.

Yeah, I guess there's different varieties of change.

The Industrial Revolution was change.

The Bolshevik Revolution was also change.

And if you were around in Russia in the 1900s and you're like, look, things aren't growing well.

The czar is kind of messing things up.

We need change.

I'd want to know what kind of change you wanted before signing on the dotted line, right?

And then similar with AI, where I'd want to understand, and to the extent it's possible to change the trajectory, to change the trajectory of AI such that the change is positive for humans.

Yeah, maybe a good analogy here would be, okay, so suppose you're raising your own children.

It might not be appropriate to have extremely tight goals for their own life or also have some sense of like, I want my children to go out there in the world and have this specific impact.