Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

David Duvenaud

๐Ÿ‘ค Speaker
1059 total appearances

Appearances Over Time

Podcast Appearances

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And, you know, we've made our peace with kind of opting out of the economy, but we have our like little sort of commune or whatever that we're happy to live in, in like unimaginable luxury and wealth in some senses.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And the government or the rest of the economy or something starts to view this as sort of like criminally decadent, that this small group of like humans, like maybe 10 or 100, are using this entire acre of land and like this amount of energy and sunshine to keep like this sort of these small brains working for no particular benefit but their own.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

when the same resources could be used to simulate maybe like millions of much more sympathetic sort of morally superior on whatever axis like virtual beings.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And so it'll start to be seen as this like selfish, as you say, like high opportunity costs, sort of irresponsible use of resources to keep like some sort of like legacy human around.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

Yeah.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

So first of all, I want to say this isn't exactly exotic.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

So maybe when we think about land taxes today, often people say land taxes are good or property taxes are good because they force, for instance, like old people who have like bigger houses than they need because their family has moved out to move into smaller houses to make room for new human families.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

So this dynamic of...

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

like take the old people's stuff because they don't need it, then we can we can house like more productive, sort of more maybe more deserving people to use the same resources is something that we already do today.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And so they're just like having property taxes or land taxes is one way that we end up losing our wealth and being forced to like upload or something.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

The second question though of like, why haven't we been grandfathered in and made some deal?

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

It's like, well, who are we making this deal with?

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

So if there is some sort of like global entity that can make promises on behalf of everybody,

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

then maybe this is plausible.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

It's kind of like if you're, I don't know, like a monkey living in a jungle next to a city, you're kind of worried the city's growing.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And if there's like some unified government, then they might be able to say like, hey, our value system is such that we want to keep the monkeys alive.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And so we're going to like have a protected forest.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

Um, if there's no such like unified polity or whatever, and it's just like a piecemeal growth thing, then you do expect that at some point there's somebody living right next to your land and then they have more kids and they want to expand onto your land.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And so that particular person actually does have a big incentive to, you know, take your last bit of land or something like that.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

So in a sense, this makes me think that the only stable good outcomes involve some sort of like strong global coordination, which is also very scary because, you know, if you get global coordination wrong, then you end up locked into bad scenarios as well.