Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

David Duvenaud

๐Ÿ‘ค Speaker
1064 total appearances

Appearances Over Time

Podcast Appearances

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

Right, right.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

When we actually start to colonize the solar system or galaxies or something like that, there is going to be still a selection pressure for the fastest possible growth.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

But this happens to be wasteful in a way that, like, just because of the loss of thermodynamics, the slower you use the resources of, like, just, like, neg entropy and...

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

the sort of more compute you get, then the more control and presumably the more value you can get out of the universe.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

So that's pretty far out there, but one concrete way in which we can expect unfettered competition to destroy value.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

I think it's crazy.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And I think, you know, in some sense you could say humans are locusts and that, you know, there was various different human societies and the ones that were effective at, you know, spreading and settling and colonizing new areas did end up dominating in some sense that like the more sedentary ones didn't.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

So again, this is like a very simple natural selection story for how the locusts end up coming into being.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

Well, I guess I'll say I was drawing this picture before that there might be these two extremes.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

One is like total coordination and like hegemony and like this total totalitarian world government or this like unfettered competition.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

But empirically, if we look at history, it's been something in between.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

It's more chaotic where it's like empires rise and fall.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

It's kind of like lava lamp where like, you know, these things grow and then they become unstable.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And same just like ecologically where there's like all these different niches and there's no one.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

animal that's like competing all the other animals or coordinating amongst all its copies.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

There's like ant colonies, but then they only grow so large before then there's like like sort of traders within like even human cells have cancer.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And that's like a huge problem.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

And it's like one of the sort of major things that we pay like an internal alignment tax on to like have this immune system and like

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

these aging mechanisms that help police cancer.

80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

So it does seem like sort of natural equilibrium in at least a fixed domain is something in between total coordination and total chaos.