80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Yeah.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
It is worth having some people thinking about stuff more than 10 years out, given how impactful some of these changes could be.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Exactly, exactly.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Yeah, how can, I guess, people who do want to, maybe they think you've said the wrong thing, but they want to say the right thing.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
How can they go and, I guess, get involved in this debate?
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Yeah.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
If I imagine someone who would say that this isn't really useful work, I could imagine them responding that there's so many things going on.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Like, this is the most difficult sort of futurism, the most difficult social science you could imagine.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Because you imagine, like, many fundamental assumptions about the world have changed.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
We're not, like, sure which ones are going to change and when they're going to change.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And then we have to, like, we can barely even understand that what exists now.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
We don't even know, like, necessarily why do we have the government structures that we do now, let alone what would they be in future in some different condition.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Yeah, Carl Schulman proposed this on the show a year and a half ago or something like that, I think.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
So I'm so glad to see that it's actually going ahead.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Because it's very difficult to avoid data poisoning, right?
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
You're saying, well, we want to train like ChatGPT 1950 that only has access to any text that came up until 1950.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Well, one challenge is there might not be enough text.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
It might not be a very smart model.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
I guess another thing is how do you avoid any knowledge about events that happen later kind of sneaking back into the text unrecognized?
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Yeah, it's a bit of a clue about how the future might have gone.