80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And the difficulty of predicting it is just going to be harder.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And I guess one thing to say is that some things are sort of like anti-inductive, like market prices.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And it's sort of a fool's errand to try to build this market predictor.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And the finance people are already incentivized to predict prices somewhat a ways out.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And then we might hope that there's some important aspects of future history that are not so anti-inductive and that are easier to get a handle on.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And I think this backtesting is going to at least help us calibrate which parts of the predictions should we be more confident in versus we think they're actually very hard to predict.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
yeah, it's going to help us act earlier and it's going to help us take costlier actions.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
So like, you know, again, like no one should take on my word for it, like do some really costly thing, especially if it involves again, attacking the liberalism, which is like the source of like the lifeblood of everything good right now.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And so if I was a politician though, that happened to feel like, um,
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
it was important to do some costly coordination.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
It's going to be much more feasible if I have this sort of neutral third party, these LLMs that everyone uses and agrees are the most sensible thing we have.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
It's like the LLMs say, if we don't coordinate, this bad thing's going to happen.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Email Alec, email me.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
It's one of these things where it's a very amateur hour sort of thing, and I think there should be a whole bunch of separate efforts here.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Maybe we can pool effort on the data cleaning, for instance.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Yeah, and then right now we're just doing everything with pretty small models just to get the flywheel going.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
Yeah, I guess I would say somebody who has time to be a real empire builder probably should take this over.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
And please, somebody who just finished, I don't know, sold their company, please make this the new public good that you're involved in.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
We would love help.
80,000 Hours Podcast
Why 'Aligned AI' Could Still Kill Democracy | David Duvenaud, ex-Anthropic team lead
It's only just a few people right now.