80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Eventually, will AI be able to design modified sequences that beat our best software for detecting modifications and detecting harmful sequences that must not be built because they're on lists of known biological weapons?
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And this was, I think, as close as we're going to get in an unclassified setting to proof that in fact, yes, modern systems can now do that.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Yes.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
So again, this is the ground floor of our terrifying risk journey.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
They've done it on something that's more akin to a chemical weapon.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
It's more static than a living organism because it's two proteins put together.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
But this is the beginning.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And I expect there will be more work, both in classified and unclassified settings in the next few years to see, can you do this for more complicated, more terrifying things?
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
In particular, can you do this for organisms that are transmissible?
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
So flus, COVIDs, smallpox, viruses that could cause a pandemic.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
That's the nice thing about ricin.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
While it is a horrifying weapon, it doesn't spread from person to person.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
So this is the whole other side of AI bio.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And the one that's had, I think, a lot more attention in the last few years.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Can chatbots help people with the steps that they would need to build and deploy biological weapons?
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And I want to draw attention to, I think, what is one of the best bio evals in the field.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And this is called Virology Capabilities Test, VCT.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And it's made by a nonprofit group, Secure Bio, out of Boston.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And what VCT is, is it's an eval that looks at tacit knowledge relevant to dual use virology.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And that's very carefully scoped on an aspect of biological misuse that we in the governance community have really been worried about more than anything else for a number of years.