80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
So the best human teams get something like 40% on the eval, which is still lower than the state of the art from AI systems.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
It didn't persuade everyone, however, and what really worries me here is that I think it's partly that people just didn't know it happened.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
I still read, you know, in newspapers, in op-eds, and also meet people at conferences who are often experts in sort of maybe biosecurity in general or in security studies, but don't deeply follow the AI angle, who say, oh, but yeah, this tacit knowledge thing is just, you know, it's a huge barrier.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
We'll never overcome it.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And I say, oh, what about, you know, virology's capabilities test?
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Don't you think secure bio, you know, really provided evidence that sort of questions that?
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And they're like, oh, what's that?
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
I've never heard of it.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And that's my larger problem, that I think some of the best work is not being, I don't know, it's not getting around.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
It's not being disseminated.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
I don't want to blame anyone in particular.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
It's just unfortunate it's not happening.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And I worry that decision makers do not have necessarily all the sort of lines of evidence that they need to be able to make an informed decision.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And that this actually compounds where they will have expert advice that is misinformed because those experts actually aren't keeping track.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Yeah.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
We don't really know how much AI is uplifting beneficial life science.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
To my knowledge, there isn't sort of a deep, regular survey to understand how AI might be helping top scientists.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
I think this is a really important thing.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
It's important not just because it might proxy how AI could uplift malicious actors.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
It's important because genuinely we want to know how AI can uplift beneficial science to improve public health, to generate new drugs, to advance human progress.