80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Okay, right.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
You think it's advancing.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
And then, of course, the dream, I guess, would be that you would just be able to type into text a function that you have in mind, and then you'd be able to spit out a sequence or a protein that would match that.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Or alternatively, you could go from a protein...
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
like the amino acid sequence, say, and it could just tell you in text what that protein would be good for and what it's likely good for.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
I don't know where we are there, but I think that is something that people are very much working on.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Okay, let's push on to the second half of the conversation.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
We're going to talk about what should be done, what useful stuff could be done to reduce these risks now or in coming years.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
You break the different possible responses that we could have into sort of three different categories.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
I'm sure there's many ways you could slice and dice them, but you've got a three-way breakdown.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Yeah, quickly explain those to us.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
So before we go into each of those three categories and what you might do within that, I kind of want to put a pessimistic case about all of this to you up front.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
So it seems like access controls, we're going to conclude, ultimately are not going to last.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
They're not going to protect us for a very long time because open source will ultimately allow bad actors to access pretty concerning stuff, regardless of any access controls that we try to put in place.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
So the guardrails, they might also help.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
They could, I guess, delay bad actors being able to use some of these capabilities.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
But again, they have a bunch of holes already and open source tools, once they're available, all the guardrails can basically be removed.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
They can.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
Then there's many different things in defense of acceleration.
80,000 Hours Podcast
AI designs genomes from scratch & outperforms virologists at lab work. What could go wrong? | Dr Richard Moulange, CLTR
There's a category like advancing other technologies that might make us safer.