Mark Zuckerberg

So do you want to make it so that the system needs to be 99% sure that someone is dealing drugs before taking them down? Do you want it to be 90% confident, 80% confident? And then those correspond to amounts of... I guess the statistics term would be recall. What percent of the bad stuff are you finding?

So do you want to make it so that the system needs to be 99% sure that someone is dealing drugs before taking them down? Do you want it to be 90% confident, 80% confident? And then those correspond to amounts of... I guess the statistics term would be recall. What percent of the bad stuff are you finding?

So do you want to make it so that the system needs to be 99% sure that someone is dealing drugs before taking them down? Do you want it to be 90% confident, 80% confident? And then those correspond to amounts of... I guess the statistics term would be recall. What percent of the bad stuff are you finding?

So if you require 99% confidence, then maybe you only actually end up taking down 20% of the bad content. Whereas if you reduce it and you say, okay, we're only going to require 90% confidence. Now maybe you can take down 60% of the bad content. But let's say you say, no, we really need to find everyone who is doing this bad thing. And it doesn't need to be as severe as dealing drugs.

So if you require 99% confidence, then maybe you only actually end up taking down 20% of the bad content. Whereas if you reduce it and you say, okay, we're only going to require 90% confidence. Now maybe you can take down 60% of the bad content. But let's say you say, no, we really need to find everyone who is doing this bad thing. And it doesn't need to be as severe as dealing drugs.

So if you require 99% confidence, then maybe you only actually end up taking down 20% of the bad content. Whereas if you reduce it and you say, okay, we're only going to require 90% confidence. Now maybe you can take down 60% of the bad content. But let's say you say, no, we really need to find everyone who is doing this bad thing. And it doesn't need to be as severe as dealing drugs.

It could just be – I mean it could be any kind of content of – any kind of category of harmful content. You start getting to some of these classifiers might have 80%, 85% precision in order to get 90% of the bad stuff down. But the problem is if you're at 90% precision, that means one out of 10 things that the classifier takes down is not actually problematic.

It could just be – I mean it could be any kind of content of – any kind of category of harmful content. You start getting to some of these classifiers might have 80%, 85% precision in order to get 90% of the bad stuff down. But the problem is if you're at 90% precision, that means one out of 10 things that the classifier takes down is not actually problematic.

It could just be – I mean it could be any kind of content of – any kind of category of harmful content. You start getting to some of these classifiers might have 80%, 85% precision in order to get 90% of the bad stuff down. But the problem is if you're at 90% precision, that means one out of 10 things that the classifier takes down is not actually problematic.

And if you kind of multiply that across the billions of people who use our services every day, that is... millions and millions of posts that are basically being taken down that are innocent.

And if you kind of multiply that across the billions of people who use our services every day, that is... millions and millions of posts that are basically being taken down that are innocent.

And if you kind of multiply that across the billions of people who use our services every day, that is... millions and millions of posts that are basically being taken down that are innocent.

And upon review, we're going to look at and be like, this is ridiculous that this thing got taken down, which I mean, I think you've had that experience and we've talked about this for a bunch of stuff over time. But it really just comes down to this question of where do you want to set the classifiers? So one of the things that we're going to do

And upon review, we're going to look at and be like, this is ridiculous that this thing got taken down, which I mean, I think you've had that experience and we've talked about this for a bunch of stuff over time. But it really just comes down to this question of where do you want to set the classifiers? So one of the things that we're going to do

And upon review, we're going to look at and be like, this is ridiculous that this thing got taken down, which I mean, I think you've had that experience and we've talked about this for a bunch of stuff over time. But it really just comes down to this question of where do you want to set the classifiers? So one of the things that we're going to do

is basically set them to require more confidence, which is this trade-off. It's going to mean that we will maybe take down a smaller amount of the harmful content, but it will also mean that we'll dramatically reduce the amount of people whose accounts we're taking off. for a mistake, which is just a terrible experience, right?

is basically set them to require more confidence, which is this trade-off. It's going to mean that we will maybe take down a smaller amount of the harmful content, but it will also mean that we'll dramatically reduce the amount of people whose accounts we're taking off. for a mistake, which is just a terrible experience, right?

is basically set them to require more confidence, which is this trade-off. It's going to mean that we will maybe take down a smaller amount of the harmful content, but it will also mean that we'll dramatically reduce the amount of people whose accounts we're taking off. for a mistake, which is just a terrible experience, right?

It's like, okay, you're going about your day and then one day you wake up and you're like, oh, my WhatsApp account just got deactivated because it's connected to a Facebook account and the Facebook account is, or like I'm using it on the same phone as a Facebook account where like we made some enforcement mistake and thought you were doing something bad that you weren't because our classifiers were set to too low of precision.

It's like, okay, you're going about your day and then one day you wake up and you're like, oh, my WhatsApp account just got deactivated because it's connected to a Facebook account and the Facebook account is, or like I'm using it on the same phone as a Facebook account where like we made some enforcement mistake and thought you were doing something bad that you weren't because our classifiers were set to too low of precision.