Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Ben Zhao

👤 Person
312 total appearances

Appearances Over Time

Podcast Appearances

Freakonomics Radio
619. How to Poison the A.I. Machine

Nightshade images tend to be much more potent than usual images, so that even when they've just seen a few hundred of them, they are willing to throw away everything that they've learned from the hundreds of thousands of other images of cows and declare that its understanding has now adapted to this new understanding, that in fact cows have a shiny bumper and four wheels.

Freakonomics Radio
619. How to Poison the A.I. Machine

Once that has happened, someone asking the model, give me a cow eating grass, the model might generate a car with a pile of hay on top.

Freakonomics Radio
619. How to Poison the A.I. Machine

Once that has happened, someone asking the model, give me a cow eating grass, the model might generate a car with a pile of hay on top.

Freakonomics Radio
619. How to Poison the A.I. Machine

Once that has happened, someone asking the model, give me a cow eating grass, the model might generate a car with a pile of hay on top.

Freakonomics Radio
619. How to Poison the A.I. Machine

There's a couple of parameters about intensity, how strongly you want to change the image. You set the parameters, you hit go, and out comes an image that may look a little bit different. Sometimes there are tiny little artifacts that if you blow it up, you'll see.

Freakonomics Radio
619. How to Poison the A.I. Machine

There's a couple of parameters about intensity, how strongly you want to change the image. You set the parameters, you hit go, and out comes an image that may look a little bit different. Sometimes there are tiny little artifacts that if you blow it up, you'll see.

Freakonomics Radio
619. How to Poison the A.I. Machine

There's a couple of parameters about intensity, how strongly you want to change the image. You set the parameters, you hit go, and out comes an image that may look a little bit different. Sometimes there are tiny little artifacts that if you blow it up, you'll see.

Freakonomics Radio
619. How to Poison the A.I. Machine

But in general, it basically looks like your old image, except with these tiny little tweaks everywhere in such a way that the AI model, when it sees it, will see something entirely different.

Freakonomics Radio
619. How to Poison the A.I. Machine

But in general, it basically looks like your old image, except with these tiny little tweaks everywhere in such a way that the AI model, when it sees it, will see something entirely different.

Freakonomics Radio
619. How to Poison the A.I. Machine

But in general, it basically looks like your old image, except with these tiny little tweaks everywhere in such a way that the AI model, when it sees it, will see something entirely different.

Freakonomics Radio
619. How to Poison the A.I. Machine

The concept of poisoning is that you are trying to convince the model that's training on these images that something looks like something else entirely, right? So we're trying to, for example, to convince a particular model that a cow has four tires and a bumper. But in order for that to happen, you need numbers. You don't need millions of images to convince it, but you need a few hundred.

Freakonomics Radio
619. How to Poison the A.I. Machine

The concept of poisoning is that you are trying to convince the model that's training on these images that something looks like something else entirely, right? So we're trying to, for example, to convince a particular model that a cow has four tires and a bumper. But in order for that to happen, you need numbers. You don't need millions of images to convince it, but you need a few hundred.

Freakonomics Radio
619. How to Poison the A.I. Machine

The concept of poisoning is that you are trying to convince the model that's training on these images that something looks like something else entirely, right? So we're trying to, for example, to convince a particular model that a cow has four tires and a bumper. But in order for that to happen, you need numbers. You don't need millions of images to convince it, but you need a few hundred.

Freakonomics Radio
619. How to Poison the A.I. Machine

And of course, the more, the merrier. And so you want everybody who uses nightshade around the world, whether they're photographers or illustration or graphic artists, you want them all to have the same effect.

Freakonomics Radio
619. How to Poison the A.I. Machine

And of course, the more, the merrier. And so you want everybody who uses nightshade around the world, whether they're photographers or illustration or graphic artists, you want them all to have the same effect.

Freakonomics Radio
619. How to Poison the A.I. Machine

And of course, the more, the merrier. And so you want everybody who uses nightshade around the world, whether they're photographers or illustration or graphic artists, you want them all to have the same effect.

Freakonomics Radio
619. How to Poison the A.I. Machine

So whenever someone paints a picture of a cow, takes a photo of a cow, draws an illustration of a cow, draws a clip art of a cow, you want all those nice shaded effects to be consistent in their target. In order to do that, we have to take control of what the target actually is ourselves inside the software.

Freakonomics Radio
619. How to Poison the A.I. Machine

So whenever someone paints a picture of a cow, takes a photo of a cow, draws an illustration of a cow, draws a clip art of a cow, you want all those nice shaded effects to be consistent in their target. In order to do that, we have to take control of what the target actually is ourselves inside the software.

Freakonomics Radio
619. How to Poison the A.I. Machine

So whenever someone paints a picture of a cow, takes a photo of a cow, draws an illustration of a cow, draws a clip art of a cow, you want all those nice shaded effects to be consistent in their target. In order to do that, we have to take control of what the target actually is ourselves inside the software.

Freakonomics Radio
619. How to Poison the A.I. Machine

If you gave users that level of control, then chances are people would choose very different things. Some people might say, I want my cow to be a cat. I want my cow to be the sun rising. If you were to do that, the poison would not be as strong.