Ben Zhao
👤 PersonAppearances Over Time
Podcast Appearances
Nightshade images tend to be much more potent than usual images, so that even when they've just seen a few hundred of them, they are willing to throw away everything that they've learned from the hundreds of thousands of other images of cows and declare that its understanding has now adapted to this new understanding, that in fact cows have a shiny bumper and four wheels.
Once that has happened, someone asking the model, give me a cow eating grass, the model might generate a car with a pile of hay on top.
Once that has happened, someone asking the model, give me a cow eating grass, the model might generate a car with a pile of hay on top.
Once that has happened, someone asking the model, give me a cow eating grass, the model might generate a car with a pile of hay on top.
There's a couple of parameters about intensity, how strongly you want to change the image. You set the parameters, you hit go, and out comes an image that may look a little bit different. Sometimes there are tiny little artifacts that if you blow it up, you'll see.
There's a couple of parameters about intensity, how strongly you want to change the image. You set the parameters, you hit go, and out comes an image that may look a little bit different. Sometimes there are tiny little artifacts that if you blow it up, you'll see.
There's a couple of parameters about intensity, how strongly you want to change the image. You set the parameters, you hit go, and out comes an image that may look a little bit different. Sometimes there are tiny little artifacts that if you blow it up, you'll see.
But in general, it basically looks like your old image, except with these tiny little tweaks everywhere in such a way that the AI model, when it sees it, will see something entirely different.
But in general, it basically looks like your old image, except with these tiny little tweaks everywhere in such a way that the AI model, when it sees it, will see something entirely different.
But in general, it basically looks like your old image, except with these tiny little tweaks everywhere in such a way that the AI model, when it sees it, will see something entirely different.
The concept of poisoning is that you are trying to convince the model that's training on these images that something looks like something else entirely, right? So we're trying to, for example, to convince a particular model that a cow has four tires and a bumper. But in order for that to happen, you need numbers. You don't need millions of images to convince it, but you need a few hundred.
The concept of poisoning is that you are trying to convince the model that's training on these images that something looks like something else entirely, right? So we're trying to, for example, to convince a particular model that a cow has four tires and a bumper. But in order for that to happen, you need numbers. You don't need millions of images to convince it, but you need a few hundred.
The concept of poisoning is that you are trying to convince the model that's training on these images that something looks like something else entirely, right? So we're trying to, for example, to convince a particular model that a cow has four tires and a bumper. But in order for that to happen, you need numbers. You don't need millions of images to convince it, but you need a few hundred.
And of course, the more, the merrier. And so you want everybody who uses nightshade around the world, whether they're photographers or illustration or graphic artists, you want them all to have the same effect.
And of course, the more, the merrier. And so you want everybody who uses nightshade around the world, whether they're photographers or illustration or graphic artists, you want them all to have the same effect.
And of course, the more, the merrier. And so you want everybody who uses nightshade around the world, whether they're photographers or illustration or graphic artists, you want them all to have the same effect.
So whenever someone paints a picture of a cow, takes a photo of a cow, draws an illustration of a cow, draws a clip art of a cow, you want all those nice shaded effects to be consistent in their target. In order to do that, we have to take control of what the target actually is ourselves inside the software.
So whenever someone paints a picture of a cow, takes a photo of a cow, draws an illustration of a cow, draws a clip art of a cow, you want all those nice shaded effects to be consistent in their target. In order to do that, we have to take control of what the target actually is ourselves inside the software.
So whenever someone paints a picture of a cow, takes a photo of a cow, draws an illustration of a cow, draws a clip art of a cow, you want all those nice shaded effects to be consistent in their target. In order to do that, we have to take control of what the target actually is ourselves inside the software.
If you gave users that level of control, then chances are people would choose very different things. Some people might say, I want my cow to be a cat. I want my cow to be the sun rising. If you were to do that, the poison would not be as strong.