Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Casey Newton

๐Ÿ‘ค Speaker
584 total appearances

Appearances Over Time

Podcast Appearances

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And I thought, well, let me see if I have any tools at my disposal that I can use.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And so I know that a lot of the AI image generators embed these digital watermarks in the image that are designed to be useful in exactly cases like this.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

So I took the photo that he had sent me of his badge and I put it into ChatGPT and I said, does this raise any red flags for you?

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

The answer I got was no.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And then put it into Google Gemini, which came back and said,

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

this image was generated in whole or part with Gemini.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

Gemini has what they call a synth ID, which is a watermark that's embedded in the image.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And so all of a sudden, I had something that looked pretty much like a smoking gun that I was being hoaxed.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

It did.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And I do think it is just something that good actors in this space should be doing because we want to have all the tools we can at our disposal to help us sort through things like this.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

Well, one reason why I was initially inclined to believe this source was that in the past, it would have taken a monumental effort to generate 18 pages and a fake employee badge, right?

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

In fact, after I published my story, I heard from a reporter at NBC News who had also been messaging with the same source.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And she shared her employee badge with me from NBC.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And it was almost identical to the one that he had shared with me.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

So we now believe that he had just taken her employee badge, which she had sort of shared with him as a kind of good faith effort to build trust, fed that into Gemini and said, turn this into an Uber Eats badge.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And within seconds, he had it.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

So it is just that easy.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

It did not used to be.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

And I think we as reporters and people who are consuming the news need to kind of catch up.

Marketplace All-in-One
Unraveling the complex knot of an AI-generated hoax

Yeah, completely.