Max Spero
speaker
224 appearances
1 recordings
1 series
first heard Jul 2026
last heard 16 Jul
Max Spero’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
like do a pretty good job at clustering text from different models separately.
Yeah.
So a lot of the early AI detectors, certainly we were not anywhere close to the first, but a lot of the early ones relied on research which said that
There's this metric called perplexity, which might be a good method for detecting AI text.
This is a measure of how surprising a piece of text is to a language model.
So if you take the sentence like, the boy ate a bowl of soup, that's pretty low perplexity.
Every...
word is expected.
Whereas if you have a sentence, the boy ate a bowl of spiders, spiders would be a high perplexity word because that's not expected, right?
So if you look at the way
AI language models are trained, they're trained to produce low-perplexity, unsurprising sentences.
Because if it's surprising, it's more likely that it's wrong.
So you can build an AI detector that measures perplexity of a text and says, if it's low-perplexity, it's AI, and if it's high-perplexity, it's human, because humans write in a more surprising way.
way this breaks down however in a couple of cases so any text that is memorized by the ai is going to be low perplexity for example like the declaration of independence so if you're wondering why like you put the declaration of independence into some random ai detector and it says it's ai that's why it's because it's low perplexity the ai model has memorized it the other issue with it
is English language learners also write in simple language, which is low perplexity, which then gets flagged as AI by these detectors.
So that's sort of the problem with these early detectors.
And the problem with perplexity in general is it's not really a metric that can be improved upon.
Like, it just is what it is.
It's like measuring, I don't know, like, the density of a liquid.
Like, it is just a single metric.
Showing 61–80 of 224 · page 4 of 12
← Previous
Next →