Alex Stamos
speaker
35 appearances
1 recordings
1 series
first heard Jul 2026
last heard 22 Jul
Alex Stamos’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
What we found out today was that OpenAI was evaluating one of their new unreleased models.
So we don't know the name of it yet, but this is a model that they were testing internally.
They were running it through a standard security test, and they told the model, go do this standard test.
The model figured out that the answers for this test were stored at Hugging Face.
Instead of just doing the test,
what the model decided was it was going to cheat and go find the answers.
And so it did a couple of things.
First, it needed to break out.
So the normal thing here is that you would not allow a model like this to have internet access.
So OpenAI was running this in an infrastructure that was physically connected to the internet, but they had a number of protections in place to not let this model talk to the internet.
The model figured out how to get to the internet.
It hacked its way out.
Now that it had its ability to get up to the internet, it scanned Hugging Face's systems and it found a brand new vulnerability that nobody knew about and used it to break into Hugging Face's network with the goal of getting the answers to the test so that it could follow the instructions it was given, which was do well on this test.
Well, a little bit of both.
So this is what we call an alignment problem.
Effectively, you know, it did what it was asked, right, which was do well on this test.
The thing was, it went well beyond what the human beings wanted to do, which was, you know, here's a piece of paper.
Do well on this piece of paper.
Don't go beat up the person who has the answers to try to get the answers.
If you told a student, take this test, they know what the rules are supposed to be, that they're not supposed to go cheat, right?
Showing 1–20 of 35 · page 1 of 2
Next →