Boris Cherny
speaker
396 appearances
1 recordings
1 series
first heard Jul 2026
last heard 28 Jul
Boris Cherny’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
Because if the model reads some instruction on the internet that's like, do X and Y and Z and also delete everything on the user's computer, a year ago the model would have just done it.
But nowadays Opus does not.
And this has actually been the case since Opus 4.7, 4.8.
Sonnet 5 has been quite good at this, Fable was quite good at it.
But Opus 5 just hits like a new frontier on this.
So essentially if you combine a well-aligned model, so this is like essentially three years of research into alignment, with a prompt injection classifier, which we run for all traffic, and what this is doing is it's based on Crisola's mechanistic interpretability work.
where it's literally, we're looking at neurons in the model's brain that light up when prompt injection happens.
So the model won't even tell you, but we can actually see those neurons and we can figure out and diagnose that it's happening.
And then you combine that with the auto mode classifier.
And with these three layers,
we just cannot demonstrate prompt injection anymore.
And we've hired security researchers, we've done red teaming, we've done competitions, no one can demonstrate it.
And so I'm actually quite curious if people are able to.
And that'll actually be a really amazing signal for the research team.
I think something that a lot of people might not realize is Cloud Code as a product and as a harness is just always changing.
We're always adding stuff, we're always deleting stuff.
Every time that a new model comes out, we delete a bunch of the system prompt, change a bunch of the system prompt, we change the set of tools all the time, we change the prompts for the tools all the time.
And the reason is every model is very different.
So something that you did for one model maybe three months ago, it just might not translate at all to the next model.
And so one thing about Opus 5 is it's just really intelligent.
Showing 21–40 of 396 · page 2 of 20
← Previous
Next →