Boris Cherny
speaker
396 appearances
1 recordings
1 series
first heard Jul 2026
last heard 28 Jul
Boris Cherny’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
So you really want to make sure that the model needs this instruction.
I think this is sort of the crazy thing about building on models.
It's just so different than all the engineering that I've ever done.
Like in the past, when you build on systems, you build these like big, beautiful systems and you really think about the system design up front.
You have like a big suite of unit tests.
You think about everything and you know, like a re-architecture is a big project.
Sometimes it takes months.
I've worked on re-architecture products at big companies that take years.
And the model is not like that.
The way to think about it is almost like a living creature, like as something more organic.
It's a thing where every model generation, it behaves differently.
It has a slightly different personality.
And you have to take the time to get to know it and then adjust the harness based on that.
And I think it's just very much like an empirical and kind of scientific thing.
You have to take a very scientific mindset to it where you try something, you see the result, and then you iterate based on that.
We do until we max out the eval.
Yeah, you keep appending.
What happens is, you know, I actually wouldn't even go this far, to be honest.
I think evals, they outlive the harness a little bit, but not by that much.
Like an eval might live for maybe one, two, three model generations.
Showing 81–100 of 396 · page 5 of 20
← Previous
Next →