Boris Cherny
speaker
396 appearances
1 recordings
1 series
first heard Jul 2026
last heard 28 Jul
Boris Cherny’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
But nowadays, you know, we're on the exponential.
The model is improving so quickly.
Very often we just saturate the eval and then we have to throw it away and we have to come up with a new eval.
And this is just part of the process.
And again, it's about being empirical.
You have to use the product, you have to use the model, you have to see where it struggles, and then based on that, that's the evil side that you should build.
Yeah, so hobbling is this idea in research that the model is doing something and you're just getting in the way.
There's this kind of like way of thinking about it that I really like.
It's very useful when you're building product.
And it's called product overhang.
And the idea is the model is able to do all sorts of things with today's models, not a future model, but today's model, that we have not yet realized.
And there are so many capabilities the model has like this that people are not aware of.
And this is like the ability to maybe use a particular tool, use a particular language, solve a particular kind of problem, do things a particular kind of way that we thought was kind of beyond the model's capability.
And there's this overhang.
Because the model can do this at every given model generation.
But there is often not a product that lets the model do this.
And lets it express this kind of ability to do this.
And on the flip side, often what happens is the product gets in the way.
And this getting in the way, we call this hobbling.
And then not eliciting the correct behavior from the model, we call this product overhang.
Showing 101–120 of 396 · page 6 of 20
← Previous
Next →