Eric Glyman
speaker
1,454 appearances
9 recordings
1 series
first heard Mar 2025
last heard 16 Jul
Eric Glyman’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 4 in all, peaking in Jul 2026 with 1.
Appearances
But then you start getting into optimization.
And there's a few sets of interesting questions.
One,
There are cases when using frontier models can, in fact, be cheaper.
Like, for example, in our own benchmarks, on our software engineering benchmark, people think of Sonnet as an older model in, let's say, the anthropic world.
And it is cheaper per call, but it needs to think a lot harder and call more agents working in collaboration.
And actually, the smarter models, like, it's kind of like you met someone smart.
Like, they don't need to go and do, like, long division.
They can just, like, do division in their head.
There are cases where...
Like a Scott Wu, for example.
Scott Wu.
Calling Scott Wu is much faster.
His hourly rate is much higher, but there might be certain things.
Scott Wu per second might be cheaper than hiring a team of third graders.
This is right.
So that's part one.
But then the really interesting part is when you get down into benchmarking of what is the nature of work that you're doing, you know,
You can use these trillion parameter models to answer really tough questions, but when you start seeing very high production use cases, you'll see, if you know all of the input tokens you're getting are around customer service, you'll see companies like Sierra having their own small models.
around what makes great efficient.
Showing 81–100 of 1,454 · page 5 of 73
← Previous
Next →