Jennifer Li
speaker
607 appearances
7 recordings
1 series
first heard Dec 2024
last heard 6d ago
Jennifer Li’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 4 in all, peaking in Sep 2026 with 2.
Appearances
um the capabilities of not just the models and agents themselves.
And there's also like a lot more dimensions that people care about.
It's not just like capability, it's cost, it's latency.
It's like um, you know, whether this model is flexible enough to to to address like broader um domains and tasks and so on.
So how do you think about the additional parameters to to what you evaluate?
And and maybe just double click on that, um, like similar question to to why the labs can't do it themselves or it requires a third party um agency to to rate it.
I I think it's it's a lot uh more um uh understandable that, you know, you you need this that neutrality across the industry.
But for enterprise, they would argue that they know the task the best for their customers.
Like what what how how does like valve come in to provide that?
And maybe you can talk through the sort of Ball Smith neoproduct launch as well.
And w what are some of the examples when you let let's say benchmark on a private ripple that it just shows very different uh performance?
cost behavior compared to let's say like
using like frontier model using a a a a public repo uh benchmark.
Maybe maybe just tag along the the earlier question.
Um how how are you guys using Val Smith internally to uh evaluate what's the best coding model for for valve?
much does that e equal to to dollars?
Very cool.
So is the current um operating mode that you're using like one uh I guess more token efficient harness plus model and then like
On top of that, people have some more flexibility to to use token base to for some h higher higher or more talent tasks.
And maybe that's a question for you, Ben, as well.
Showing 141–160 of 607 · page 8 of 31
← Previous
Next →