Jennifer Li
speaker
607 appearances
7 recordings
1 series
first heard Dec 2024
last heard 5d ago
Jennifer Li’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 4 in all, peaking in Sep 2026 with 2.
Appearances
What do you see when is the analogy to the past, that lessons we can borrow and what do you see that's really going to be the challenge and missing pieces going forward?
And Ryan, today you have already a pretty extensive catalog of different type of benchmarks.
Some of them are more focused on specific industries, some of them are more like consumer mental health related.
Maybe first just talk through what are the benchmarks that are most popular and most like read upon and we'll love to dive into one of them as well.
Yeah, I thought that one is a very cool benchmark.
It's sort of all the rage in the research community of how do you measure like
progress you can make through having more frontier models that you can just compound on the capabilities.
Um how do you actually
go about like beauty on this R SI benchmark.
Very cool.
Um there's also uh cases where you have deprecated uh indexes and benchmarks.
Uh it's funny that I always uh watch this benchmark industry if people like
just like early diffusion model days, like you cherry pick whichever image shows up the best and the most perfect, like benchmarks as well.
Like you pick something that's, you know, very popular but maybe already saturated and you rank very well on on that or score very high.
But you took a very different approach in like if these benchmarks are saturated, you'll deprecate it, like maybe talk us through the the the thinking I think around that too.
And how has um I guess
One, like it it used to be like we're we're um doing these like multi um answer or multi-s uh step questions to like just evaluate prompt and answers.
Now there's like a lot more agentic uh work that's happening, uh whether it's on finance or legal, um, or coding especially, like there's a lot of um, you know, um
async background agents that can just complete tasks.
How has has that changed sort of how you build infrastructure, how you think of evaluating?
Showing 121–140 of 607 · page 7 of 31
← Previous
Next →