Sherwin Wu
speaker
309 appearances
1 recordings
1 series
first heard Oct 2025
last heard 7 Oct
Sherwin Wu’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Oct 2025 with 1.
Appearances
Um I think this is step one.
Like I think it's good to be able to do this, but um uh I I think our roadmap from here on out is to you know really allow you to break down the different parts of the trace uh and and allow you to eval and like kind of like measure each of those and optimize each of those as well.
A lot of the times this will involve human
In the loop as well, which is why we have the human in the loop component here too.
Um, but uh if you kind of look at our eval's product over the last year, it's been very simple.
It's been much more geared towards this like simple prompt completion setup.
But obviously, as we see people doing these longer um uh gentic traces, like, you know, how do you even evaluate a 20-minute task uh correctly?
And it's like it's a really hard problem.
Um we're trying to set up our Evals product to move in that way to help you not only evaluate the
Overall trajectory, but also individual parts of it.
yeah.
I actually think it's a really cool time right now in prompt optimization.
I'm sure you guys are seeing this too.
It's like uh not only there are a lot of products kind of like gearing around this, so like kind of what we're we're thinking about, but I also think like there's a lot of interesting research around this, like G EPA with like the data breaks folks are actually doing really cool stuff around uh this.
Um we're obviously not doing any of the the cool G EPA optimization right now in in our product, but uh would love to would love to do that soon.
And um also it's just an active research area, so like you know, whatever uh
uh Mate and the Databricks folks like might think about next, what we might you know think about internally as well.
Um uh whatever new prompt optimization techniques come out, I think we'd we'd love to uh be able to have that in our in our product as well.
Um and yeah and and and it's interesting because it's coming at a time when people are realizing that prompt you know like like I feel like two years ago people were like, oh at some point prop like prompting's gonna be dead.
No.
Showing 101–120 of 309 · page 6 of 16
← Previous
Next →