Brian Fioca
speaker
409 appearances
1 recordings
1 series
first heard Dec 2025
last heard 26 Dec
Brian Fioca’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Dec 2025 with 1.
Appearances
And then so therefore if you can build an agentic harness
That
works in a multiple turn way, you can eval it.
And then there are like also academic benchmarks that already does this in some ways like Cowbench and now we have like Tao Square Bench that that does this like particularly well and would definitely certainly take inspirations from that.
I have this idea.
I call it like a
a job interview evil.
I haven't finished it.
But really like if you're evaluating a coding agent.
What do you want it to be able to do?
You want it to be able to take an under-specified.
Imagine you are interviewing a developer.
You give them a problem.
Hey, like go implement a string reverse or whatever.
Um, and then it's like up to them to like ask for, okay, well, I need more information.
What are the constraints here?
Like, what is and then you you judge them on that.
And then they start implementing it.
You give them some modifications, you grade them on that.
You can imagine like building, you know, with an
Showing 301–320 of 409 · page 16 of 21
← Previous
Next →