James Reggio

speaker

667 appearances 1 recordings 1 series first heard Jan 2026 last heard 17 Jan

James Reggio’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Jan 2026 with 1.

Appearances

newest first · ▶ plays the moment

Latent Space: The AI Engineer Podcast · Brex’s AI Hail Mary — With CTO James Reggio · 17 Jan 2026 podcast

Uh but the

The team is actually interesting.

We think we're gonna get an a big update on like how the team is thinking about evals tomorrow and like our Friday, uh our Friday review.

So it's this is an area where I'd say the largest challenge, like the the largest change we needed to make and how we were executing sort of as like a lab or an incubator back uh uh earlier this year to like where we are now where we've we've shipped and like we're trying to

to increase the rigor has been around uh like avoiding regressions and having more and more increasingly robust evals.

That's actually really, really interesting to me.

And it I I I'm gonna take that away and and and start thinking about this because there are there are going to be certain I mean, we already seen this where where uh users will ask the assistant for help with things that we don't support yet or we haven't implemented yet.

It's like those are opportunities actually for us to build a like effectively write a test that's going to be fail like failing for for weeks or months and and eventually we'll go green.

but is a way for us to actually kind of show like the progression of

Sophistication of the assistant.

I I really I really like that as an idea.

that it doesn't have to be.

That's usually the that's usually the problem, is it?

One thing that is really annoying that has been tough to um to prevent is that the the assistant because it is used to speaking to other agents um that can support it in like accomplishing various tasks, if you ask it to to help with a task that it thinks it probably should have an agent to

uh uh to to work with it'll just hallucinate that it it always like oh yes I'll I will like you know I'll reach out to the finance team on your behalf to uh to pass this question along but it's not doing anything.

There's like no finance team.

There's no way for it to do that.

This is something that comes up a lot.

It's like would you like me to ask the finance team and the there's no there's no actual tool for it.

Yeah, yeah.

Showing 501–520 of 667 · page 26 of 34