Lance Martin
speaker
624 appearances
1 recordings
1 series
first heard Sep 2025
last heard Sep 2025
Lance Martin’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
I do want to highlight Manus.
I thought they had a very interesting take here about caching.
And it's a good argument.
When people have the experience of building an agent, the fact that it runs in a loop and that all those prior tool calls are passed back through every time is quite like a shock the first time you build an agent.
You have one token every tool call and you incur that token cost every pass through your agent.
And so Manus talks about the idea of just caching your prior message history.
It's a good idea.
I haven't done it personally, but it seems quite reasonable.
So caching reduces both latency and cost significantly.
But
I'm actually not sure that's the case.
For example, when you're building age, you're passing your message history back through every time.
As far as I know, it's stateless.
Yeah, okay, so that's a good call-out.
So I had used Anthropic's kind of caching header explicitly in the past, but it may be the case that caching is automatically done for you, which is fantastic if that's the case.
I think it's a good call-out for Manus.
Yeah, yeah, yeah.
Well, you know, it's interesting, though.
So APIs are now supporting caching more and more.
That's fantastic.
Showing 361–380 of 624 · page 19 of 32
← Previous
Next →