Lance Martin
speaker
624 appearances
1 recordings
1 series
first heard Sep 2025
last heard Sep 2025
Lance Martin’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
Yeah, we should, let's walk through these actually.
When I talked about
naive agents, and the first time I built an agent, agent makes a bunch of tool calls, those tool calls are passed back to the LLM at each turn, and you naively just plumb all that context back.
And of course, what you see is the context window grows significantly because this tool feedback is accumulating in your message history.
A perspective that Manish shared in particular I thought was really good.
It's important and useful to offload context.
Don't just naively send back the full context of each of your tool calls.
You can actually offload it, and they talk about offloading it to disk.
So they talk about this idea of using the file system as externalized memory, rather than just writing back the full context of your tool calls, which could be token heavy, write those to disk,
And you can write back a summary.
It could be a URL.
Something so that the agent knows it's retrieved a thing.
It can fetch that on demand.
But you're not just naively pushing all that raw context back to the model.
So that's this offloading concept.
Note that it could be a file system.
It could also be, for example, agent state.
So LandGraph, for example, has this notion of state.
So it could be kind of the agent runtime state object.
It could be the file system.
Showing 61–80 of 624 · page 4 of 32
← Previous
Next →