Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Eno Reyes

๐Ÿ‘ค Speaker
513 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

And so if you build an explicit structure into your compression strategy, hey, files are all going to go here.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

Decisions are all going to go here.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

That where the agent is currently operating is going to go right here.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

And you also preserve some of the continuity in the conversation, right?

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

Maybe the last message or the last couple of messages should actually be preserved.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

So the agent is able to pick back up without losing track.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

That's huge.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

Compression ratio is obviously the wrong strategy as well.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

So like, it doesn't matter if you compress more, if it's worse, because you'll end up actually spending more tokens to get back to where you were.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

And then you've lost the like 1% delta.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

Yeah, totally.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

I mean, I think that the, uh, so, so the question is, was that very long session because of the strategy?

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

Uh, yeah, totally.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

Like technically this is, uh, this can go infinitely.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

Uh, we have like a strategy at the very end.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

If it were to accidentally run over by over compressing, uh, we have a way of like flushing, in which case you might see a minor decline at that very, very, very long end of a, of a potentially multi-day session.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

Um,

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

But but really, this strategy allows you to run for a very long time.

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

I mean, we have customers that have quite literally run sessions that go well into the 80 million tokens like and so really the thought process here is

The Neuron: AI Explained
This AI Agent Builds Better Code Than Most Developers (Factory AI)

If the question is, can it recall the most precise detail about at the very beginning of the session, the second question you asked, very unlikely that it will be able to.