David Cox
speaker
634 appearances
1 recordings
1 series
first heard Jan 2026
last heard 13 Jan
David Cox’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jan 2026 with 1.
Appearances
It's this awful process where you're trying to like, you stretch it out a little bit and you train and train and train and train and get it back up to, and then you stretch it out more and you stretch it out more.
So we just got rid of them and all the hybrid versions of Granite 4, because we figured out basically you don't need them when you have these hybrid, these other layers that don't have the KV cache.
So in principle, you could just put arbitrary amounts of stuff and the model would just sort of fine.
Of course, that's not nothing.
Nothing, yeah.
Nothing is theoretically infinite, but it'll depend on what's inside the context, right?
Because what's happening is if there's like chaff that it might get distracted on in this giant long context, that'll be more distracting.
If it's less interfering, maybe it wouldn't go as long.
The whole issue of how long is the context is a really...
Yeah, well, I mean, the place we're going is like, actually, the thing that's going to be really exciting is don't put things in context unless you really need them there, right?
Like, you know, a lot of what people do is those have like an agent, you know, that people still have this kind of I'm talking to a friendly robot thing, even when they're doing the agents.
So
They keep like a little conversation party line of the agent talking to itself and doing all this thing.
And then pretty soon you have this giant context.
And now you have all this crap that could potentially screw things up.
It could grab the wrong thing, have the wrong idea.
Yeah, like you do a web search and you bring back like half the internet.
You bring back the longest web page you've ever seen and now you're stuck with it forever in your context.
And that's getting to be, you know, a bit of a problem versus a mode where we actually like think about it.
It's like, do I really need to keep this around?
Showing 221–240 of 634 · page 12 of 32
← Previous
Next →