Elan Barenholtz
speaker
2,007 appearances
4 recordings
1 series
first heard Feb 2025
last heard Jun 2025
Elan Barenholtz’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
Um that's what happens uh when you have to directly explicitly retrieve.
Like what was the last word I said?
Uh tell me the exact sequence of of letters or numbers.
That's
Not something our brain actually has to do regularly.
Instead what we s what we're seeing in working memory, we can do that, we can do retrieval of the last seven seconds, but that's because we have continuous context.
And is there is a decay function, unlike the the the large language models, which represent everything in whole blocks, um, although I think some of the newer models, these these endless context models are probably doing something similar.
But we don't remember ever we don't actually have uh literally the exact tokens.
That were expressed 10 minutes ago.
But what we do have is some sort of continuous activation that's similar, where it's not retrieval.
It's guiding.
It's it's the past is guiding the generation.
And so what you and I talked about an hour ago, I don't know how long we've been going here, probably a while.
I don't know how much gluogoglobal you've got going on, right?
It's been a while.
Pero bueno.
Um so those those tokens that we are that we were expressed, you know.
an hour ago, are still guiding the generation now.
Now they're doing so less than the than the last 10 seconds.
Uh the this is uh you know we we could think about it as kind of a decay function of some sort where they're having less impact.
Showing 821–840 of 2,007 · page 42 of 101
← Previous
Next →