Elan Barenholtz
speaker
2,007 appearances
4 recordings
1 series
first heard Feb 2025
last heard Jun 2025
Elan Barenholtz’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
Um but it lo and behold that's
That's what happens.
The uh it and that is happening in the auto regress.
Uh it's happening even though
This model has never seen Google Global.
Even though it's never encountered that word before.
But here it lo it shows up in the sequence and now
Through the autoaggressive process as it's churning through the longer sequence with this word in it, it's now able to predict sort of the next token in the appropriate way so that it's using that term uh correctly.
So we do actually see this kind of continuous learning uh in the case of these models.
However, it's happening in context.
It's and what that means is
you know, from a practical standpoint, is if you start a new chat window, it doesn't know that word anymore.
question.
Yes.
That is what I truly believe.
Uh and this is uh this is a different line of research.
Um but with some caveats.
Uh so yes, uh in m in in m in my conception
What we call long term memory is just fine tuning of the of the weights.
Uh it's in it's the it's it's it's in information that gets embedded in the actual weights of the model.
Showing 761–780 of 2,007 · page 39 of 101
← Previous
Next →