Elan Barenholtz
speaker
2,007 appearances
4 recordings
1 series
first heard Feb 2025
last heard Jun 2025
Elan Barenholtz’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
In terms of really being able to hammer down uh how the brain is instantiating this exact same algorithm.
It's not gonna look exactly like ChatGPT, it's not necessarily gonna be based on what what are called transformer models, which is something we can get into a little bit.
Um but as far as the core principle of prediction of the next token, uh the fact that that solved language so handily to me really argues that that is the fundamental algorithm.
That's the that is the fundamental
algorithm that when you apply it, boom, language emerges.
If you just have the corpus, you have the statistics and then you do next token prediction
Language, uh you know it's just like add water.
And the fact that it emerges so readily from that without having to do anything complicated, uh to me suggests that it's latent within language in in the first place.
And that language is is designed um in in a sense in order for uh to to be able to be j to be generated through this simple predictive uh kind of mechanism.
So i the the it wasn't so much an idea as as a as an epiphany, uh a realization.
And it really it hit me in a single moment.
Um and it wasn't necessarily about auto regression.
It wasn't about uh this finer detail of how uh ultimately language models s and and I believe the brain solve this problem.
It was
The realization that
All of the all any model uh that has been trained, uh any any model that uh that anybody has built that a accomplishes lying um
human level language.
So it might be based on autoregression.
It might be based even on diffusion, uh, which is kind of the arch nemesis of my my uh autoregressive theory.
But regardless
Showing 61–80 of 2,007 · page 4 of 101
← Previous
Next →