Elan Barenholtz
speaker
2,007 appearances
4 recordings
1 series
first heard Feb 2025
last heard Jun 2025
Elan Barenholtz’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
uh symposium of uh you know quote unquote cavemen or or uh let's use the uh the the the more modern term, hunter-gatherers.
Um and they had to figure out how do we make an auto-generative, auto regressive, right, uh sequen sequential system that uh is able to carry meaning about the world.
This thing is just ridiculously good.
Um, and it's and it's operating over these it's arbitrary symbols.
And again, when I say arbitrary symbols, just to recap, it's not that it's arbitrary like the word for snow is this weird sound snow and it's kinda s like what no.
Arbitrary in the sense that these
Is it completely arbitrary though?
So for instance, there's the Kiki and and Boo Boo.
You've heard of this?
I think those are cute.
I mean th that that that's that's the exception that that proves the rule, uh, to a large extent.
I don't think I I think it is largely arbitrary.
is also
And again, I uh I'm I'm only I I'm really I'm just following where the data leads me because in the large language models.
They it's it it's they no longer have any of those properties, right?
It's just an arbitrary vector.
The tokenization in the end ultimately, yes, there's proximity, but it's just strings of of of ones and zeros.
Um or well, it's not ones and zeros, but whatever your your you know, uh your vector is just a string of numbers that end up having certain uh mathematical relations to one another, but d completely and totally lost, as far as I can tell.
is the physical characteristics of these words.
By the way, I should mention there's this uh a a a former student and I are actually working on
Showing 1181–1200 of 2,007 · page 60 of 101
← Previous
Next →