Elan Barenholtz

speaker

2,007 appearances 4 recordings 1 series first heard Feb 2025 last heard Jun 2025

Elan Barenholtz’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

No recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.

newest first · ▶ plays the moment

So the static model we can think of when it's not actually in the process of auto-regressively generating.

Working memory is is literally the auto regression.

So what would the analogy for rag be then?

What would the role for Rad be?

Okay, so

This is this is where I I am at right now.

Uh do does the brain actually do anything like retrieval?

I I have taken uh I've I've decided to stake out the extreme view that we uh our brain doesn't do retrieval at all.

That all we do

is fine tuning and then next token generation auto regressively.

And we don't actually ever retrieve per se, that we don't ever actually have to do anything like rag.

Rag is.

a transitional technology.

Uh, I don't believe long term that we're gonna have to do something like that.

We're gonna have to have something like a stored database and then a search.

One of the reasons I believe this is because that's not how our brains work.

We don't do that.

Cognition doesn't work that way.

We may sometimes sit there pondering and trying to recall a fact, um, but when we're doing that, we're not actually searching a space.

Uh it's it's either we're running some sort of chain of thought.

Showing 781–800 of 2,007 · page 40 of 101