Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Zuzanna Stamirowska

👤 Speaker
570 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So they actually managed to produce something new that they didn't necessarily see in the training data very explicitly, right?

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

From having so many kind of samples of data.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Yeah, exactly.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So they've seen so much.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And these are language models, and they don't have memory.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Yes.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Correct.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So right now, when you have an LLM and you kind of start it, it's trained once.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

We have these like huge models and they'll tell you how many parameters, right?

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And the bigger, the better.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

That would be usual, the kind of the vibe that they would be giving.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And then every time you use it, it's as if the model was waking up and always using the same brain that was set during training.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Training is very expensive because of data and compute because you need to produce a huge model.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Then it works better, of course.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You ask your question, you add some context, like a New York private document, like some whatever you're asking about, right?

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Then you get your answer.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

But then you relive the Groundhog Day every time.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And you have a sort of memory, Corey, exactly kind of as you said, but it's more like as if you were leaving sticky notes for yourself from the day that you know you wouldn't remember.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Yeah, I mean, exactly, exactly.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So it's like, you know, there's a big difference between having a library of knowledge versus having internalized it.