Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Zuzanna Stamirowska

👤 Speaker
570 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Well, the point is, you use it more, it becomes stronger.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

I mean, this is just a principle.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And it's only positive activation, so there's no positive and negative.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

It's only positive, it gets stronger.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Something is not used, over time it will start fading.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

But journey speaking, the connections that were useful become stronger.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And this is kind of it.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And then, I mean, this structure is, you know, it's actually very efficient because it's like a brain.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So it's computationally efficient.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

It distributes nicely.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

It gives so many nice properties that unlock a number of things, you know, that then for us, even from the engineering standpoint, in terms of how it scales, how it distributes, how you can run it on many machines.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

et cetera, et cetera.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

But it's like a scale-free, so this is sorry, super geeky, but it's a scale-free graph structure.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So point is, even if we go beyond the scales that we've seen in data and tests, we scientifically know how it will behave.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

It's very different from the Transformer, at least as we see it now, because for Transformer, it hasn't been studied.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

It would probably be difficult to study.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

For this, because we know how the emergence works, we know that, I mean, yeah, it's scale-free.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Same laws we'll be holding, you know, above what we've seen in tests and kind of data until now.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Yes, in a way.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So specifically, we do see very precisely neural activity.