Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Zuzanna Stamirowska

👤 Speaker
570 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

I mean, it's usually some sort of inflection points where many things come together.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

I mean, so much compute with this algorithm, all of a sudden this gets us a boom.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So what we did is we looked a little bit at Transformer and thought like, okay, what is it really missing from the brain to get closer to the brain?

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And then, yeah, that was actually Adrian, our chief scientific officer, who went on this journey literally with very strong conviction that it has to be local interactions.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Looking at the brain, we have to have those small particles.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And our model, our architecture, BDH, the way it works is that you really have small neurons.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Neurons are connected.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Whenever you have a new bit of information, like as folks call it tokens, but you have some new information coming in, only the neurons that are interested and connected light up.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So one neuron gets information, passes it on to its neighbors, those with whom he's connected.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Not everybody, not everybody lights up, just the neighbors.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

If they care enough about this thing, they light up as well.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So this is the principle of neurons, you know, who are connected and they fire together.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Yeah.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And actually, but this structure emerges naturally.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

We don't set it.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Wow.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

It just comes from data.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

It emerges.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

We actually saw in our lab, this was an amazing moment.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

We actually saw the emergence of just this kind of brain appearing.