Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Zuzanna Stamirowska

👤 Speaker
570 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

This is all right.

1800.498 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You could have a model that's growing technically.

1801.479 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

But it's like right now in transformers, it's not the reasoning power doesn't come so much from this.

1805.546 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

size per se okay when you think about this we actually do have a lot of compute power because of how much place we have in the brain because of the structure so these models but if you if you look like the brain now i would need to check again but i mean for the synaptic synaptic connections the brain are in the trillions right and i think it could be

1813.553 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Yeah, like 1,000.

1839.862 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Some folks would say it could be, I think, 1,000 trillions or something like this of synaptic connections in the brain.

1842.787 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

This gives you a lot of memory and a very efficient structure.

1848.456 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So effectively, you get to something that operationally works like infinite context.

1853.184 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

I mean, to be super scientifically precise, yes, context in BDH is limited by the size of your brain.

1858.193 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

brain, so the number of neurons and then connections between them.

1865.545 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

But this network structure allows you to encode so much.

1869.009 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Exactly.

1886.707 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And then when you think about this, you keep your memory close to the core.

1887.288 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Actually, exactly at the core.

1891.172 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So you don't need to do lookups for technical people.

1893.254 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You don't spend your energy on all of that.

1897.14 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You don't need additional compute for this.

1899.603 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So it becomes very efficient from this point of view.

1902.347 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You have memory directly there.

1905.171 View full episode →
The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And yeah, it's like in memory on a chip.

1906.814 View full episode →