Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Zuzanna Stamirowska

👤 Speaker
570 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

This is all right.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You could have a model that's growing technically.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

But it's like right now in transformers, it's not the reasoning power doesn't come so much from this.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

size per se okay when you think about this we actually do have a lot of compute power because of how much place we have in the brain because of the structure so these models but if you if you look like the brain now i would need to check again but i mean for the synaptic synaptic connections the brain are in the trillions right and i think it could be

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Yeah, like 1,000.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Some folks would say it could be, I think, 1,000 trillions or something like this of synaptic connections in the brain.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

This gives you a lot of memory and a very efficient structure.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So effectively, you get to something that operationally works like infinite context.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

I mean, to be super scientifically precise, yes, context in BDH is limited by the size of your brain.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

brain, so the number of neurons and then connections between them.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

But this network structure allows you to encode so much.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Exactly.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And then when you think about this, you keep your memory close to the core.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

Actually, exactly at the core.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So you don't need to do lookups for technical people.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You don't spend your energy on all of that.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You don't need additional compute for this.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

So it becomes very efficient from this point of view.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

You have memory directly there.

The Neuron: AI Explained
Inside Pathway’s Brain-Like AI: Zuzanna Stamirowska on Continual Learning, Memory & Real-Time Reasoning

And yeah, it's like in memory on a chip.