Zuzanna Stamirowska
👤 SpeakerAppearances Over Time
Podcast Appearances
I mean, it's usually some sort of inflection points where many things come together.
I mean, so much compute with this algorithm, all of a sudden this gets us a boom.
So what we did is we looked a little bit at Transformer and thought like, okay, what is it really missing from the brain to get closer to the brain?
And then, yeah, that was actually Adrian, our chief scientific officer, who went on this journey literally with very strong conviction that it has to be local interactions.
Looking at the brain, we have to have those small particles.
And our model, our architecture, BDH, the way it works is that you really have small neurons.
Neurons are connected.
Whenever you have a new bit of information, like as folks call it tokens, but you have some new information coming in, only the neurons that are interested and connected light up.
So one neuron gets information, passes it on to its neighbors, those with whom he's connected.
Not everybody, not everybody lights up, just the neighbors.
If they care enough about this thing, they light up as well.
So this is the principle of neurons, you know, who are connected and they fire together.
Yeah.
And actually, but this structure emerges naturally.
We don't set it.
Wow.
It just comes from data.
It emerges.
We actually saw in our lab, this was an amazing moment.
We actually saw the emergence of just this kind of brain appearing.