Dr. Terry Sejnowski

In other words, you think about what you want to do, planning ahead or something that happened to you during the day. Your brain is always generating internally. After talking to you, One of these large language models just goes blank. There is no self-continuous, self-generated thoughts.

In other words, you think about what you want to do, planning ahead or something that happened to you during the day. Your brain is always generating internally. After talking to you, One of these large language models just goes blank. There is no self-continuous, self-generated thoughts.

In other words, you think about what you want to do, planning ahead or something that happened to you during the day. Your brain is always generating internally. After talking to you, One of these large language models just goes blank. There is no self-continuous, self-generated thoughts.

We're getting closer. And so this is something I'm working on myself, actually, trying to understand how that's done in our own brains, was generating continual brain activity that leads to planning and things. We don't know what the answer to that is yet in neuroscience. And by the way, you go to a lecture and you hear the words one after the next,

We're getting closer. And so this is something I'm working on myself, actually, trying to understand how that's done in our own brains, was generating continual brain activity that leads to planning and things. We don't know what the answer to that is yet in neuroscience. And by the way, you go to a lecture and you hear the words one after the next,

We're getting closer. And so this is something I'm working on myself, actually, trying to understand how that's done in our own brains, was generating continual brain activity that leads to planning and things. We don't know what the answer to that is yet in neuroscience. And by the way, you go to a lecture and you hear the words one after the next,

over an hour and you see the slides went after the next, at the end you ask a question, right? Just let's think about what you just did. Somehow you're able to integrate all that information over the hour and then use your long-term memory then to come up with some insight or some issue that you want. How did your brain remember

over an hour and you see the slides went after the next, at the end you ask a question, right? Just let's think about what you just did. Somehow you're able to integrate all that information over the hour and then use your long-term memory then to come up with some insight or some issue that you want. How did your brain remember

over an hour and you see the slides went after the next, at the end you ask a question, right? Just let's think about what you just did. Somehow you're able to integrate all that information over the hour and then use your long-term memory then to come up with some insight or some issue that you want. How did your brain remember

all that information, working memory, traditional working memory that neuroscientists study is only for a few seconds, right? Or maybe a telephone number or something. But we're talking about long-term working memory. We don't understand how that is done. And LLMs, actually large language models, can do something. It's called in-context learning.

all that information, working memory, traditional working memory that neuroscientists study is only for a few seconds, right? Or maybe a telephone number or something. But we're talking about long-term working memory. We don't understand how that is done. And LLMs, actually large language models, can do something. It's called in-context learning.

all that information, working memory, traditional working memory that neuroscientists study is only for a few seconds, right? Or maybe a telephone number or something. But we're talking about long-term working memory. We don't understand how that is done. And LLMs, actually large language models, can do something. It's called in-context learning.

And it's a really, it was a great surprise because there is no plasticity. The thing learns at the beginning, you train it up on data, and then all it does after that is to inference, you know, fast loop of activity, one word after the next, right? That's what happens with no learning, no learning. But it's been noticed that as you continue your dialogue, it seems to get better at things.

And it's a really, it was a great surprise because there is no plasticity. The thing learns at the beginning, you train it up on data, and then all it does after that is to inference, you know, fast loop of activity, one word after the next, right? That's what happens with no learning, no learning. But it's been noticed that as you continue your dialogue, it seems to get better at things.

And it's a really, it was a great surprise because there is no plasticity. The thing learns at the beginning, you train it up on data, and then all it does after that is to inference, you know, fast loop of activity, one word after the next, right? That's what happens with no learning, no learning. But it's been noticed that as you continue your dialogue, it seems to get better at things.

How could that be? How could it be in context learning, even though there's no plasticity? That's a mystery. We don't know the answer to that question yet, but we also don't know what the answer is for humans either.

How could that be? How could it be in context learning, even though there's no plasticity? That's a mystery. We don't know the answer to that question yet, but we also don't know what the answer is for humans either.

How could that be? How could it be in context learning, even though there's no plasticity? That's a mystery. We don't know the answer to that question yet, but we also don't know what the answer is for humans either.

No, it's funny you mentioned that because I get my best ideas, not sprinting on the beach, but just either walking or jogging. And it's wonderful. I don't know. I think serotonin goes up. It's another neuromodulator. I think that that stimulates ideas and thoughts. And so inevitably, I come back to my office And I can't remember any of those great ideas.

No, it's funny you mentioned that because I get my best ideas, not sprinting on the beach, but just either walking or jogging. And it's wonderful. I don't know. I think serotonin goes up. It's another neuromodulator. I think that that stimulates ideas and thoughts. And so inevitably, I come back to my office And I can't remember any of those great ideas.