Charan Ranganath
๐ค SpeakerAppearances Over Time
Podcast Appearances
there's a million things i could say but like one of them determining who around you is an asshole aggressive driver yes i was just thinking about this yeah or like you can read it a mile once you get become a great driver you can see it a mile away this guy is gonna pull an asshole move in front of you exactly It's like way back there, but you know it's going to happen.
there's a million things i could say but like one of them determining who around you is an asshole aggressive driver yes i was just thinking about this yeah or like you can read it a mile once you get become a great driver you can see it a mile away this guy is gonna pull an asshole move in front of you exactly It's like way back there, but you know it's going to happen.
there's a million things i could say but like one of them determining who around you is an asshole aggressive driver yes i was just thinking about this yeah or like you can read it a mile once you get become a great driver you can see it a mile away this guy is gonna pull an asshole move in front of you exactly It's like way back there, but you know it's going to happen.
I would say superficially, not that hard, but then in a deeper level, very, very hard because we don't understand episodic memory, right? So one of the ideas I talk about in the book is one of the oldest kind of dilemmas in computational neuroscience is what Steve Grossberg called the stability plasticity dilemma, right?
I would say superficially, not that hard, but then in a deeper level, very, very hard because we don't understand episodic memory, right? So one of the ideas I talk about in the book is one of the oldest kind of dilemmas in computational neuroscience is what Steve Grossberg called the stability plasticity dilemma, right?
I would say superficially, not that hard, but then in a deeper level, very, very hard because we don't understand episodic memory, right? So one of the ideas I talk about in the book is one of the oldest kind of dilemmas in computational neuroscience is what Steve Grossberg called the stability plasticity dilemma, right?
When do you say something is new and overwrite your preexisting knowledge versus going with what you had before and making incremental changes? And so- You know, part of the problem with going through like massive, you know, I mean, part of the problem of things like if you're trying to design an LLM or something like that is especially for English, there's so many exceptions to the rules, right?
When do you say something is new and overwrite your preexisting knowledge versus going with what you had before and making incremental changes? And so- You know, part of the problem with going through like massive, you know, I mean, part of the problem of things like if you're trying to design an LLM or something like that is especially for English, there's so many exceptions to the rules, right?
When do you say something is new and overwrite your preexisting knowledge versus going with what you had before and making incremental changes? And so- You know, part of the problem with going through like massive, you know, I mean, part of the problem of things like if you're trying to design an LLM or something like that is especially for English, there's so many exceptions to the rules, right?
And so if you want to rapidly learn the exceptions, you're going to lose the rules. And if you want to keep the rules, you have a harder time learning the exception. And so David Marr is one of the early pioneers in computational neuroscience.
And so if you want to rapidly learn the exceptions, you're going to lose the rules. And if you want to keep the rules, you have a harder time learning the exception. And so David Marr is one of the early pioneers in computational neuroscience.
And so if you want to rapidly learn the exceptions, you're going to lose the rules. And if you want to keep the rules, you have a harder time learning the exception. And so David Marr is one of the early pioneers in computational neuroscience.
And then Jay McClelland and my colleague Randy O'Reilly, some other people like Neil Cohen, all these people started to come up with the idea that maybe that's part of what we need and what the human brain is doing is we have this kind of a, actually a fairly dumb system, which just says this happened once at this point in time. which we call episodic memory, so to speak.
And then Jay McClelland and my colleague Randy O'Reilly, some other people like Neil Cohen, all these people started to come up with the idea that maybe that's part of what we need and what the human brain is doing is we have this kind of a, actually a fairly dumb system, which just says this happened once at this point in time. which we call episodic memory, so to speak.
And then Jay McClelland and my colleague Randy O'Reilly, some other people like Neil Cohen, all these people started to come up with the idea that maybe that's part of what we need and what the human brain is doing is we have this kind of a, actually a fairly dumb system, which just says this happened once at this point in time. which we call episodic memory, so to speak.
And then we have this knowledge that we've accumulated from our experiences as semantic memory. So now when we want to, we encounter a situation that's surprising and violates all our previous expectations, what happens is that now we can form an episodic memory here.
And then we have this knowledge that we've accumulated from our experiences as semantic memory. So now when we want to, we encounter a situation that's surprising and violates all our previous expectations, what happens is that now we can form an episodic memory here.
And then we have this knowledge that we've accumulated from our experiences as semantic memory. So now when we want to, we encounter a situation that's surprising and violates all our previous expectations, what happens is that now we can form an episodic memory here.
And the next time we're in a similar situation, boom, we can supplement our knowledge with this information from episodic memory and reason about what the right thing to do is, right? It gives us this enormous amount of flexibility to stop on a dime and change without having to erase everything we've already learned.
And the next time we're in a similar situation, boom, we can supplement our knowledge with this information from episodic memory and reason about what the right thing to do is, right? It gives us this enormous amount of flexibility to stop on a dime and change without having to erase everything we've already learned.