Edward Gibson
๐ค SpeakerAppearances Over Time
Podcast Appearances
Yeah, it's complicated, but probably it's doable. I would guess it's doable. I tried to do that a while ago, and I was reasonably successful, but for some reason I stopped working on it. on that. I agree with you that it would be nice to figure out. So there's like some way to figure out the cost. I mean, it's complicated. Another issue you raised before was like, how do you measure distance?
Yeah, it's complicated, but probably it's doable. I would guess it's doable. I tried to do that a while ago, and I was reasonably successful, but for some reason I stopped working on it. on that. I agree with you that it would be nice to figure out. So there's like some way to figure out the cost. I mean, it's complicated. Another issue you raised before was like, how do you measure distance?
Is it words? It probably isn't. Is it part of the problem? Is that some words matter more than others and probably, you know, meaning like nouns might matter depending, and then it maybe depends on which kind of noun. Is it a noun we've already introduced or a noun that's already been mentioned? Is it a pronoun versus a name? Like all these things probably matter.
Is it words? It probably isn't. Is it part of the problem? Is that some words matter more than others and probably, you know, meaning like nouns might matter depending, and then it maybe depends on which kind of noun. Is it a noun we've already introduced or a noun that's already been mentioned? Is it a pronoun versus a name? Like all these things probably matter.
Is it words? It probably isn't. Is it part of the problem? Is that some words matter more than others and probably, you know, meaning like nouns might matter depending, and then it maybe depends on which kind of noun. Is it a noun we've already introduced or a noun that's already been mentioned? Is it a pronoun versus a name? Like all these things probably matter.
So probably the simplest thing to do is just like, oh, let's forget about all that and just think about words or morphemes.
So probably the simplest thing to do is just like, oh, let's forget about all that and just think about words or morphemes.
So probably the simplest thing to do is just like, oh, let's forget about all that and just think about words or morphemes.
I think it's an exponential. So we think it's probably an exponential such that the longer the distance, the less it matters. And so then it's the sum of those is my... That was our best guess a while ago. So you've got a bunch of dependencies. If you've got a bunch of them that are being connected at some point, that's...
I think it's an exponential. So we think it's probably an exponential such that the longer the distance, the less it matters. And so then it's the sum of those is my... That was our best guess a while ago. So you've got a bunch of dependencies. If you've got a bunch of them that are being connected at some point, that's...
I think it's an exponential. So we think it's probably an exponential such that the longer the distance, the less it matters. And so then it's the sum of those is my... That was our best guess a while ago. So you've got a bunch of dependencies. If you've got a bunch of them that are being connected at some point, that's...
At the ends of those, the cost is some exponential function of those, is my guess. Because the reason it's probably an exponential is it's not just the distance between two words. Because I can make a very, very long subject, verb dependency, by adding lots and lots of noun phrases and prepositional phrases, and it doesn't matter too much.
At the ends of those, the cost is some exponential function of those, is my guess. Because the reason it's probably an exponential is it's not just the distance between two words. Because I can make a very, very long subject, verb dependency, by adding lots and lots of noun phrases and prepositional phrases, and it doesn't matter too much.
At the ends of those, the cost is some exponential function of those, is my guess. Because the reason it's probably an exponential is it's not just the distance between two words. Because I can make a very, very long subject, verb dependency, by adding lots and lots of noun phrases and prepositional phrases, and it doesn't matter too much.
It's when you do nested, when I have multiple of these, then things go really bad, go south.
It's when you do nested, when I have multiple of these, then things go really bad, go south.
It's when you do nested, when I have multiple of these, then things go really bad, go south.
Yeah, that's probably a function of the memory here is the access, is trying to find those earlier things. It's kind of hard to figure out what was referred to earlier. Those are those connections. That's the sort of notion of working, as opposed to a storage-y thing, but trying to connect things.
Yeah, that's probably a function of the memory here is the access, is trying to find those earlier things. It's kind of hard to figure out what was referred to earlier. Those are those connections. That's the sort of notion of working, as opposed to a storage-y thing, but trying to connect things.
Yeah, that's probably a function of the memory here is the access, is trying to find those earlier things. It's kind of hard to figure out what was referred to earlier. Those are those connections. That's the sort of notion of working, as opposed to a storage-y thing, but trying to connect things.