Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Edward Gibson

๐Ÿ‘ค Speaker
1434 total appearances

Appearances Over Time

Podcast Appearances

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Yeah, it's complicated, but probably it's doable. I would guess it's doable. I tried to do that a while ago, and I was reasonably successful, but for some reason I stopped working on it. on that. I agree with you that it would be nice to figure out. So there's like some way to figure out the cost. I mean, it's complicated. Another issue you raised before was like, how do you measure distance?

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Yeah, it's complicated, but probably it's doable. I would guess it's doable. I tried to do that a while ago, and I was reasonably successful, but for some reason I stopped working on it. on that. I agree with you that it would be nice to figure out. So there's like some way to figure out the cost. I mean, it's complicated. Another issue you raised before was like, how do you measure distance?

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Is it words? It probably isn't. Is it part of the problem? Is that some words matter more than others and probably, you know, meaning like nouns might matter depending, and then it maybe depends on which kind of noun. Is it a noun we've already introduced or a noun that's already been mentioned? Is it a pronoun versus a name? Like all these things probably matter.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Is it words? It probably isn't. Is it part of the problem? Is that some words matter more than others and probably, you know, meaning like nouns might matter depending, and then it maybe depends on which kind of noun. Is it a noun we've already introduced or a noun that's already been mentioned? Is it a pronoun versus a name? Like all these things probably matter.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Is it words? It probably isn't. Is it part of the problem? Is that some words matter more than others and probably, you know, meaning like nouns might matter depending, and then it maybe depends on which kind of noun. Is it a noun we've already introduced or a noun that's already been mentioned? Is it a pronoun versus a name? Like all these things probably matter.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

So probably the simplest thing to do is just like, oh, let's forget about all that and just think about words or morphemes.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

So probably the simplest thing to do is just like, oh, let's forget about all that and just think about words or morphemes.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

So probably the simplest thing to do is just like, oh, let's forget about all that and just think about words or morphemes.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

I think it's an exponential. So we think it's probably an exponential such that the longer the distance, the less it matters. And so then it's the sum of those is my... That was our best guess a while ago. So you've got a bunch of dependencies. If you've got a bunch of them that are being connected at some point, that's...

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

I think it's an exponential. So we think it's probably an exponential such that the longer the distance, the less it matters. And so then it's the sum of those is my... That was our best guess a while ago. So you've got a bunch of dependencies. If you've got a bunch of them that are being connected at some point, that's...

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

I think it's an exponential. So we think it's probably an exponential such that the longer the distance, the less it matters. And so then it's the sum of those is my... That was our best guess a while ago. So you've got a bunch of dependencies. If you've got a bunch of them that are being connected at some point, that's...

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

At the ends of those, the cost is some exponential function of those, is my guess. Because the reason it's probably an exponential is it's not just the distance between two words. Because I can make a very, very long subject, verb dependency, by adding lots and lots of noun phrases and prepositional phrases, and it doesn't matter too much.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

At the ends of those, the cost is some exponential function of those, is my guess. Because the reason it's probably an exponential is it's not just the distance between two words. Because I can make a very, very long subject, verb dependency, by adding lots and lots of noun phrases and prepositional phrases, and it doesn't matter too much.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

At the ends of those, the cost is some exponential function of those, is my guess. Because the reason it's probably an exponential is it's not just the distance between two words. Because I can make a very, very long subject, verb dependency, by adding lots and lots of noun phrases and prepositional phrases, and it doesn't matter too much.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

It's when you do nested, when I have multiple of these, then things go really bad, go south.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

It's when you do nested, when I have multiple of these, then things go really bad, go south.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

It's when you do nested, when I have multiple of these, then things go really bad, go south.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Yeah, that's probably a function of the memory here is the access, is trying to find those earlier things. It's kind of hard to figure out what was referred to earlier. Those are those connections. That's the sort of notion of working, as opposed to a storage-y thing, but trying to connect things.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Yeah, that's probably a function of the memory here is the access, is trying to find those earlier things. It's kind of hard to figure out what was referred to earlier. Those are those connections. That's the sort of notion of working, as opposed to a storage-y thing, but trying to connect things.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Yeah, that's probably a function of the memory here is the access, is trying to find those earlier things. It's kind of hard to figure out what was referred to earlier. Those are those connections. That's the sort of notion of working, as opposed to a storage-y thing, but trying to connect things.