Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Edward Gibson

๐Ÿ‘ค Speaker
1434 total appearances

Appearances Over Time

Podcast Appearances

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

I mean, that's the mechanism. If it's modeling, I think it's kind of really interesting that it can't. That it's really interesting. I think it's potentially underlyingly modeling something like the way the form is processed.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

So what I like about dependency grammar is it makes... The cognitive cost associated with longer distance connections, very transparent. It turns out there is a cost associated with producing and comprehending connections between words which are just not beside each other. The further apart they are, the worse it is, according to, well, we can measure that.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

So what I like about dependency grammar is it makes... The cognitive cost associated with longer distance connections, very transparent. It turns out there is a cost associated with producing and comprehending connections between words which are just not beside each other. The further apart they are, the worse it is, according to, well, we can measure that.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

So what I like about dependency grammar is it makes... The cognitive cost associated with longer distance connections, very transparent. It turns out there is a cost associated with producing and comprehending connections between words which are just not beside each other. The further apart they are, the worse it is, according to, well, we can measure that.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And there is a cost associated with that.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And there is a cost associated with that.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And there is a cost associated with that.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Sure. And how do you measure it? Oh, well, you can measure it in a lot of ways. The simplest is just asking people to say how good a sentence sounds. That's one way to measure. And you try to triangulate then across sentences and across structures to try to figure out what the source of that is. You can look at...

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Sure. And how do you measure it? Oh, well, you can measure it in a lot of ways. The simplest is just asking people to say how good a sentence sounds. That's one way to measure. And you try to triangulate then across sentences and across structures to try to figure out what the source of that is. You can look at...

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Sure. And how do you measure it? Oh, well, you can measure it in a lot of ways. The simplest is just asking people to say how good a sentence sounds. That's one way to measure. And you try to triangulate then across sentences and across structures to try to figure out what the source of that is. You can look at...

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

reading times in controlled materials, in certain kinds of materials, and then we can measure the dependency distances there. There's a recent study which looked at, we're talking about the brain here, we could look at the language network, okay? We could look at the language network and we could look at the activation in the language network

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

reading times in controlled materials, in certain kinds of materials, and then we can measure the dependency distances there. There's a recent study which looked at, we're talking about the brain here, we could look at the language network, okay? We could look at the language network and we could look at the activation in the language network

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

reading times in controlled materials, in certain kinds of materials, and then we can measure the dependency distances there. There's a recent study which looked at, we're talking about the brain here, we could look at the language network, okay? We could look at the language network and we could look at the activation in the language network

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And how big the activation is depending on the length of the dependencies. And it turns out in just random sentences that you're listening to, if you're listening to, so it turns out there are people listening to stories here. And the bigger, the longer the dependency is, the stronger the activation in the language network.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And how big the activation is depending on the length of the dependencies. And it turns out in just random sentences that you're listening to, if you're listening to, so it turns out there are people listening to stories here. And the bigger, the longer the dependency is, the stronger the activation in the language network.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And how big the activation is depending on the length of the dependencies. And it turns out in just random sentences that you're listening to, if you're listening to, so it turns out there are people listening to stories here. And the bigger, the longer the dependency is, the stronger the activation in the language network.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And so there's some measure, there's a bunch of different measures we could do. That's kind of a neat measure, actually, of actual activations. Activation in the brain.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And so there's some measure, there's a bunch of different measures we could do. That's kind of a neat measure, actually, of actual activations. Activation in the brain.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And so there's some measure, there's a bunch of different measures we could do. That's kind of a neat measure, actually, of actual activations. Activation in the brain.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Yeah, it's complicated, but probably it's doable. I would guess it's doable. I tried to do that a while ago, and I was reasonably successful, but for some reason I stopped working on it. on that. I agree with you that it would be nice to figure out. So there's like some way to figure out the cost. I mean, it's complicated. Another issue you raised before was like, how do you measure distance?