Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Edward Gibson

๐Ÿ‘ค Speaker
1434 total appearances

Appearances Over Time

Podcast Appearances

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Absolutely.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

No. Okay. Not at all. I mean, regular languages are too simple for human languages. It's a part of the hierarchy, but human languages in the phrase structure world are at least context-free, maybe a little bit more, a little bit harder than that. So there's something called context-sensitive as well, where you can have, like this is just the formal language description,

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

No. Okay. Not at all. I mean, regular languages are too simple for human languages. It's a part of the hierarchy, but human languages in the phrase structure world are at least context-free, maybe a little bit more, a little bit harder than that. So there's something called context-sensitive as well, where you can have, like this is just the formal language description,

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

No. Okay. Not at all. I mean, regular languages are too simple for human languages. It's a part of the hierarchy, but human languages in the phrase structure world are at least context-free, maybe a little bit more, a little bit harder than that. So there's something called context-sensitive as well, where you can have, like this is just the formal language description,

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

In a context-free grammar, you have one... This is like a bunch of formal language theory we're doing here.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

In a context-free grammar, you have one... This is like a bunch of formal language theory we're doing here.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

In a context-free grammar, you have one... This is like a bunch of formal language theory we're doing here.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Okay. So you have a left-hand side category, and you're expanding to anything on the right. That's a context-free. The idea is that that category on the left expands in independent of context to those things, whatever they are on the right. It doesn't matter what. And a context-sensitive... says, okay, I actually have more than one thing on the left.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Okay. So you have a left-hand side category, and you're expanding to anything on the right. That's a context-free. The idea is that that category on the left expands in independent of context to those things, whatever they are on the right. It doesn't matter what. And a context-sensitive... says, okay, I actually have more than one thing on the left.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Okay. So you have a left-hand side category, and you're expanding to anything on the right. That's a context-free. The idea is that that category on the left expands in independent of context to those things, whatever they are on the right. It doesn't matter what. And a context-sensitive... says, okay, I actually have more than one thing on the left.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

I can tell you only in this context, you know, maybe you have like a left and a right context or just a left context or a right context. I have two or more stuff on the left tells you how to expand those things in that way. Okay, so it's context sensitive. A regular language is just more constrained. And so it It doesn't allow anything on the right.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

I can tell you only in this context, you know, maybe you have like a left and a right context or just a left context or a right context. I have two or more stuff on the left tells you how to expand those things in that way. Okay, so it's context sensitive. A regular language is just more constrained. And so it It doesn't allow anything on the right.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

I can tell you only in this context, you know, maybe you have like a left and a right context or just a left context or a right context. I have two or more stuff on the left tells you how to expand those things in that way. Okay, so it's context sensitive. A regular language is just more constrained. And so it It doesn't allow anything on the right.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

It allows very... Basically, it's one very complicated rule is kind of what a regular language is. And so it doesn't have any... I was going to say long-distance dependencies. It doesn't allow recursion, for instance. There's no recursion. Yeah, recursion is where you... Human languages have recursion. They have embedding.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

It allows very... Basically, it's one very complicated rule is kind of what a regular language is. And so it doesn't have any... I was going to say long-distance dependencies. It doesn't allow recursion, for instance. There's no recursion. Yeah, recursion is where you... Human languages have recursion. They have embedding.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

It allows very... Basically, it's one very complicated rule is kind of what a regular language is. And so it doesn't have any... I was going to say long-distance dependencies. It doesn't allow recursion, for instance. There's no recursion. Yeah, recursion is where you... Human languages have recursion. They have embedding.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And you can't... Well, it doesn't allow center-embedded recursion, which human languages have, which is what... Center-embedded recursion.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And you can't... Well, it doesn't allow center-embedded recursion, which human languages have, which is what... Center-embedded recursion.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

And you can't... Well, it doesn't allow center-embedded recursion, which human languages have, which is what... Center-embedded recursion.

Lex Fridman Podcast
#426 โ€“ Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs

Yeah, within a sentence. So here we're going to get to that. But the formal language stuff is a little aside. Chomsky wasn't proposing it for human languages even. He was just pointing out that human languages are context-free. Because that was kind of stuff we did for formal languages. And what he was most interested in was