Edward Gibson

It's a black box. It's another black box. But I think it is a theory.

It's a black box. It's another black box. But I think it is a theory.

Well, I don't know. Maybe I'm just being loose there. I think it's not a great theory, but it's a theory. It's a good theory in one sense in that it covers all the data. Like anything you want to say in English, it does. And so that's how it's arguably the best. is that no other theory is as good as a large language model in predicting exactly what's good and what's bad in English.

Well, I don't know. Maybe I'm just being loose there. I think it's not a great theory, but it's a theory. It's a good theory in one sense in that it covers all the data. Like anything you want to say in English, it does. And so that's how it's arguably the best. is that no other theory is as good as a large language model in predicting exactly what's good and what's bad in English.

Well, I don't know. Maybe I'm just being loose there. I think it's not a great theory, but it's a theory. It's a good theory in one sense in that it covers all the data. Like anything you want to say in English, it does. And so that's how it's arguably the best. is that no other theory is as good as a large language model in predicting exactly what's good and what's bad in English.

Now you're saying, is it a good theory? Well, probably not, because I want a smaller theory than that. It's too big. I agree.

Now you're saying, is it a good theory? Well, probably not, because I want a smaller theory than that. It's too big. I agree.

Now you're saying, is it a good theory? Well, probably not, because I want a smaller theory than that. It's too big. I agree.

Well, you know, that's, I mean, that presumes, and there's some evidence for this, that some large language models are implementing something like dependency grammar inside them. And so there's work from a guy called Chris Manning and colleagues over at Stanford in natural language.

Well, you know, that's, I mean, that presumes, and there's some evidence for this, that some large language models are implementing something like dependency grammar inside them. And so there's work from a guy called Chris Manning and colleagues over at Stanford in natural language.

Well, you know, that's, I mean, that presumes, and there's some evidence for this, that some large language models are implementing something like dependency grammar inside them. And so there's work from a guy called Chris Manning and colleagues over at Stanford in natural language.

And they looked at, I don't know how many large language model types, but certainly BERT and some others where you do some kind of

And they looked at, I don't know how many large language model types, but certainly BERT and some others where you do some kind of

And they looked at, I don't know how many large language model types, but certainly BERT and some others where you do some kind of

fancy math to figure out exactly what the sort of what kind of abstractions of representations are going on and they and they were saying it does look like dependency structure is is what they're constructing it doesn't like so it's actually a very very good map so kind of a they are constructing something like that um does it mean that you know that they're using that for meaning i mean probably but we don't know

fancy math to figure out exactly what the sort of what kind of abstractions of representations are going on and they and they were saying it does look like dependency structure is is what they're constructing it doesn't like so it's actually a very very good map so kind of a they are constructing something like that um does it mean that you know that they're using that for meaning i mean probably but we don't know

fancy math to figure out exactly what the sort of what kind of abstractions of representations are going on and they and they were saying it does look like dependency structure is is what they're constructing it doesn't like so it's actually a very very good map so kind of a they are constructing something like that um does it mean that you know that they're using that for meaning i mean probably but we don't know

It's just a general theory of language such that there's a form and a meaning pair for lots of pieces of the language. And so it's primarily usage-based, is the construction grammar. It's trying to deal with the things that people actually say, actually say and actually write. And so it's a usage-based idea. And what's a construction?

It's just a general theory of language such that there's a form and a meaning pair for lots of pieces of the language. And so it's primarily usage-based, is the construction grammar. It's trying to deal with the things that people actually say, actually say and actually write. And so it's a usage-based idea. And what's a construction?

It's just a general theory of language such that there's a form and a meaning pair for lots of pieces of the language. And so it's primarily usage-based, is the construction grammar. It's trying to deal with the things that people actually say, actually say and actually write. And so it's a usage-based idea. And what's a construction?