Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
It's syntactically correct.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
The nouns and the verbs are in the right place, but it just doesn't mean anything.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
And so there clearly is some rule that there are rules that determine when a sentence has the potential to be meaningful that go beyond the pure parts of speech syntax.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
And so the question is, what are those rules?
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
And are there a fairly finite set of those rules?
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
My guess is that there's a fairly finite set of those rules.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
And once you have those rules, you have a kind of a construction kit, just like the rules of syntactic grammar give you a construction kit for making syntactically correct sentences.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
So you can also have a construction kit for making semantically correct sentences.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
Those sentences may not be realized in the world,
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
I mean, I think, you know, the elephant flew to the moon.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
A syntactic, a semantically, you know, we know, we have an idea.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
If I say that to you, you kind of know what that means.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
But the fact is it hasn't been realized in the world, so to speak.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
with the things we're describing in language.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
It's a bit circular in the end, because you can, and the sort of boundaries of what is physically realizable.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
Okay, let's take the example of motion, okay?
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
Motion is a complicated concept.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
It might seem like it's a concept that should have been figured out by the Greeks long ago, but it's actually a really pretty complicated concept, because what is motion?
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
Motion is you can go from place A to place B, and it's still you when you get to the other end.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
You take an object, you move it, and it's still the same object, but it's in a different place.