Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
Maybe this is one of these things where I should try and get an LLM to help me.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
How to make it speakable.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
Maybe it's easier than you realize.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
I think it is easier.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
I think it's one idea or so.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
I think it's going to be something where, you know, the fact is it's a tree-structured language, just like human language is a tree-structured language.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
And I think it's going to be one of these things where one of the requirements that I've had is that whatever the spoken version is,
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
that dictation should be easy.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
That is, that shouldn't be the case that you have to relearn how the whole thing works.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
It should be the case that, you know, that open bracket is just a ah or something.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
And it's, you know, and then, but, you know, human language has a lot of tricks that are, I mean, for example, human language,
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
has features that are sort of optimized, keep things within the bounds that our brains can easily deal with.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
Like I tried to teach a transformer neural net to do parenthesis matching.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
It's pretty crummy at that.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
And then ChatGPT is similarly quite crummy at parenthesis matching.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
You can do it for small parenthesis things, for the same size of parenthesis things where if I look at it as a human, I can immediately say these are matched, these are not matched.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
But as soon as it gets big, as soon as it gets kind of to the point where sort of a deeper computation, it's hopeless.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
But the fact is that human language has avoided, for example, the deep sub-clauses.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
We arrange things so we don't end up with these incredibly deep things because brains are not well set up to deal with that.
Lex Fridman Podcast
#376 โ Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation
And it's found lots of tricks.