Dwarkesh Patel
π€ SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
I guess that doesn't seem like the crux to me because I think those people would also agree that the overwhelming amount of compute in the future will come from learning from experience.
They just think that the scaffold or the basis of that
The thing you'll start with in order to pour in the compute to do this future experiential learning or on the job learning will be LLMs.
And so I guess I still don't understand why this is the wrong starting point altogether.
Why we need a whole new architecture to begin doing experiential continual learning and why we can't start with LLMs to do that.
Maybe it's interesting to compare this to humans.
So in both the case of learning from imitation versus experience and on the question of goals, I think there's some interesting analogies.
So, you know, kids will initially learn from imitation.
You don't think so?
No, of course not.
Really?
Yeah.
I think kids just like watch people.
They like kind of try to like say the same words.
I think the level- What about the first six months?
I think they're kind of imitating things.
They're trying to like make their mouth sound the way they see their mother's mouth sound.
And then they'll say the same words without understanding what they mean.
And as they get older, the complexity of the imitation they do increases.
So you're imitating maybe the skills that your people in your band are using to hunt down the deer or something.