Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Dwarkesh Patel

πŸ‘€ Speaker
15656 total appearances
Voice ID

Voice Profile Active

This person's voice can be automatically recognized across podcast episodes using AI voice matching.

Voice samples: 1
Confidence: Medium

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

I guess that doesn't seem like the crux to me because I think those people would also agree that the overwhelming amount of compute in the future will come from learning from experience.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

They just think that the scaffold or the basis of that

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

The thing you'll start with in order to pour in the compute to do this future experiential learning or on the job learning will be LLMs.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

And so I guess I still don't understand why this is the wrong starting point altogether.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

Why we need a whole new architecture to begin doing experiential continual learning and why we can't start with LLMs to do that.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

Maybe it's interesting to compare this to humans.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

So in both the case of learning from imitation versus experience and on the question of goals, I think there's some interesting analogies.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

So, you know, kids will initially learn from imitation.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

You don't think so?

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

No, of course not.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

Really?

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

Yeah.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

I think kids just like watch people.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

They like kind of try to like say the same words.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

I think the level- What about the first six months?

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

I think they're kind of imitating things.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

They're trying to like make their mouth sound the way they see their mother's mouth sound.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

And then they'll say the same words without understanding what they mean.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

And as they get older, the complexity of the imitation they do increases.

Dwarkesh Podcast
Richard Sutton – Father of RL thinks LLMs are a dead-end

So you're imitating maybe the skills that your people in your band are using to hunt down the deer or something.