Gavin Baker
speaker
1,686 appearances
2 recordings
1 series
first heard May 2026
last heard 4 Aug
Gavin Baker’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 2 in all, peaking in Aug 2026 with 1.
Appearances
We're such sample efficient learners relative to AI.
Many orders of magnitude.
Now we have a crude variant of continual learning today when something is verifiable and that's just reinforcement learning.
During mid-training, continual learning is a model that dynamically adjusts its weights or adjusts in some way in real time.
Like as a human, the first time I put my hand in a fire, I've learned I never put it in there before.
That model today needs to put its hand in the fire a million times and then have the designers effectively put a fire in the next training run or an R.
RL gym for it to learn.
I think it has to be dynamically updating the weights, but I think people are working on really smart techniques beyond this.
But if we get that,
then we have a really fast takeoff and people seem confident that continual learning is kind of just around the corner.
And I do think this is like the third big question.
Bitter lesson violation as a result of ASI are less likely human ingenuity.
Will frontier tokens still command the premium they do?
And will we get continual learning?
And if so, when?
And healthy for the world, it's good for Jensen too, because a different administration might take a different view.
Competition, I think, is good for everyone, and seeing different architectures explored is good.
And the reason is in tank design, they talk about the iron triangle.
The iron triangle of tank design is that all designers of a tank they have to make trade-offs between attack, defense, and mobility for obvious reasons.
More
Showing 1201–1220 of 1,686 · page 61 of 85
← Previous
Next →