Gavin Baker
speaker
1,686 appearances
2 recordings
1 series
first heard May 2026
last heard 4 Aug
Gavin Baker’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 2 in all, peaking in Aug 2026 with 1.
Appearances
There's this DRAM optimization.
I was unable to find a single AI engineer on planet Earth who believed that TurboQuant would have any impact on DRAM demand.
But nonetheless, a violation of Richard Sutton's bitter lesson: you know, more compute will always outperform human algorithmic ingenuity, more compute and data, chinchilla optimal, beyond chinchilla optimal, I guess what people increasingly do today.
That's a real risk, man.
The people who are building these models are skeptical of that risk.
The reason I am a little less skeptical is I think we're very close to ASI.
And who knows?
knows if the bitter lesson holds for 400 IQ models.
Maybe we get a temporary period where these, you know, if you get to ASI, the first thing it wants is probably to be smarter and have more resources.
How does it do that?
It makes itself more efficient.
I think that is an actual risk.
The bitter lesson literally, I believe, includes humans in it.
So we're about to find out whether the bitter lesson will find out if it applies to 300 IQ AIs, then 400, then 500, and 600.
And at some point, we may have like a temporary violation of the bitter lesson based upon AI.
Yeah, well, I think we've done a lot with memory through these harnesses.
And it turns out that harness engineering is not as important as the model, but it really matters.
And these harnesses in these models are increasingly being co-developed.
One of the big things a harness does, we just think of as like a runtime that the model operates in.
And it knows where the tools are.
Showing 1141–1160 of 1,686 · page 58 of 85
← Previous
Next →