Cal Newport
speaker
22,298 appearances
39 recordings
5 series
first heard Oct 2025
last heard 6d ago
Cal Newport’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 39 in all, peaking in Jun 2026 with 9.
Appearances
Okay, so that is where more or less we were.
podcast-host
This brings us up to speed to Astra.
podcast-host
Okay.
podcast-host
So what we have heard, the report from the information, and again, this is not confirmed by OpenAI.
podcast-host
So I'm just running off of their report.
podcast-host
I'm pulling the thread from that report.
podcast-host
It may turn out to be different.
podcast-host
But the report we have from the information is that Astra was implementing some variations of a collection of techniques from the research literature.
podcast-host
for reducing the amount of these chain of thought tokens required, yet to still get good type of results like you would if you did have this sort of rambling.
podcast-host
There's a name for it.
podcast-host
Loop transformers is one of the techniques.
podcast-host
Recurrent depth is another one of the techniques.
podcast-host
Confusingly, sometimes recurrent depth feels like it's an umbrella term that also includes loop transformers, but they're sort of techniques that are in the same family.
podcast-host
So we think...
podcast-host
Astra implements something like these techniques inside its implementation.
podcast-host
Now, how do these things work?
podcast-host
It's actually relatively straightforward.
podcast-host
Let me bring this back up on the screen here.
podcast-host
All right, so here we have our model of a large language model with the transformer blocks.
podcast-host
But notice now I've added a loop.
podcast-host
Showing 181–200 of 22,298 · page 10 of 1115
← Previous
Next →