Ben Thompson
speaker
41,192 appearances
118 recordings
2 series
first heard Sep 2024
last heard 21 Aug
Ben Thompson’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 39 in all, peaking in Mar 2026 with 5.
Appearances
Like we need this part of the model, it loads only that part of the model into memory and then it's in memory for all the tokens.
podcast-host
Anyhow, regardless, they have all those on-device models are Apple models.
podcast-host
But how do you get small models?
podcast-host
Uh distill it down.
podcast-host
Distilling.
podcast-host
Exactly.
podcast-host
This is there there is a like they won't say distilling.
podcast-host
I think they said that Google derived or in conjunction with Google, basically what you do is you ask the big model questions and then you get answers and that's how you build your model.
podcast-host
These are Google distilled model legal above board.
podcast-host
distilling that's happening between apples.
podcast-host
It's not just legal having
podcast-host
Actual access to the model.
podcast-host
So the whole idea of generating tokens, there's actually multiple layers underneath.
podcast-host
If you're only getting access to the final output, it's it you can distill from that, but it's way more inefficient and you're not getting uh as broad of a coverage and understanding of the sort of parent model.
podcast-host
If you have actual access to the model, your distilling is far more effective.
podcast-host
And by the way,
podcast-host
When you're accessing most of these models online, including ChatGPT Anthropic, you're accessing a distilled model as it is.
podcast-host
No one's getting access to the real model because it'd be astronomically expensive and impossible to scale.
podcast-host
So even like the big models that are online are distilled to an extent.
podcast-host
And then and they they can do a good job of it because it's their model.
podcast-host
Showing 2741–2760 of 41,192 · page 138 of 2060
← Previous
Next →