Ben Thompson

speaker

41,192 appearances 118 recordings 2 series first heard Sep 2024 last heard 21 Aug

Ben Thompson’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 39 in all, peaking in Mar 2026 with 5.

newest first · ▶ plays the moment

Okay. podcast-host

Uh what's next? podcast-host

For these models, we use none of the models that Google deploys to their customers. podcast-host

Uh podcast-host

They don't use the exact same model that Google podcast-host

Gives their customers. podcast-host

Now that is uh that is correct, nor do we use the infrastructure. podcast-host

Okay. podcast-host

So, but where what are they actually doing? podcast-host

So Apple has, I think it's five models, uh, several of them on device, and then one that's in the cloud. podcast-host

So all the ones that are in device are Apple's own models. podcast-host

And by the way, I was uh uh are Apple's own models. podcast-host

Those models are, of course, because they're on device, very small. podcast-host

Now, one of them is pretty interesting. podcast-host

It's actually quite large, a twenty billion parameter model that were only part of it is loaded in memory at the time. podcast-host

Uh it's called a mixture of experts. podcast-host

Usually for mixture of experts, you load a different ex or use a different expert every token. podcast-host

So it's always like which means you have to have the whole thing in memory. podcast-host

In this case, you do an expert per query. podcast-host

So they so when you make a query, it's podcast-host

Showing 2721–2740 of 41,192 · page 137 of 2060

Heard on

Something wrong?

Each row has a “Not Ben Thompson?” link; anything else, tell us.