Ben Thompson

speaker
42,103 appearances 120 recordings 2 series first heard Sep 2024 last heard 21 Aug

Ben Thompson’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months
5 · Mar OctJan 26AprJulnow

Recordings per month over the last 12 months — 39 in all, peaking in Mar 2026 with 5.

Appearances

newest first · ▶ plays the moment
There is a limit to how much compute you might want for humans. podcast-host
The limiter is how many humans there are and like how much stuff they can come up with. podcast-host
But at least in theory, the limit for computers doing computing and especially once they're doing their own programming and and spinning up their own sorts of things is effectively infinite. podcast-host
The you're going to need to store all this context. podcast-host
And again, there's lots of innovations around here, whether you're on batching or caching or or podcast-host
or like, you know, some prompts have the same sort of context and so you can put those together. podcast-host
Well, there's all sorts of things that are g people are going to figure out and they're gonna innovate on these in lots of ways. podcast-host
They're gonna podcast-host
But podcast-host
as long the the idea of there's a concept called a memory hierarchy. podcast-host
So podcast-host
With traditional computing, like your typical CPU, you have registers, which is like the actual data that's being processed. podcast-host
Then you have like L1 cache, L two cache, maybe L3 cache. podcast-host
This is all storage on the chip itself. podcast-host
One of the reasons Apple's M chips are really fast is they have a lot of cash. podcast-host
And so it's like right there on the chip, all the like a lot of the core foundational like options. podcast-host
operating system stuff. podcast-host
They they've done a lot of inj this is where their integration is really paid off to make sure everything is like super available and executes very, very quickly. podcast-host
But then from there you go out to RAM. podcast-host
Yeah. podcast-host
Showing 3481–3500 of 42,103 · page 175 of 2106 ← Previous Next →