Adam Leventhal
๐ค SpeakerAppearances Over Time
Podcast Appearances
So, for example, if we designed when we did SP three, we designed what they called Group X, which was the group they added later for the 3D V cache and like max frequency skews. Maybe it's like a 240 or 280 watt max. But then we ran kind of a 225 watt CPU in there the entire time, giving us plenty of margin, plenty of headroom, which meant that, you know, our power subsystem was very clean.
So here we kind of are saying, hey, let's let's you know, we said, hey, we're going to start with group B as our target. We're going to see what does it cost us to fit group G? You know, does it actually cost us more stages, more inductors, more? more other parts. And, you know, then the first question of, can we cool, can you air cool 500 plus Watts, which is a different question entirely.
So here we kind of are saying, hey, let's let's you know, we said, hey, we're going to start with group B as our target. We're going to see what does it cost us to fit group G? You know, does it actually cost us more stages, more inductors, more? more other parts. And, you know, then the first question of, can we cool, can you air cool 500 plus Watts, which is a different question entirely.
No, that's the thing.
No, that's the thing.
I mean, right now we've done all of our, our worst case studies, which is basically saying, assume the CPU is going 500 Watts, right? All the dims are going at their maximum. You've got every SSD going at its maximum. and the NIC, and some amount of loss, you're paying some amount of loss for all the stages, we still think we can cool that.
I mean, right now we've done all of our, our worst case studies, which is basically saying, assume the CPU is going 500 Watts, right? All the dims are going at their maximum. You've got every SSD going at its maximum. and the NIC, and some amount of loss, you're paying some amount of loss for all the stages, we still think we can cool that.
And then practically speaking, even though the CPUs with turbo boosting have a good way to eat up the rest of your power, you're usually not getting all of those devices maxed out all at the same time.
And then practically speaking, even though the CPUs with turbo boosting have a good way to eat up the rest of your power, you're usually not getting all of those devices maxed out all at the same time.
They've also gotten a lot more clever about how they do all the hashing across stims.
They've also gotten a lot more clever about how they do all the hashing across stims.
Yeah, I mean, the P4 programmable nature of it for us is something that's actually really powerful. We leverage that in our switching silicon a lot and have been looking for something to get that into the NIC. The big challenge is just, I think where we're a little different is a lot of the DPUs have been designed to basically be like, we're the compute, the DPU is the computer in charge.
Yeah, I mean, the P4 programmable nature of it for us is something that's actually really powerful. We leverage that in our switching silicon a lot and have been looking for something to get that into the NIC. The big challenge is just, I think where we're a little different is a lot of the DPUs have been designed to basically be like, we're the compute, the DPU is the computer in charge.
And Hey, you big, big CPU. That's like running guests over there. Like, uh, you're subordinate to me. So like, yeah, you don't, you don't, you know, you exist, but like only at my pleasure. Uh, and we were not quite as, uh, split brain, uh, there slash we're not trying to sell the entire server.
And Hey, you big, big CPU. That's like running guests over there. Like, uh, you're subordinate to me. So like, yeah, you don't, you don't, you know, you exist, but like only at my pleasure. Uh, and we were not quite as, uh, split brain, uh, there slash we're not trying to sell the entire server.
So like, you know, it just gets thorny when it's like, okay, that, that device also needs its own DDR five.
So like, you know, it just gets thorny when it's like, okay, that, that device also needs its own DDR five.
Uh, some questions around like, Oh, but yeah,
Uh, some questions around like, Oh, but yeah,
Totally. Yeah. So when we end up designing for kind of not absolute density, but trying to get the best density in a fixed power budget, which because, you know, unlike the hyperscalers, we're not basically building a power plant next to every new DC. Yeah. that that's where it gets a little more challenging.