Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Adam Leventhal

๐Ÿ‘ค Speaker
2711 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

So, for example, if we designed when we did SP three, we designed what they called Group X, which was the group they added later for the 3D V cache and like max frequency skews. Maybe it's like a 240 or 280 watt max. But then we ran kind of a 225 watt CPU in there the entire time, giving us plenty of margin, plenty of headroom, which meant that, you know, our power subsystem was very clean.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

So here we kind of are saying, hey, let's let's you know, we said, hey, we're going to start with group B as our target. We're going to see what does it cost us to fit group G? You know, does it actually cost us more stages, more inductors, more? more other parts. And, you know, then the first question of, can we cool, can you air cool 500 plus Watts, which is a different question entirely.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

So here we kind of are saying, hey, let's let's you know, we said, hey, we're going to start with group B as our target. We're going to see what does it cost us to fit group G? You know, does it actually cost us more stages, more inductors, more? more other parts. And, you know, then the first question of, can we cool, can you air cool 500 plus Watts, which is a different question entirely.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

No, that's the thing.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

No, that's the thing.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

I mean, right now we've done all of our, our worst case studies, which is basically saying, assume the CPU is going 500 Watts, right? All the dims are going at their maximum. You've got every SSD going at its maximum. and the NIC, and some amount of loss, you're paying some amount of loss for all the stages, we still think we can cool that.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

I mean, right now we've done all of our, our worst case studies, which is basically saying, assume the CPU is going 500 Watts, right? All the dims are going at their maximum. You've got every SSD going at its maximum. and the NIC, and some amount of loss, you're paying some amount of loss for all the stages, we still think we can cool that.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

And then practically speaking, even though the CPUs with turbo boosting have a good way to eat up the rest of your power, you're usually not getting all of those devices maxed out all at the same time.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

And then practically speaking, even though the CPUs with turbo boosting have a good way to eat up the rest of your power, you're usually not getting all of those devices maxed out all at the same time.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

They've also gotten a lot more clever about how they do all the hashing across stims.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

They've also gotten a lot more clever about how they do all the hashing across stims.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

Yeah, I mean, the P4 programmable nature of it for us is something that's actually really powerful. We leverage that in our switching silicon a lot and have been looking for something to get that into the NIC. The big challenge is just, I think where we're a little different is a lot of the DPUs have been designed to basically be like, we're the compute, the DPU is the computer in charge.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

Yeah, I mean, the P4 programmable nature of it for us is something that's actually really powerful. We leverage that in our switching silicon a lot and have been looking for something to get that into the NIC. The big challenge is just, I think where we're a little different is a lot of the DPUs have been designed to basically be like, we're the compute, the DPU is the computer in charge.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

And Hey, you big, big CPU. That's like running guests over there. Like, uh, you're subordinate to me. So like, yeah, you don't, you don't, you know, you exist, but like only at my pleasure. Uh, and we were not quite as, uh, split brain, uh, there slash we're not trying to sell the entire server.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

And Hey, you big, big CPU. That's like running guests over there. Like, uh, you're subordinate to me. So like, yeah, you don't, you don't, you know, you exist, but like only at my pleasure. Uh, and we were not quite as, uh, split brain, uh, there slash we're not trying to sell the entire server.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

So like, you know, it just gets thorny when it's like, okay, that, that device also needs its own DDR five.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

So like, you know, it just gets thorny when it's like, okay, that, that device also needs its own DDR five.

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

Uh, some questions around like, Oh, but yeah,

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

Uh, some questions around like, Oh, but yeah,

Oxide and Friends
Unshrouding Turin (or Benvenuto a Torino)

Totally. Yeah. So when we end up designing for kind of not absolute density, but trying to get the best density in a fixed power budget, which because, you know, unlike the hyperscalers, we're not basically building a power plant next to every new DC. Yeah. that that's where it gets a little more challenging.