Dr Sai Shivareddy
speaker
363 appearances
1 recordings
1 series
first heard Feb 2026
last heard 17 Feb
Dr Sai Shivareddy’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Feb 2026 with 1.
Appearances
So in your latest Blackwell racks, you know, it's 150 kilowatts of that peak.
But what they have to do is
Because of the excess headroom they need, you need almost 250 kilowatts of power.
And that's basically what you have in an NV72 AI rack, right?
And you contrast that with your normal CPU server, your normal data center, which was not even like 10 kilowatts per rack.
You've gone up like 25 times in like five years or whatever, since the first GPUs came, maybe it's like eight years or so.
And we just heard from NVIDIA that they're going to a megawatt in a rack in the next two years.
That's insane.
Power density raises, right?
I'm sure you've covered like aspects of cooling and all that.
So I think in the last 12 to 24 months, I was talking to a co-location provider or a virtual CPU or virtual machine provider recently, and they had this...
data center in phoenix where you had a cloud site that you know i think was 10 10 megawatts so you could have your steady loads at 10 megawatts and when they thought okay we can we can put 10 000 of these gpus each one one kilowatt for 10 megawatts they couldn't they could only use 5 000 because of these peak problems because of the spikes five megawatt goes to 10 megawatt spike
So you've got like millions of dollars of assets that you've acquired thinking that's what you could fit in.
And they didn't even know that they could not do it until they fit the machines in, the racks inside.
You sat on that inventory that you can't use, right?
So you've heard this many places, or you could use that 10,000, but throttle it down to less than 50% utilization to have that headroom.
So these problems are very different from, first of all, power problem.
Like one is steady load, other one is a highly dynamic peaky load.
Yes.
Now, how do you design a data center for native peaky loads?
Showing 201–220 of 363 · page 11 of 19
← Previous
Next →