Nathan Lambert
๐ค SpeakerAppearances Over Time
Podcast Appearances
Yeah, yeah. So air cooling has been the de facto standard. Throw a bunch of metal, heat pipes, et cetera, and fans, right? And like that's cooled. That's been enough to cool it. People have been dabbling in water cooling. Google's TPUs are water cooled. Right. So they've been doing that for a few years.
Yeah, yeah. So air cooling has been the de facto standard. Throw a bunch of metal, heat pipes, et cetera, and fans, right? And like that's cooled. That's been enough to cool it. People have been dabbling in water cooling. Google's TPUs are water cooled. Right. So they've been doing that for a few years.
Yeah, yeah. So air cooling has been the de facto standard. Throw a bunch of metal, heat pipes, et cetera, and fans, right? And like that's cooled. That's been enough to cool it. People have been dabbling in water cooling. Google's TPUs are water cooled. Right. So they've been doing that for a few years.
But with GPUs, no one's ever done and no one's ever done the scale of water cooling that Elon just did. Right. Now, next generation NVIDIA is for the for the like highest end GPU. It is mandatory water cooling. You have to water cool it. But Elon did it on this current generation NVIDIA. And that required a lot of stuff, right?
But with GPUs, no one's ever done and no one's ever done the scale of water cooling that Elon just did. Right. Now, next generation NVIDIA is for the for the like highest end GPU. It is mandatory water cooling. You have to water cool it. But Elon did it on this current generation NVIDIA. And that required a lot of stuff, right?
But with GPUs, no one's ever done and no one's ever done the scale of water cooling that Elon just did. Right. Now, next generation NVIDIA is for the for the like highest end GPU. It is mandatory water cooling. You have to water cool it. But Elon did it on this current generation NVIDIA. And that required a lot of stuff, right?
If you look at like some of the satellite photos and stuff of the Memphis facility, there's all these external water chillers that are sitting basically, it looks like a semi-truck pod thing. What's it called? The container. But really those are water chillers. And he has like 90 of those water chillers just sitting outside. 90 different containers, right?
If you look at like some of the satellite photos and stuff of the Memphis facility, there's all these external water chillers that are sitting basically, it looks like a semi-truck pod thing. What's it called? The container. But really those are water chillers. And he has like 90 of those water chillers just sitting outside. 90 different containers, right?
If you look at like some of the satellite photos and stuff of the Memphis facility, there's all these external water chillers that are sitting basically, it looks like a semi-truck pod thing. What's it called? The container. But really those are water chillers. And he has like 90 of those water chillers just sitting outside. 90 different containers, right?
With water, you know, that chill the water, bring it back to the data center, and then you distribute it to all the chips, pull all the heat out, and then send it back, right? And this is both a way to cool the chips, but also an efficiency thing. And going back to that three-vector thing, there is memory bandwidth, flops, and interconnect.
With water, you know, that chill the water, bring it back to the data center, and then you distribute it to all the chips, pull all the heat out, and then send it back, right? And this is both a way to cool the chips, but also an efficiency thing. And going back to that three-vector thing, there is memory bandwidth, flops, and interconnect.
With water, you know, that chill the water, bring it back to the data center, and then you distribute it to all the chips, pull all the heat out, and then send it back, right? And this is both a way to cool the chips, but also an efficiency thing. And going back to that three-vector thing, there is memory bandwidth, flops, and interconnect.
The closer the chips are together, the easier it is to do high-speed interconnects. And so this is also a reason why you're going to go water cooling is because you can just put the chips right next to each other and therefore get higher speed connectivity.
The closer the chips are together, the easier it is to do high-speed interconnects. And so this is also a reason why you're going to go water cooling is because you can just put the chips right next to each other and therefore get higher speed connectivity.
The closer the chips are together, the easier it is to do high-speed interconnects. And so this is also a reason why you're going to go water cooling is because you can just put the chips right next to each other and therefore get higher speed connectivity.
There's another word there, but I won't say it, you know?
There's another word there, but I won't say it, you know?
There's another word there, but I won't say it, you know?
Today, individual largest is Elon, right?
Today, individual largest is Elon, right?