Nathan Lambert

Now the next scale is something that's even bigger, right? And so, you know, Elon, just to stick on the topic, he's building his own natural gas plant, like a proper one right next door. He's deploying tons of Tesla Megapack batteries to make the power more smooth and all sorts of other things. He's got like industrial chillers, right? to cool the water down because he's water cooling the chips.

Now the next scale is something that's even bigger, right? And so, you know, Elon, just to stick on the topic, he's building his own natural gas plant, like a proper one right next door. He's deploying tons of Tesla Megapack batteries to make the power more smooth and all sorts of other things. He's got like industrial chillers, right? to cool the water down because he's water cooling the chips.

Um, so all these crazy things to, uh, get the clusters bigger and bigger. Um, but when you look at like, say what opening I did with Stargate, that's that in Arizona and, um, in Abilene, Texas, right. Uh, what they've announced at least, right. It's not built, right. Elon says they don't have the money. You know, there's some debates about this. Um,

Um, so all these crazy things to, uh, get the clusters bigger and bigger. Um, but when you look at like, say what opening I did with Stargate, that's that in Arizona and, um, in Abilene, Texas, right. Uh, what they've announced at least, right. It's not built, right. Elon says they don't have the money. You know, there's some debates about this. Um,

Um, so all these crazy things to, uh, get the clusters bigger and bigger. Um, but when you look at like, say what opening I did with Stargate, that's that in Arizona and, um, in Abilene, Texas, right. Uh, what they've announced at least, right. It's not built, right. Elon says they don't have the money. You know, there's some debates about this. Um,

But at full scale, at least the first section is like definitely money's accounted for, but there's multiple sections. But full scale, that data center is going to be 2.2 gigawatts, right? 2200 megawatts of power in and roughly like 1.8 gigawatts or 1800 megawatt. Yeah. 1800 megawatts of power delivered to chips, right? Now, this is an absurd scale.

But at full scale, at least the first section is like definitely money's accounted for, but there's multiple sections. But full scale, that data center is going to be 2.2 gigawatts, right? 2200 megawatts of power in and roughly like 1.8 gigawatts or 1800 megawatt. Yeah. 1800 megawatts of power delivered to chips, right? Now, this is an absurd scale.

But at full scale, at least the first section is like definitely money's accounted for, but there's multiple sections. But full scale, that data center is going to be 2.2 gigawatts, right? 2200 megawatts of power in and roughly like 1.8 gigawatts or 1800 megawatt. Yeah. 1800 megawatts of power delivered to chips, right? Now, this is an absurd scale.

2.2 gigawatts is like more than most cities, right? You know, to be clear, delivered to a single cluster that's connected to do training, right? To train these models, to do both the pre-training, the post-training, all of this stuff, right?

2.2 gigawatts is like more than most cities, right? You know, to be clear, delivered to a single cluster that's connected to do training, right? To train these models, to do both the pre-training, the post-training, all of this stuff, right?

2.2 gigawatts is like more than most cities, right? You know, to be clear, delivered to a single cluster that's connected to do training, right? To train these models, to do both the pre-training, the post-training, all of this stuff, right?

What is a nuclear power plant again? Everyone is doing this, right? Everyone is doing this, right? Meta in Louisiana, right? They're building two natural gas plants, massive ones, and then they're building this massive data center. Amazon has plans for this scale. Google has plans for this scale. XAI has plans for this scale, right? All of these, the guys that are racing...

What is a nuclear power plant again? Everyone is doing this, right? Everyone is doing this, right? Meta in Louisiana, right? They're building two natural gas plants, massive ones, and then they're building this massive data center. Amazon has plans for this scale. Google has plans for this scale. XAI has plans for this scale, right? All of these, the guys that are racing...

What is a nuclear power plant again? Everyone is doing this, right? Everyone is doing this, right? Meta in Louisiana, right? They're building two natural gas plants, massive ones, and then they're building this massive data center. Amazon has plans for this scale. Google has plans for this scale. XAI has plans for this scale, right? All of these, the guys that are racing...

The companies that are racing are racing hard and they're doing multi gigawatt data centers, right? To build this out because they think that, yeah, if I now have, you know, obviously pre-training scaling is going to continue, but to some extent, but then also all this post-training stuff where you have an RL sandbox for computer use or whatever, right? Like, you know,

The companies that are racing are racing hard and they're doing multi gigawatt data centers, right? To build this out because they think that, yeah, if I now have, you know, obviously pre-training scaling is going to continue, but to some extent, but then also all this post-training stuff where you have an RL sandbox for computer use or whatever, right? Like, you know,

The companies that are racing are racing hard and they're doing multi gigawatt data centers, right? To build this out because they think that, yeah, if I now have, you know, obviously pre-training scaling is going to continue, but to some extent, but then also all this post-training stuff where you have an RL sandbox for computer use or whatever, right? Like, you know,

This is where they're going to and all these fearful about viable domains where they just keep learning and learning and learning self play, whatever, whatever it is, makes the AI so much more capable because the line does go up, right? As you throw more compute, you get more performance. The shirt is about scaling laws. You know, to some extent, it is diminishing returns, right?

This is where they're going to and all these fearful about viable domains where they just keep learning and learning and learning self play, whatever, whatever it is, makes the AI so much more capable because the line does go up, right? As you throw more compute, you get more performance. The shirt is about scaling laws. You know, to some extent, it is diminishing returns, right?

This is where they're going to and all these fearful about viable domains where they just keep learning and learning and learning self play, whatever, whatever it is, makes the AI so much more capable because the line does go up, right? As you throw more compute, you get more performance. The shirt is about scaling laws. You know, to some extent, it is diminishing returns, right?