Nathan Lambert

super regions right in that the data center isn't physically like all of the gpus aren't physically on one site but they're like 30 miles from each other not gpus tpus right they have like in in iowa nebraska they have four data centers that are just like right next to each other why doesn't google flex its cluster size go to multi-data center training this is good images in there so i'll show you what i mean it's just uh semi-analysis multi-data center

super regions right in that the data center isn't physically like all of the gpus aren't physically on one site but they're like 30 miles from each other not gpus tpus right they have like in in iowa nebraska they have four data centers that are just like right next to each other why doesn't google flex its cluster size go to multi-data center training this is good images in there so i'll show you what i mean it's just uh semi-analysis multi-data center

super regions right in that the data center isn't physically like all of the gpus aren't physically on one site but they're like 30 miles from each other not gpus tpus right they have like in in iowa nebraska they have four data centers that are just like right next to each other why doesn't google flex its cluster size go to multi-data center training this is good images in there so i'll show you what i mean it's just uh semi-analysis multi-data center

So this is an image of what a standard Google data center looks like. By the way, their data centers look very different than anyone else's data centers.

So this is an image of what a standard Google data center looks like. By the way, their data centers look very different than anyone else's data centers.

So this is an image of what a standard Google data center looks like. By the way, their data centers look very different than anyone else's data centers.

So if you see this image, in the center there are these big rectangular boxes. Those are where the actual chips are kept. And then if you scroll down a little bit further, you can see there's these water pipes, there's these chiller cooling towers in the top, and a bunch of diesel generators. The diesel generators are backup power.

So if you see this image, in the center there are these big rectangular boxes. Those are where the actual chips are kept. And then if you scroll down a little bit further, you can see there's these water pipes, there's these chiller cooling towers in the top, and a bunch of diesel generators. The diesel generators are backup power.

So if you see this image, in the center there are these big rectangular boxes. Those are where the actual chips are kept. And then if you scroll down a little bit further, you can see there's these water pipes, there's these chiller cooling towers in the top, and a bunch of diesel generators. The diesel generators are backup power.

the data center itself is like look physically smaller than the water chillers, right? So the chips are actually easier to like keep together, but then like cooling all the water for the water cooling is very difficult, right? So Google has like a very advanced infrastructure that no one else has for the TPU.

the data center itself is like look physically smaller than the water chillers, right? So the chips are actually easier to like keep together, but then like cooling all the water for the water cooling is very difficult, right? So Google has like a very advanced infrastructure that no one else has for the TPU.

the data center itself is like look physically smaller than the water chillers, right? So the chips are actually easier to like keep together, but then like cooling all the water for the water cooling is very difficult, right? So Google has like a very advanced infrastructure that no one else has for the TPU.

And what they do is they've like stamped these data center, they've dumped a bunch of these data centers out in a few regions, right? So if you go a little bit further down, this is this is a Microsoft, this is an Arizona, this is where GPT five, quote, unquote, will be trained.

And what they do is they've like stamped these data center, they've dumped a bunch of these data centers out in a few regions, right? So if you go a little bit further down, this is this is a Microsoft, this is an Arizona, this is where GPT five, quote, unquote, will be trained.

And what they do is they've like stamped these data center, they've dumped a bunch of these data centers out in a few regions, right? So if you go a little bit further down, this is this is a Microsoft, this is an Arizona, this is where GPT five, quote, unquote, will be trained.

Yeah, if it doesn't exist already. But each of these data centers, I've shown a couple images of them. They're really closely co-located in the same region, Nebraska, Iowa. And then they also have a similar one in Ohio complex. And so these data centers are really close to each other. And what they've done is they've connected them super high bandwidth with fiber.

Yeah, if it doesn't exist already. But each of these data centers, I've shown a couple images of them. They're really closely co-located in the same region, Nebraska, Iowa. And then they also have a similar one in Ohio complex. And so these data centers are really close to each other. And what they've done is they've connected them super high bandwidth with fiber.

Yeah, if it doesn't exist already. But each of these data centers, I've shown a couple images of them. They're really closely co-located in the same region, Nebraska, Iowa. And then they also have a similar one in Ohio complex. And so these data centers are really close to each other. And what they've done is they've connected them super high bandwidth with fiber.

And so these are just a bunch of data centers. And the point here is that Google has a very advanced infrastructure. very tightly connected in a small region. So Elon will always have the biggest cluster fully connected, right? Because it's all in one building, right? And he's completely right on that, right?

And so these are just a bunch of data centers. And the point here is that Google has a very advanced infrastructure. very tightly connected in a small region. So Elon will always have the biggest cluster fully connected, right? Because it's all in one building, right? And he's completely right on that, right?