Casey Handmer
👤 SpeakerAppearances Over Time
Podcast Appearances
You could use laser links if you really needed to.
And that's it.
It's like this completely self-contained world of like... Because it's off-grid.
Yeah, of computation that occurs off-grid.
Like on private land somewhere in the backwoods of Texas where like no one lives and no one will ever live because it's completely inhospitable to humans.
It's like a megawatt per rack is what they're heading to now, which just seems bananas to me.
So let's get concrete here for a second.
Let's say you got one rack and it's one megawatt.
And I'll leave the cooling to someone who specializes in air conditioners.
But it's basically three air conditioners that are the problem.
And then you have batteries.
So in order to get four nines of uptime on this, you need, in South Texas, you actually need less than this.
But let's just say 24 hours worth of battery storage.
Because that means it'll get you through two bad nights in a row, basically.
And actually it turns out that you can significantly decrease power consumption with a very small reduction in overall compute.
So if you've got like three really bad days in a row or something, you can actually just like, you can dial back your power usage quite a lot without compromising your inference or training.
Okay, so you've got say a Tesla Powerwall, something like four megawatt hours.
So one megawatt rack and then six Tesla mega packs, each of which is roughly one truckload worth of stuff.
So like one truckload worth of rack and then like six truckloads worth of batteries.
And then in order to operate this at an average power of one megawatt, your solar arrays in Texas would be something like 25% utilization.