Nathan Lambert
๐ค SpeakerAppearances Over Time
Podcast Appearances
And that's been over decades, right, of data centers, et cetera. It's been climbing, climbing slowly. But now, two to three percent. Now, by the end of this decade, it's, like, even under, like, you know, when I say, like, 10%, a lot of people that are traditionally, by, like, 2028, 2030, people traditionally non-traditional data center people, like, that's nuts.
And that's been over decades, right, of data centers, et cetera. It's been climbing, climbing slowly. But now, two to three percent. Now, by the end of this decade, it's, like, even under, like, you know, when I say, like, 10%, a lot of people that are traditionally, by, like, 2028, 2030, people traditionally non-traditional data center people, like, that's nuts.
But then, like, people who are in, like, AI who have, like, really looked at this at, like, the anthropics and open AIs are, like, that's not enough. And I'm, like, okay. But, like... you know, this is, this is both through, uh, globally distributed, uh, or distributed throughout the U S as well as like centralized clusters, right?
But then, like, people who are in, like, AI who have, like, really looked at this at, like, the anthropics and open AIs are, like, that's not enough. And I'm, like, okay. But, like... you know, this is, this is both through, uh, globally distributed, uh, or distributed throughout the U S as well as like centralized clusters, right?
But then, like, people who are in, like, AI who have, like, really looked at this at, like, the anthropics and open AIs are, like, that's not enough. And I'm, like, okay. But, like... you know, this is, this is both through, uh, globally distributed, uh, or distributed throughout the U S as well as like centralized clusters, right?
The, the distributed throughout the U S is, is exciting and it's the bulk of it, right? Like, Hey, you know, uh, open AI or, uh, you know, say meta is adding a gigawatt, right? Um, but most of it is distributed through the U S for inference and all these other things, right?
The, the distributed throughout the U S is, is exciting and it's the bulk of it, right? Like, Hey, you know, uh, open AI or, uh, you know, say meta is adding a gigawatt, right? Um, but most of it is distributed through the U S for inference and all these other things, right?
The, the distributed throughout the U S is, is exciting and it's the bulk of it, right? Like, Hey, you know, uh, open AI or, uh, you know, say meta is adding a gigawatt, right? Um, but most of it is distributed through the U S for inference and all these other things, right?
I thought I was about to do the Apple ad, right? What's a computer? So traditionally, data centers and data center tasks have been a distributed systems problem that is capable of being spread very far and widely, right? I.e., I send a request to Google, it gets routed to a data center somewhat close to me, it does whatever search ranking recommendation, sends a result back, right? Yeah.
I thought I was about to do the Apple ad, right? What's a computer? So traditionally, data centers and data center tasks have been a distributed systems problem that is capable of being spread very far and widely, right? I.e., I send a request to Google, it gets routed to a data center somewhat close to me, it does whatever search ranking recommendation, sends a result back, right? Yeah.
I thought I was about to do the Apple ad, right? What's a computer? So traditionally, data centers and data center tasks have been a distributed systems problem that is capable of being spread very far and widely, right? I.e., I send a request to Google, it gets routed to a data center somewhat close to me, it does whatever search ranking recommendation, sends a result back, right? Yeah.
The nature of the task is changing rapidly in that there's two tasks that people are really focused on now, right? It's not database access. It's not serve me the right page, serve me the right ad. It's now... A, inference. And inference is dramatically different from traditional distributed systems, but it looks a lot more similar. And then there's training, right?
The nature of the task is changing rapidly in that there's two tasks that people are really focused on now, right? It's not database access. It's not serve me the right page, serve me the right ad. It's now... A, inference. And inference is dramatically different from traditional distributed systems, but it looks a lot more similar. And then there's training, right?
The nature of the task is changing rapidly in that there's two tasks that people are really focused on now, right? It's not database access. It's not serve me the right page, serve me the right ad. It's now... A, inference. And inference is dramatically different from traditional distributed systems, but it looks a lot more similar. And then there's training, right?
The inference side is still like, hey, I'm going to put, you know, thousands of GPUs and, you know, blocks all around these data centers. I'm going to run models on them. You know, user submits a request, gets kicked off. Or, hey, my service, you know, they submit a request to my service, right? They're on Word and they're like, oh, yeah, help me copilot. And it kicks it off.
The inference side is still like, hey, I'm going to put, you know, thousands of GPUs and, you know, blocks all around these data centers. I'm going to run models on them. You know, user submits a request, gets kicked off. Or, hey, my service, you know, they submit a request to my service, right? They're on Word and they're like, oh, yeah, help me copilot. And it kicks it off.
The inference side is still like, hey, I'm going to put, you know, thousands of GPUs and, you know, blocks all around these data centers. I'm going to run models on them. You know, user submits a request, gets kicked off. Or, hey, my service, you know, they submit a request to my service, right? They're on Word and they're like, oh, yeah, help me copilot. And it kicks it off.
I'm on my Windows, copilot, whatever. Apple intelligence, whatever it is, it gets kicked off to a data center. right? And that data center does some work and sends it back. That's inference. That is going to be the bulk of compute. But then, you know, and that's like, you know, there's thousands of data centers that we're tracking with like satellites and like all these other things.
I'm on my Windows, copilot, whatever. Apple intelligence, whatever it is, it gets kicked off to a data center. right? And that data center does some work and sends it back. That's inference. That is going to be the bulk of compute. But then, you know, and that's like, you know, there's thousands of data centers that we're tracking with like satellites and like all these other things.
I'm on my Windows, copilot, whatever. Apple intelligence, whatever it is, it gets kicked off to a data center. right? And that data center does some work and sends it back. That's inference. That is going to be the bulk of compute. But then, you know, and that's like, you know, there's thousands of data centers that we're tracking with like satellites and like all these other things.