Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Nathan Lambert

๐Ÿ‘ค Speaker
1665 total appearances

Appearances Over Time

Podcast Appearances

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

And that's been over decades, right, of data centers, et cetera. It's been climbing, climbing slowly. But now, two to three percent. Now, by the end of this decade, it's, like, even under, like, you know, when I say, like, 10%, a lot of people that are traditionally, by, like, 2028, 2030, people traditionally non-traditional data center people, like, that's nuts.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

And that's been over decades, right, of data centers, et cetera. It's been climbing, climbing slowly. But now, two to three percent. Now, by the end of this decade, it's, like, even under, like, you know, when I say, like, 10%, a lot of people that are traditionally, by, like, 2028, 2030, people traditionally non-traditional data center people, like, that's nuts.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

But then, like, people who are in, like, AI who have, like, really looked at this at, like, the anthropics and open AIs are, like, that's not enough. And I'm, like, okay. But, like... you know, this is, this is both through, uh, globally distributed, uh, or distributed throughout the U S as well as like centralized clusters, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

But then, like, people who are in, like, AI who have, like, really looked at this at, like, the anthropics and open AIs are, like, that's not enough. And I'm, like, okay. But, like... you know, this is, this is both through, uh, globally distributed, uh, or distributed throughout the U S as well as like centralized clusters, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

But then, like, people who are in, like, AI who have, like, really looked at this at, like, the anthropics and open AIs are, like, that's not enough. And I'm, like, okay. But, like... you know, this is, this is both through, uh, globally distributed, uh, or distributed throughout the U S as well as like centralized clusters, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The, the distributed throughout the U S is, is exciting and it's the bulk of it, right? Like, Hey, you know, uh, open AI or, uh, you know, say meta is adding a gigawatt, right? Um, but most of it is distributed through the U S for inference and all these other things, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The, the distributed throughout the U S is, is exciting and it's the bulk of it, right? Like, Hey, you know, uh, open AI or, uh, you know, say meta is adding a gigawatt, right? Um, but most of it is distributed through the U S for inference and all these other things, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The, the distributed throughout the U S is, is exciting and it's the bulk of it, right? Like, Hey, you know, uh, open AI or, uh, you know, say meta is adding a gigawatt, right? Um, but most of it is distributed through the U S for inference and all these other things, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

I thought I was about to do the Apple ad, right? What's a computer? So traditionally, data centers and data center tasks have been a distributed systems problem that is capable of being spread very far and widely, right? I.e., I send a request to Google, it gets routed to a data center somewhat close to me, it does whatever search ranking recommendation, sends a result back, right? Yeah.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

I thought I was about to do the Apple ad, right? What's a computer? So traditionally, data centers and data center tasks have been a distributed systems problem that is capable of being spread very far and widely, right? I.e., I send a request to Google, it gets routed to a data center somewhat close to me, it does whatever search ranking recommendation, sends a result back, right? Yeah.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

I thought I was about to do the Apple ad, right? What's a computer? So traditionally, data centers and data center tasks have been a distributed systems problem that is capable of being spread very far and widely, right? I.e., I send a request to Google, it gets routed to a data center somewhat close to me, it does whatever search ranking recommendation, sends a result back, right? Yeah.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The nature of the task is changing rapidly in that there's two tasks that people are really focused on now, right? It's not database access. It's not serve me the right page, serve me the right ad. It's now... A, inference. And inference is dramatically different from traditional distributed systems, but it looks a lot more similar. And then there's training, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The nature of the task is changing rapidly in that there's two tasks that people are really focused on now, right? It's not database access. It's not serve me the right page, serve me the right ad. It's now... A, inference. And inference is dramatically different from traditional distributed systems, but it looks a lot more similar. And then there's training, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The nature of the task is changing rapidly in that there's two tasks that people are really focused on now, right? It's not database access. It's not serve me the right page, serve me the right ad. It's now... A, inference. And inference is dramatically different from traditional distributed systems, but it looks a lot more similar. And then there's training, right?

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The inference side is still like, hey, I'm going to put, you know, thousands of GPUs and, you know, blocks all around these data centers. I'm going to run models on them. You know, user submits a request, gets kicked off. Or, hey, my service, you know, they submit a request to my service, right? They're on Word and they're like, oh, yeah, help me copilot. And it kicks it off.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The inference side is still like, hey, I'm going to put, you know, thousands of GPUs and, you know, blocks all around these data centers. I'm going to run models on them. You know, user submits a request, gets kicked off. Or, hey, my service, you know, they submit a request to my service, right? They're on Word and they're like, oh, yeah, help me copilot. And it kicks it off.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

The inference side is still like, hey, I'm going to put, you know, thousands of GPUs and, you know, blocks all around these data centers. I'm going to run models on them. You know, user submits a request, gets kicked off. Or, hey, my service, you know, they submit a request to my service, right? They're on Word and they're like, oh, yeah, help me copilot. And it kicks it off.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

I'm on my Windows, copilot, whatever. Apple intelligence, whatever it is, it gets kicked off to a data center. right? And that data center does some work and sends it back. That's inference. That is going to be the bulk of compute. But then, you know, and that's like, you know, there's thousands of data centers that we're tracking with like satellites and like all these other things.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

I'm on my Windows, copilot, whatever. Apple intelligence, whatever it is, it gets kicked off to a data center. right? And that data center does some work and sends it back. That's inference. That is going to be the bulk of compute. But then, you know, and that's like, you know, there's thousands of data centers that we're tracking with like satellites and like all these other things.

Lex Fridman Podcast
#459 โ€“ DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters

I'm on my Windows, copilot, whatever. Apple intelligence, whatever it is, it gets kicked off to a data center. right? And that data center does some work and sends it back. That's inference. That is going to be the bulk of compute. But then, you know, and that's like, you know, there's thousands of data centers that we're tracking with like satellites and like all these other things.