Nathan Lambert

And obviously there's butting of heads here in the most simple terms.

And the U.S. 's current task is like, hey, if we control AI, if we're the leader in AI, and AI significantly accelerates progress, then we can maintain the global hegemony position. I hope that works. And as an American, like, you know, kind of like, okay, I guess that's going to lead to peace for us. Now, obviously, other people around the world get affected negatively.

And the U.S. 's current task is like, hey, if we control AI, if we're the leader in AI, and AI significantly accelerates progress, then we can maintain the global hegemony position. I hope that works. And as an American, like, you know, kind of like, okay, I guess that's going to lead to peace for us. Now, obviously, other people around the world get affected negatively.

And the U.S. 's current task is like, hey, if we control AI, if we're the leader in AI, and AI significantly accelerates progress, then we can maintain the global hegemony position. I hope that works. And as an American, like, you know, kind of like, okay, I guess that's going to lead to peace for us. Now, obviously, other people around the world get affected negatively.

You know, obviously, the Chinese people are not going to be in as advantageous of a position if that happens. But, you know, this is sort of the reality of like what's being done and the actions that are being carried out.

You know, obviously, the Chinese people are not going to be in as advantageous of a position if that happens. But, you know, this is sort of the reality of like what's being done and the actions that are being carried out.

You know, obviously, the Chinese people are not going to be in as advantageous of a position if that happens. But, you know, this is sort of the reality of like what's being done and the actions that are being carried out.

Yeah, so this goes, and I think we'd have to like, we need to dive really deep into the reasoning aspect and what's going on there. But the H20, you know, the US has gone through multiple iterations of the export controls, right? This H800 was at one point allowed back in 23, but then it got canceled. And by then, you know, DeepSeek had already built their cluster of, they claim 2K.

Yeah, so this goes, and I think we'd have to like, we need to dive really deep into the reasoning aspect and what's going on there. But the H20, you know, the US has gone through multiple iterations of the export controls, right? This H800 was at one point allowed back in 23, but then it got canceled. And by then, you know, DeepSeek had already built their cluster of, they claim 2K.

Yeah, so this goes, and I think we'd have to like, we need to dive really deep into the reasoning aspect and what's going on there. But the H20, you know, the US has gone through multiple iterations of the export controls, right? This H800 was at one point allowed back in 23, but then it got canceled. And by then, you know, DeepSeek had already built their cluster of, they claim 2K.

I think they actually have like many more, like something like 10K of those. And now this H20 is the legally allowed chip, right? NVIDIA shipped a million of these last year to China. For context, it was like four or five million GPUs. So the percentage of GPUs that were this China-specific H20 is quite high, roughly 20%, 25%, 20% or so.

I think they actually have like many more, like something like 10K of those. And now this H20 is the legally allowed chip, right? NVIDIA shipped a million of these last year to China. For context, it was like four or five million GPUs. So the percentage of GPUs that were this China-specific H20 is quite high, roughly 20%, 25%, 20% or so.

I think they actually have like many more, like something like 10K of those. And now this H20 is the legally allowed chip, right? NVIDIA shipped a million of these last year to China. For context, it was like four or five million GPUs. So the percentage of GPUs that were this China-specific H20 is quite high, roughly 20%, 25%, 20% or so.

And so this H20 has been neutered in one way, but it's actually upgraded in other ways. And you could think of chips along three axes for AI, ignoring software stack and exact architecture, just raw specifications. There's floating point operations, flops. There is memory bandwidth, i.e. in memory capacity, IO, memory. And then there is interconnect, chip-to-chip interconnections.

And so this H20 has been neutered in one way, but it's actually upgraded in other ways. And you could think of chips along three axes for AI, ignoring software stack and exact architecture, just raw specifications. There's floating point operations, flops. There is memory bandwidth, i.e. in memory capacity, IO, memory. And then there is interconnect, chip-to-chip interconnections.

And so this H20 has been neutered in one way, but it's actually upgraded in other ways. And you could think of chips along three axes for AI, ignoring software stack and exact architecture, just raw specifications. There's floating point operations, flops. There is memory bandwidth, i.e. in memory capacity, IO, memory. And then there is interconnect, chip-to-chip interconnections.

All three of these are incredibly important for... making AI systems, right? Because AI systems involve a lot of compute. They involve a lot of moving memory around, whether it be to memory or to other chips, right? And so these three vectors, the US initially had two of these vectors controlled and one of them not controlled, which was flops and interconnect bandwidth were initially controlled.

All three of these are incredibly important for... making AI systems, right? Because AI systems involve a lot of compute. They involve a lot of moving memory around, whether it be to memory or to other chips, right? And so these three vectors, the US initially had two of these vectors controlled and one of them not controlled, which was flops and interconnect bandwidth were initially controlled.

All three of these are incredibly important for... making AI systems, right? Because AI systems involve a lot of compute. They involve a lot of moving memory around, whether it be to memory or to other chips, right? And so these three vectors, the US initially had two of these vectors controlled and one of them not controlled, which was flops and interconnect bandwidth were initially controlled.

And then they said, no, no, no, no, we're going to remove the interconnect bandwidth and just make it a very simple only flops. But now NVIDIA can now make a chip that has, okay, it's cut down on flops. It's like one third that of the H100 on spec sheet paper performance for flops. In real world, it's closer to like half or maybe even like 60% of it.