Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Mandeep Singh

๐Ÿ‘ค Speaker
See mentions of this person in podcasts
94 total appearances

Appearances Over Time

Podcast Appearances

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And so from that perspective, H200, just on the training side, could be a pretty sizable $25 to $30 billion option.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

next year.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

Yeah, and that's where, you know, the continuity is the main point because what NVIDIA gives you is that backward compatibility.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

Even if you move to, you know, the newer version of their architecture, which NVIDIA will be releasing, Rubin.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And so, yes, Chinese market will be delayed from that standpoint.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

But what you want to see is they being able to use, you know, whenever the Blackwell version is available to the Chinese market, they should be able to use that because then it becomes...

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

a cluster that they could use for inferencing down the line.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

Right now, they use the same chips for training, but over time, they could use it for inferencing.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And what we have heard from the Neo Cloud providers here is the NVIDIA chips have a very long, useful life.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And everyone wants to use them for as long as possible.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And the Chinese market has no shortage of power, unlike the market here.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

So from that perspective, it does make sense for them to use

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

those clusters for as long as they can.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

Yeah, and look, every executive has called out tokens per watt as a key metric that they are focused on.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And that's a measure of intelligence, right?

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

So per unit of power, how many tokens can you generate?

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

So from that perspective, the Chinese market is no different.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

They want to maximize the tokens generated per watt for their model companies, even though they have more watts available.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And look, over here to your prior question, I mean, right now,

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

The estimates are we will probably be adding up to 100 gigawatts of capacity over the next five years.