Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Mandeep Singh

๐Ÿ‘ค Speaker
See mentions of this person in podcasts
94 total appearances

Appearances Over Time

Podcast Appearances

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

We have heard commitments from OpenAI, which everyone has started to question now in terms of the 26 gigawatts that they have been talking about, but clearly the numbers are big in terms of the gigawatts that are in the pipeline in terms of the capacity that companies want to add.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

You know, the efficiency part when it comes to token per watt will remain a key metric because you won't be able to bring all that power online in the next 12 months, and it's going to be a lot more staggered than people can imagine.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

Yeah.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

Well, their notion of model layer as an intelligence layer is to open source a lot of their models.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And that's where they have kind of taken a different approach.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

The models are...

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

available for any company to use.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

In fact, they want to build an ecosystem outside of China where Europeans or other companies adopt their open source models.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

And from that perspective, they're trying to distill a lot of their models to smaller versions so that they can run on the phones.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

I just feel like they have espoused that open source concept and you see that with ByteDance and all these companies and they're trying to get to agentic use case a lot quicker in terms of models being able to book your travel or book your restaurant.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

We've seen that how good the WeChat app is in terms of being that super app.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

So that's what they're trying to get to with the agentic use cases is deploy a lot more of that using the LLM layer and do that at a very efficient price because at the end of the day, they have espoused cost and efficiency when it comes to running their infrastructure.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

So they want that to be reflected at the agent layer as well.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

Right, so for our workload specifically, for image and video, H200s are a little bit overkill for us, at least for the Hopper generation.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

But when we're actually...

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

Moving away from the Hopper architecture to Blackwell architecture, we're actually just going directly from H100s to B200s or B300s because that actually gives us more flops per watt or per dollar.

Bloomberg Tech
Nvidia Wins US Approval to Sell H200 Chips to China

We're actually moving over.

Bloomberg Tech
Meta Stock Surges on Plans for Metaverse Cuts

Yeah.

Bloomberg Tech
Meta Stock Surges on Plans for Metaverse Cuts

And look, I mean, based on consensus right now, we are talking about at least a 50% increase in capex or meta next year.

Bloomberg Tech
Meta Stock Surges on Plans for Metaverse Cuts

And no one, I think, would mind that given everyone's fees, there will be lift in revenue from AI down the line in the near term.