Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Jensen Huang

👤 Person
1523 total appearances

Appearances Over Time

Podcast Appearances

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

I just prelude it to maybe AI data processing processors, because guess what?

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

You need long-term memory.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

You need short-term memory.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

The KV cache processing is really intense.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

AI memory is a big deal.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

You kind of like your AI to have good memory.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

And just dealing with all the KV caching around the system, really complicated stuff.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

Maybe it wants to have a specialized processor.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

Maybe there's other things, right?

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

So you see that NVIDIA's are

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

Our viewpoint is now not GPU.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

Our viewpoint is looking at the entire AI infrastructure and what does it take for these incredible companies to get all of their workload through it, which is diverse and changing.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

Look at the transformer.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

The transformer architecture is changing incredibly, if not for the fact that CUDA is easy to operate on and iterate on,

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

How do they try all of their vast number of experiments to decide which of the transformer versions, what kind of attention algorithm to use?

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

How do you disaggregate?

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

CUDA helps you do all that because it's so programmable.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

And so the way to think about our business now is you look at when all of these ASIC companies or ASIC projects start,

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

three, four, five years ago, I got to tell you, that industry was super adorable and simple.

BG2Pod with Brad Gerstner and Bill Gurley
NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

There was a GPU involved.