Jensen Huang

Distributed computing at the scale that we do, the CPU is a problem, the GPU is a problem, the networking is a problem, the switching is a problem.

and distributing the workload across all these computers are a problem.

It's just a massively complex computer science problem.

And so we just got to bring every technology to bear.

Otherwise,

We scale up linearly, or we scale up based on the capabilities of Moore's Law, which has largely slowed because Dennard's scaling has slowed.

There's the first question, which is, what is extreme co-design?

You were optimizing across the entire stack of software, from architectures to chips to systems to system software to the algorithms to the applications.

That's one layer.

The second thing that you and I just talked about goes beyond that.

cpus and gpus and networking chips and scale up switches and scale out switches and then of course you got to include power and cooling and all of that because you know all these computers are extremely extremely power power hungry they do a lot of work and they're very energy efficient but they in aggregate still consume a lot of power and so that's one the first question is what is it

The second question is, why is it?

And we just spoke about the reason you want to distribute the workload so that you can exceed the benefit of just increasing the number of computers.

And then the third question is, how is it?

How do you do it?

And that's kind of the miracle of this company.

When you're designing a computer, you have to have an operating system of computers.

When you're designing a company, you should first think about what is it that you want the company to produce?

I see a lot of companies' organization charts, and they all look the same.

Hamburger organization charts, software organization charts, and car company organization charts, they all look the same.