Lex Fridman
๐ค SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
You've propelled NVIDIA into a new era in AI, moving beyond its focus on chip-scale design to now rack-scale design.
And I think it's fair to say that winning for NVIDIA for a long time used to be about building the best GPU possible.
And you still do.
But now you've expanded that to extreme co-design of GPU, CPU, memory, networking, storage, power, cooling, software.
the rack itself, the pod that you've announced, and even the data center.
So let's talk about extreme co-design.
What is the hardest part of co-designing a system with that many complex components and design variables?
I'm sure there's trade-offs there.
Plus, you have a complete disparate disciplines here.
I'm sure you have specialists in each one of these, high bandwidth memory.
The networking, the NVLink, the NICS, the optics and the copper that you're doing, the power delivery, the cooling, all of that.
I mean, there's like world experts in each of those.
How do you get them in a room together to figure out- That's why my staff is so large.
Yeah.
Can you take me through the process of the specialists and the journalists, like-
How do you put together the rack when you know the set of things you have to shove into a rack together?
What does that process look like of designing it all together?
So you still have 60 reports.
You still have, of course.
And most stars at least have a foot in engineering.