Lex Fridman
๐ค SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
And just building up that intuition from every single task involved in putting together the data center, you start to immediately get a sense at the detailed scale and at the broad system scale of where the inefficiencies are.
And so you can make it more and more and more efficient.
Plus you have the big hammer of being able to say, let's do it totally different and remove all possible blockers.
Is there parallels in the NVIDIA Xtreme Systems co-design approach that you see in the way Elon approaches systems engineering?
In such incredibly complex systems that you're working with, is simplicity sometimes a good heuristic to reach for?
I mean, if I can just... I mean, the pod, the Vera Rubin pod that you announced is just incredible.
We're talking about seven chips, seven chip types, five purpose built rack types, 40 racks, 1.2 quadrillion transistors, nearly 20,000 NVIDIA DAIs,
over 1,100 Rubin GPUs, 60 exaflobs, 10 petabytes per second of scale bandwidth.
That's all just one.
That's just one pod.
That's just one pod.
Yeah, that's just one pod.
I mean, so you have the, and then even the NVL72 rack alone is 1.3 million components, 1,300 chips, 4,000 pounds crammed into a single 19-inch wide rack.
The amount of different components, I suppose simplicity is impossible, but is that a metric that you kind of reach for in trying to design things?
But some of the most incredible semiconductor industry broadly, but what NVIDIA is doing, some of the greatest engineering in history.
So these systems are just truly, truly marvels of engineering.
Yeah, the engineering teams.
I mean, I don't know.
It's not a competition, but I don't know.
If it was like an Olympics of engineering teams, I mean, TSMC does incredible engineering.