Jensen Huang
👤 PersonAppearances Over Time
Podcast Appearances
And of course, now we have to build even larger systems so we scale across multiple AI factories connected together.
And then we do this at an annual pace.
And so we now have an exponential of exponentials going ourselves from technology.
And that allows our customers to drive the cost of tokens down.
keep making those tokens smarter and smarter with pre-training and post-training and thinking.
And as a result, when the AI gets smarter, they get more used.
When they get more used, they're going to grow exponentially.
Extreme co-design means that you have to optimize the model, algorithm, system, and chip at the same time.
You have to innovate outside the box.
Because Moore's Law said you just have to keep making the CPU faster and faster.
Everything got faster.
You were innovating within a box.
Just make that chip faster.
Well, if that chip doesn't go any faster, then what are you going to do?
Innovate outside the box.
And so NVIDIA really changed things because we did two things.
We invented CUDA, invented GPUs, and we invented the idea of co-design at a very large scale.
That's why there's all these industries we're in.
We're creating all these libraries and co-design.
Number one, full stack.