Jensen Huang
speaker
987 appearances
31 recordings
5 series
first heard Nov 2024
last heard 1 Sep
Jensen Huang’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 28 in all, peaking in Aug 2026 with 11.
Appearances
And so that that that's the reason why we bought Mellanox and started fusing InfiniBand and MV Link um in such an aggressive way.
And now look where MV Link is gonna go.
You know, the the compute fabric is going to going to um uh uh scale out.
uh what appears to be one incredible processor called a GPU.
Now we're gonna hundreds of GPUs that are gonna be working together.
You know, most most of these these computing challenges that we're dealing with now, one of the the the most exciting ones, of course, is is uh
Inference time scaling.
Has to do
with essentially uh generating tokens at incredibly low latency.
Mm-hmm.
Because you're self reflecting as you as you just mentioned.
I mean you're gonna be
You're gonna be uh uh doing tree search, you're you're gonna be doing chain of thought, you're gonna be doing probably some amount of simulation in your head, you're gonna be reflecting on your own answers.
Well, you're going to be prompting yourself and generating text to your in you know silently and still respond, hopefully in a second.
Well, uh the only way to do that is if your latency low your latency is extremely low.
Meanwhile, the data center is still about producing high throughput.
tokens because, you know, you still wanna keep cost down, you wanna keep the throughput high, you wanna right.
You know, generate a return.
And so these two fundamental things about a factory, low latency and high throughput.
The they're at odds with each other.
Showing 541–560 of 987 · page 28 of 50
← Previous
Next →