Jordan Nanos

speaker

175 appearances 1 recordings 1 series first heard Sep 2026 last heard 2d ago

Jordan Nanos’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Sep 2026 with 1.

newest first · ▶ plays the moment

So in terms of performance, I think the biggest thing that we see change between providers is the network design.

The difference in how you set up a network for a hundred thousand GPUs is quite different than ten thousand and even smaller.

And some providers are going with non-standard networks.

In other words, they don't buy the switches and the NICs from NVIDIA.

Instead, they build them themselves.

I'm looking at Amazon EFA as an example there.

But others are just deciding to go with InfiniBand instead of Rocky, two different NVIDIA options.

This can really affect performance.

The other thing is just configuration.

To the

Yeah, to the downside.

Um and it's it's it's not necessarily that the physical hardware has any significant issue in it.

It's that let's say you are tr a customer and you're trying to use some open source piece of software.

So uh a VLM or SG Lang for inference comes out and they've got some new feature.

The people who have developed that software have likely been using an NVIDIA network.

Almost exclusively they use NVIDIA networks.

So how long does it take for you to get that software supported and performing well on your custom network?

I mean, this delay can be months and again, time is money.

Showing 41–60 of 175 · page 3 of 9