Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Carmen Li

πŸ‘€ Speaker
328 total appearances
Voice ID

Voice Profile Active

This person's voice can be automatically recognized across podcast episodes using AI voice matching.

Voice samples: 1
Confidence: Medium

Appearances Over Time

Podcast Appearances

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

If you are naturally short GPU, which is everybody in this room, unless you tell me you have GPUs, then it depends how much you use.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

If you want to control your cost volatility, you want to use future to hedge as well.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

This is a great question.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

So I'm going to flip to slide, if you don't mind.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

We have visuals.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

More slides, yeah.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

So I usually don't like to use slides, but this time, because you mentioned a really good question, so we actually call it GPU lottery.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

So we published a paper earlier this year at GPGPU conference with Jefferson Lab on GPU performances.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

We actually, so we can have you create a link and, you know, to the audience later on.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

This is A100, by the way.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

I know we didn't put 10 on.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

This is A100, 40 gigabytes memory bandwidth.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

We proved there's 38% performance variance for the same chip, and then we decomposed it into the chip itself, intra-provider, and inter-provider.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

And there's many reasons for that, right?

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

And to your point, you don't know until you get your GPUs.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

We have a Pletsch for GPU, Carfax for GPU, depends how you look at it.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

So in Compute Change, you actually verify the GPU before delivered to you.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

So basically, you can RFQ for say, hey, I want a 200 by 200 nodes.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

Obviously, it will give you specs back and the commercial back.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

At the same time, independently verify the performances on flops, memory bandwidth, tokens, and other information, SLAs and other things.