Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Traci Alloway

πŸ‘€ Speaker
1271 total appearances
Voice ID

Voice Profile Active

This person's voice can be automatically recognized across podcast episodes using AI voice matching.

Voice samples: 3
Confidence: High

Appearances Over Time

Podcast Appearances

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

Just on the compute exchange side of things, if someone is buying off the spot market, how do you guarantee, I'm not sure quality is the right word for this, but how do you guarantee they're getting what they expect?

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

Let's stick with the oil analogy for a second.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

You know, there's a few benchmarks that we all know about.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

There's Brent, there's WTI, there's others, but those are the two that we talk about.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

If we transpose this to chips for a second, okay, let's say you have an H100 index.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

We did an episode of the podcast last week, I think, with the CEO of Cerberus, which is another- It's an amazing company, yep.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

Yeah, but they're a different, another type of chip for inference.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

Is your assumption that these indices are going to be close enough to the cost such that if you're, okay, I'm running inference maybe on some service or TPUs or training, whatever, some of these others, that an H100 index will be good enough as a hedging instrument?

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

You mentioned volatility just then.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

I mean, the reason people need to hedge is because of volatility.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

Are you seeing enough of that in GPU prices that this model makes sense?

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

Because if it's just a steady line up or steady line down, it's going to be a kind of boring market.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

I'm always fascinated by, like, you know, we look at the Bloomberg terminal, for example, and there's a price on the screen and it's just there.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

And we started taking for granted that like it had to come from somewhere.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

And maybe some commodities have like a, you know, there's an existing exchange and a public price.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

And then there's also a lot of commodities, just bilateral trades.

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

What is the actual process by which you collect the most recent data?

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

So if you say, OK, an hour of H100 usage costs x, whatever it is right now, how did you assemble that number?

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

How did you gather that information from, say, the inference providers?

Odd Lots
Carmen Li's Plan to Build a Futures Market for Compute

But do you call them up?