Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Hannah Petrovic

๐Ÿ‘ค Speaker
155 total appearances

Appearances Over Time

Podcast Appearances

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

And it seems to me that this part is infrastructure, and they're giving up big time to break into the infrastructure space.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

They have famously said like, oh, we want to get to a position where we are building gigawatts of power at a time, which is really ambitious, a very ambitious goal.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

Well, it makes sense from my perspective.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

If you think that the software part is rapidly depreciating, you might want to get in on this part of building and serving infrastructure at a scale.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

It's just a lot here, Matt.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

And I just see that there are two primary constraints here.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

If you want to scale up the infrastructure, you need enough GPUs and you need enough energy.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

It seems to me that energy right now is the thing that everyone talks about.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

It's something that we know how to solve.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

We know how to build energy.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

Like, you don't need that much energy, all things considered, if we need to build

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

10 gigawatts, 100 gigawatts of extra power, that's only a 10% increase over all installed capacity in the US.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

This has happened in the past, in the 2000s, they built enough gas infrastructure to match that level of expansion.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

The GPU part though, that's something very unique.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

That's something that right now is being chalked hold on production in a few factories in Taiwan, and they have been trying really hard to expand on it with pretty limited success.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

So it feels to me that that's probably where the bottleneck to scaling is going to end up being in the long term.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

Yeah, well, it's actually very interesting if you let me to build on top of this, because if you look at a fixed level of capabilities, you see this rapid growth where in order to achieve what models could do nine months ago, you already have pretty much an open model that's

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

I mean, it's going to be kind of there, right?

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

If you look at the Kimi 2.5 model, like it's arguably at the O3 level, the O3 being the model that OpenAI launched in April last year.

Azeem Azhar's Exponential View
Inside the economics of OpenAI (exclusive research)

If you look at that, then you see this rapid decrease, this rapid decrease in the amount of resources that you need in order to train and to deploy a model at a fixed level of capabilities.