Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Azeem Azhar

๐Ÿ‘ค Speaker
6838 total appearances

Appearances Over Time

Podcast Appearances

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

Now, some of this, I think, is just expediency.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

It's just, let's take advantage of the changes.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

But some, I think, is real.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

We know, for example, that Google has done a deal with Commonwealth Fusion Systems for a 400 megawatt power tranche when their fusion reactor goes live in a few years.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

And

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

Helion Energy, which is another fusion company, has ties with Microsoft to power data centers.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

So this is a really, really significant problem.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

It's a big issue in the US, much less of an issue in China, where they've mastered the ability to deliver clean electrons at scale.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

There's also this squeeze coming in between inference, which is the bit of the AI activity that makes money, and training, which is when you're doing your product development for your next model.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

Model companies will be battling between where do they put their resources into training the next model or into serving customers for revenues today.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

They have lots of resources, but even those resources are not infinite.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

And earlier this week, Brookfield

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

which is an asset manager lined up with our estimates that in a few years, about 70 to 75% of compute cycles will be used on inference.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

So that's going to be a tension, right?

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

Do we pay bills today or do we build the next big thing in some different way?

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

And you see the labs.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

I mean, I think the contrast between Anthropic and OpenAI is most marked in how they approach that, right?

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

Anthropic appears to be rather more focused in thinking through the economics of that particular trade-off between training and inference.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

There are levers to address that.

Azeem Azhar's Exponential View
What it will take for AI to scale (energy, compute, talent)

Efficiency gains being one that is an obvious approach.