Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Azeem Azhar

๐Ÿ‘ค Speaker
5487 total appearances

Appearances Over Time

Podcast Appearances

Azeem Azhar's Exponential View
The demand for infinite compute

In other words, we consumed a lot more, astronomically more compute in 2023 over an astronomically large computing infrastructure in 2023 compared to that wonderful year of 1972.

Azeem Azhar's Exponential View
The demand for infinite compute

It's a combination of there being many more computers, not just mainframes and mini computers, but also laptops, supercomputers, and of course, our smartphones.

Azeem Azhar's Exponential View
The demand for infinite compute

And those computers themselves were much more powerful thanks to Moore's law, making them powerful, more powerful every year.

Azeem Azhar's Exponential View
The demand for infinite compute

It turns out that in that 50 or so year, every single year we saw 62% growth in the total computational stock on the planet.

Azeem Azhar's Exponential View
The demand for infinite compute

62% compounded for 50 years is a big astronomical number.

Azeem Azhar's Exponential View
The demand for infinite compute

So we've really shown that we like having this stuff around, even though lots of the time it sits idle.

Azeem Azhar's Exponential View
The demand for infinite compute

And the truth is there's a ton of it out there.

Azeem Azhar's Exponential View
The demand for infinite compute

I mean, I reckon, and I may be wrong by an order of magnitude, that there's about 10 to the 22 flops

Azeem Azhar's Exponential View
The demand for infinite compute

of compute stock in the world as of 2023, where a flop is a floating point operation.

Azeem Azhar's Exponential View
The demand for infinite compute

So it's like an instruction that the computer is carrying out.

Azeem Azhar's Exponential View
The demand for infinite compute

When we think about these new AI factories, these gargantuan data centers with chips optimized to serve AI models, they're going to be filled with incredibly powerful chips.

Azeem Azhar's Exponential View
The demand for infinite compute

I mean, think of the Nvidia ones.

Azeem Azhar's Exponential View
The demand for infinite compute

It's a $5 trillion company.

Azeem Azhar's Exponential View
The demand for infinite compute

It shipped about 7 million of these GPUs this year.

Azeem Azhar's Exponential View
The demand for infinite compute

And they probably added several Zeta Flops to the stock of computing.

Azeem Azhar's Exponential View
The demand for infinite compute

What's a Zeta Flop?

Azeem Azhar's Exponential View
The demand for infinite compute

A Zeta Flop is 10 to the 21.

Azeem Azhar's Exponential View
The demand for infinite compute

So, you know, meaningful addition to the existing stock of computing.

Azeem Azhar's Exponential View
The demand for infinite compute

And the thing is that all of this compute is actually being used.

Azeem Azhar's Exponential View
The demand for infinite compute

I mean, if you listen to analysts and you talk to the companies as I do, you hear that they are running short of compute.