Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Lennart Heim

👤 Person
531 total appearances

Appearances Over Time

Podcast Appearances

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

And before ChatGPT, there was not a lot of deployment.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

There were not many users.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

There were some nerds playing around with the API.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

But since then, again, I think many people are saying the fastest growing app ever.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

You need to serve millions of users, probably up until the hundreds of millions of users now.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

You need tons of GPUs there.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

And if everybody tries to ghiblify the image,

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

which we saw there at a GPU crunch.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

I mean, we were talking about history, right?

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

We started with like two GPUs, which was the breakthrough with LXNet.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

And now we go up, I think the biggest system we know with numbers of GPUs is around 100,000, which is like grok-free.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

It goes back to this whole deep secret.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

How do we measure this in terms of money?

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

Let's say there are two ways of measuring it.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

There's like how much you need to pay for getting these CPUs if you want to buy them.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

And NVIDIA stock is going up.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

They have a nice margin.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

So again, if you buy 100,000 chips, each chip costs you $40,000, right?

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

So we go up into the billions to just like get the AI chip, which makes up the large majority of the cost for building such a data center.

Azeem Azhar's Exponential View
China’s catching up to US AI… Here’s why it won’t matter

This might change in the future if the AI chip landscape becomes more competitive right now.