Lennart Heim
👤 PersonAppearances Over Time
Podcast Appearances
And before ChatGPT, there was not a lot of deployment.
There were not many users.
There were some nerds playing around with the API.
But since then, again, I think many people are saying the fastest growing app ever.
You need to serve millions of users, probably up until the hundreds of millions of users now.
You need tons of GPUs there.
And if everybody tries to ghiblify the image,
which we saw there at a GPU crunch.
I mean, we were talking about history, right?
We started with like two GPUs, which was the breakthrough with LXNet.
And now we go up, I think the biggest system we know with numbers of GPUs is around 100,000, which is like grok-free.
It goes back to this whole deep secret.
How do we measure this in terms of money?
Let's say there are two ways of measuring it.
There's like how much you need to pay for getting these CPUs if you want to buy them.
And NVIDIA stock is going up.
They have a nice margin.
So again, if you buy 100,000 chips, each chip costs you $40,000, right?
So we go up into the billions to just like get the AI chip, which makes up the large majority of the cost for building such a data center.
This might change in the future if the AI chip landscape becomes more competitive right now.