Gavin Baker
๐ค SpeakerAppearances Over Time
Podcast Appearances
The best information I have is the largest cluster Microsoft has after panicking. It's still smaller than XAI's cluster in Memphis. If you didn't believe it was possible, you weren't even working on it. Grok 3 should take the lead if scaling laws hold in January or February.
The best information I have is the largest cluster Microsoft has after panicking. It's still smaller than XAI's cluster in Memphis. If you didn't believe it was possible, you weren't even working on it. Grok 3 should take the lead if scaling laws hold in January or February.
I thought it was... a really shocking statement from Mira Marotti that she resigned during a fundraise. That's the only way she can express disapproval of what is going on there and still probably get her money.
I thought it was... a really shocking statement from Mira Marotti that she resigned during a fundraise. That's the only way she can express disapproval of what is going on there and still probably get her money.
So I think, I think there's, there's a lot of reasons if scaling loss holds to be, to, to be optimistic about crock three. But I think, and then by the way, on the power question, and they are, you know, 23 and 24, it was just a panic to get GPUs and get them plugged in. Now we're, you know, trying to make them efficient and thoughtful, and to your point, re-architecting them.
So I think, I think there's, there's a lot of reasons if scaling loss holds to be, to, to be optimistic about crock three. But I think, and then by the way, on the power question, and they are, you know, 23 and 24, it was just a panic to get GPUs and get them plugged in. Now we're, you know, trying to make them efficient and thoughtful, and to your point, re-architecting them.
They have a little more compute and a lot more memory, which really matters. So per kind of unitive effect of compute, they're a lot more power efficient.
They have a little more compute and a lot more memory, which really matters. So per kind of unitive effect of compute, they're a lot more power efficient.
No, the H200s, probably not 2X, but a good increment. And the H100 was a great chip. So 50%, yeah. Yeah, Blackwell's just around the corner, and that's an entirely new architecture with an entirely new set of networking technologies.
No, the H200s, probably not 2X, but a good increment. And the H100 was a great chip. So 50%, yeah. Yeah, Blackwell's just around the corner, and that's an entirely new architecture with an entirely new set of networking technologies.
Right now, you have a friend in your pocket who has an IQ of 115, 110 maybe, but has all of the world's knowledge accessible to it. And that's what makes it amazing. I think this will be like you have a friend in your pocket, and they sometimes make things up. Again, they're very human. And a lot of humans, when they don't know the answer, they dissemble. These AIs do it too.
Right now, you have a friend in your pocket who has an IQ of 115, 110 maybe, but has all of the world's knowledge accessible to it. And that's what makes it amazing. I think this will be like you have a friend in your pocket, and they sometimes make things up. Again, they're very human. And a lot of humans, when they don't know the answer, they dissemble. These AIs do it too.
So you will have a friend in your pocket with an IQ of maybe 130 that knows everything, has more up-to-date knowledge of the world, and is more grounded in factual accuracy. And it is interesting for any question involving real-time information, mostly sports and finance. You know, I always, you know, if there's a stock down 25%, ask every AI, why is the stock down 25%?
So you will have a friend in your pocket with an IQ of maybe 130 that knows everything, has more up-to-date knowledge of the world, and is more grounded in factual accuracy. And it is interesting for any question involving real-time information, mostly sports and finance. You know, I always, you know, if there's a stock down 25%, ask every AI, why is the stock down 25%?
Generally, Grok is the one that knows. But I'm obviously biased.
Generally, Grok is the one that knows. But I'm obviously biased.
Grok knows.
Grok knows.
In the world today.
In the world today.