Dylan Patel
๐ค SpeakerAppearances Over Time
Podcast Appearances
And the idea with Monte Carlo tree search is that you would take an intermediate point in that train, do some sort of expansion, spend more compute, and then select the right one. That's like a very complex form of search that has been used in things like Mu0 and Alpha0 potentially. I know Mu0 does this.
And the idea with Monte Carlo tree search is that you would take an intermediate point in that train, do some sort of expansion, spend more compute, and then select the right one. That's like a very complex form of search that has been used in things like Mu0 and Alpha0 potentially. I know Mu0 does this.
There are many extensions to this. I would say the simplest one is that our language models to date have been designed to give the right answer the highest percentage of the time in one response. And we are now opening the door to different ways of running inference on our models in which we need to reevaluate many parts of the training process.
There are many extensions to this. I would say the simplest one is that our language models to date have been designed to give the right answer the highest percentage of the time in one response. And we are now opening the door to different ways of running inference on our models in which we need to reevaluate many parts of the training process.
There are many extensions to this. I would say the simplest one is that our language models to date have been designed to give the right answer the highest percentage of the time in one response. And we are now opening the door to different ways of running inference on our models in which we need to reevaluate many parts of the training process.
which normally opens the door to more progress, but we don't know if OpenAI changed a lot or if just sampling more and multiple choice is what they're doing or if it's something more complex where they change the training and they know that the inference mode is going to be different.
which normally opens the door to more progress, but we don't know if OpenAI changed a lot or if just sampling more and multiple choice is what they're doing or if it's something more complex where they change the training and they know that the inference mode is going to be different.
which normally opens the door to more progress, but we don't know if OpenAI changed a lot or if just sampling more and multiple choice is what they're doing or if it's something more complex where they change the training and they know that the inference mode is going to be different.
We are both NVIDIA bulls here, I would say. And in some ways, the market response is reasonable. NVIDIA's biggest customers in the US are major tech companies, and they're spending a ton on AI. And a simple interpretation of DeepSeek is you can get really good models without spending as much on AI.
We are both NVIDIA bulls here, I would say. And in some ways, the market response is reasonable. NVIDIA's biggest customers in the US are major tech companies, and they're spending a ton on AI. And a simple interpretation of DeepSeek is you can get really good models without spending as much on AI.
We are both NVIDIA bulls here, I would say. And in some ways, the market response is reasonable. NVIDIA's biggest customers in the US are major tech companies, and they're spending a ton on AI. And a simple interpretation of DeepSeek is you can get really good models without spending as much on AI.
So in that capacity, it's like, oh, maybe these big tech companies won't need to spend as much on AI and go down. The actual thing that happened, it's much more complex where there's social factors, where there's the rising in the app store, the social contagion that is happening. And then I think a lot of some of it is just like, I don't trade. I don't know anything about financial markets.
So in that capacity, it's like, oh, maybe these big tech companies won't need to spend as much on AI and go down. The actual thing that happened, it's much more complex where there's social factors, where there's the rising in the app store, the social contagion that is happening. And then I think a lot of some of it is just like, I don't trade. I don't know anything about financial markets.
So in that capacity, it's like, oh, maybe these big tech companies won't need to spend as much on AI and go down. The actual thing that happened, it's much more complex where there's social factors, where there's the rising in the app store, the social contagion that is happening. And then I think a lot of some of it is just like, I don't trade. I don't know anything about financial markets.
But it builds up over the weekend or the social pressure where it's like if it was during the week and there was multiple days of trading when this was really becoming, but it comes on the weekend and then everybody wants to sell. Yeah. And that is a social contagion.
But it builds up over the weekend or the social pressure where it's like if it was during the week and there was multiple days of trading when this was really becoming, but it comes on the weekend and then everybody wants to sell. Yeah. And that is a social contagion.
But it builds up over the weekend or the social pressure where it's like if it was during the week and there was multiple days of trading when this was really becoming, but it comes on the weekend and then everybody wants to sell. Yeah. And that is a social contagion.
We were trying to get GPUs on a short notice this week for a demo and it wasn't that easy. We were trying to get just like 16 or 32 H100s for a demo and it was not very easy.
We were trying to get GPUs on a short notice this week for a demo and it wasn't that easy. We were trying to get just like 16 or 32 H100s for a demo and it was not very easy.
We were trying to get GPUs on a short notice this week for a demo and it wasn't that easy. We were trying to get just like 16 or 32 H100s for a demo and it was not very easy.