Dylan Patel
๐ค SpeakerAppearances Over Time
Podcast Appearances
It's going to be a rough journey, but there will be some solutions like that that make sense. But there's a long tail where it's just on the internet.
It's going to be a rough journey, but there will be some solutions like that that make sense. But there's a long tail where it's just on the internet.
It's going to be a rough journey, but there will be some solutions like that that make sense. But there's a long tail where it's just on the internet.
Code and data is hard, but ideas is easy. Silicon Valley operates on the way that top employees get bought out by other companies for a pay raise. And a large reason why these companies do this is to bring ideas with them. And there are, there's no, I mean, in California, there's rules that like certain like non-competes or whatever are illegal in California.
Code and data is hard, but ideas is easy. Silicon Valley operates on the way that top employees get bought out by other companies for a pay raise. And a large reason why these companies do this is to bring ideas with them. And there are, there's no, I mean, in California, there's rules that like certain like non-competes or whatever are illegal in California.
Code and data is hard, but ideas is easy. Silicon Valley operates on the way that top employees get bought out by other companies for a pay raise. And a large reason why these companies do this is to bring ideas with them. And there are, there's no, I mean, in California, there's rules that like certain like non-competes or whatever are illegal in California.
And whether or not there's NDAs and things, that is how a lot of it happens. Recently, there was somebody from Gemini who helped make this 1 million contacts length. And everyone is saying the next Lama who, I mean, he went to the meta team is going to have 1 million contacts length. And that's kind of how the world works.
And whether or not there's NDAs and things, that is how a lot of it happens. Recently, there was somebody from Gemini who helped make this 1 million contacts length. And everyone is saying the next Lama who, I mean, he went to the meta team is going to have 1 million contacts length. And that's kind of how the world works.
And whether or not there's NDAs and things, that is how a lot of it happens. Recently, there was somebody from Gemini who helped make this 1 million contacts length. And everyone is saying the next Lama who, I mean, he went to the meta team is going to have 1 million contacts length. And that's kind of how the world works.
Everybody else, not me. I'm too oblivious and I am not single. So I'm safe from one espionage access.
Everybody else, not me. I'm too oblivious and I am not single. So I'm safe from one espionage access.
Everybody else, not me. I'm too oblivious and I am not single. So I'm safe from one espionage access.
Which is why nuclear is also good for it. Like long-term nuclear is a very natural fit, but you can't do solar or anything in the short term.
Which is why nuclear is also good for it. Like long-term nuclear is a very natural fit, but you can't do solar or anything in the short term.
Which is why nuclear is also good for it. Like long-term nuclear is a very natural fit, but you can't do solar or anything in the short term.
People should just go to Google, like scale, like what does X watts do and go through all the scales from one watt to a kilowatt to a megawatt. And you look and stare at that and you're how high on the list a gigawatt is. And it's mind blowing. Yeah.
People should just go to Google, like scale, like what does X watts do and go through all the scales from one watt to a kilowatt to a megawatt. And you look and stare at that and you're how high on the list a gigawatt is. And it's mind blowing. Yeah.
People should just go to Google, like scale, like what does X watts do and go through all the scales from one watt to a kilowatt to a megawatt. And you look and stare at that and you're how high on the list a gigawatt is. And it's mind blowing. Yeah.
Because at the end of pre-training is when you increase the context length for these models. And we've talked earlier in the conversation about how the context length, when you have a long input, is much easier to manage than output. And a lot of these post-training and reasoning techniques rely on a ton of sampling, and it's becoming increasingly long context.
Because at the end of pre-training is when you increase the context length for these models. And we've talked earlier in the conversation about how the context length, when you have a long input, is much easier to manage than output. And a lot of these post-training and reasoning techniques rely on a ton of sampling, and it's becoming increasingly long context.