Dylan Patel
๐ค SpeakerAppearances Over Time
Podcast Appearances
To be clear, these sandboxes already exist in research. There are people who have built clones of all the most popular websites of Google, Amazon, blah, blah, blah, to make it so that there's... I mean, OpenAI probably has them internally to train these things. It's the same as DeepMind's robotics team for years has had clusters for robotics where you interact with robots fully remotely.
To be clear, these sandboxes already exist in research. There are people who have built clones of all the most popular websites of Google, Amazon, blah, blah, blah, to make it so that there's... I mean, OpenAI probably has them internally to train these things. It's the same as DeepMind's robotics team for years has had clusters for robotics where you interact with robots fully remotely.
To be clear, these sandboxes already exist in research. There are people who have built clones of all the most popular websites of Google, Amazon, blah, blah, blah, to make it so that there's... I mean, OpenAI probably has them internally to train these things. It's the same as DeepMind's robotics team for years has had clusters for robotics where you interact with robots fully remotely.
They just have a lab in London and you send tasks to it, arrange the blocks, and you do this research. Obviously, there's techs there that fix stuff, but... We've turned these cranks of automation before. You go from sandbox to progress, and then you add one more domain at a time and generalize.
They just have a lab in London and you send tasks to it, arrange the blocks, and you do this research. Obviously, there's techs there that fix stuff, but... We've turned these cranks of automation before. You go from sandbox to progress, and then you add one more domain at a time and generalize.
They just have a lab in London and you send tasks to it, arrange the blocks, and you do this research. Obviously, there's techs there that fix stuff, but... We've turned these cranks of automation before. You go from sandbox to progress, and then you add one more domain at a time and generalize.
In the history of NLP and language processing, instruction tuning in tasks per language model used to be like one language model did one task. And then in the instruction tuning literature, there's this point where you start adding more and more tasks together, where it just starts to generalize to every task. And we don't know where on this curve we are.
In the history of NLP and language processing, instruction tuning in tasks per language model used to be like one language model did one task. And then in the instruction tuning literature, there's this point where you start adding more and more tasks together, where it just starts to generalize to every task. And we don't know where on this curve we are.
In the history of NLP and language processing, instruction tuning in tasks per language model used to be like one language model did one task. And then in the instruction tuning literature, there's this point where you start adding more and more tasks together, where it just starts to generalize to every task. And we don't know where on this curve we are.
I think for reasoning with this RL and verifiable domains, we're early, but we don't know where the point is where you just start training on enough domains and poof, like more domains just start working and you've crossed the generalization barrier.
I think for reasoning with this RL and verifiable domains, we're early, but we don't know where the point is where you just start training on enough domains and poof, like more domains just start working and you've crossed the generalization barrier.
I think for reasoning with this RL and verifiable domains, we're early, but we don't know where the point is where you just start training on enough domains and poof, like more domains just start working and you've crossed the generalization barrier.
The big picture is that I don't think it's going to be a cliff. It's like we talked to a really good example of how growth changes is when meta added stories. So Snapchat was on an exponential. They added stories. It flatlined. Software engineers, then up until the right. AI is going to come in. It's probably just going to be flat. It's a lot like everyone's going to lose their job.
The big picture is that I don't think it's going to be a cliff. It's like we talked to a really good example of how growth changes is when meta added stories. So Snapchat was on an exponential. They added stories. It flatlined. Software engineers, then up until the right. AI is going to come in. It's probably just going to be flat. It's a lot like everyone's going to lose their job.
The big picture is that I don't think it's going to be a cliff. It's like we talked to a really good example of how growth changes is when meta added stories. So Snapchat was on an exponential. They added stories. It flatlined. Software engineers, then up until the right. AI is going to come in. It's probably just going to be flat. It's a lot like everyone's going to lose their job.
It's hard because the supply corrects more slowly. So the amount of students is still growing and that'll correct on a multi-year, like a year delay, but the amount of jobs will just turn. And then maybe in 20, 40 years, it'll be well down. But in the few years, there'll never going to be the snap moment where it's like software engineers aren't useful.
It's hard because the supply corrects more slowly. So the amount of students is still growing and that'll correct on a multi-year, like a year delay, but the amount of jobs will just turn. And then maybe in 20, 40 years, it'll be well down. But in the few years, there'll never going to be the snap moment where it's like software engineers aren't useful.
It's hard because the supply corrects more slowly. So the amount of students is still growing and that'll correct on a multi-year, like a year delay, but the amount of jobs will just turn. And then maybe in 20, 40 years, it'll be well down. But in the few years, there'll never going to be the snap moment where it's like software engineers aren't useful.
Kind of like, yes, adding the human... Designing the perfect Google button. Google's famous for having people design buttons that are so perfect. And it's like, how is AI going to do that? Like, they could give you all the ideas, but...
Kind of like, yes, adding the human... Designing the perfect Google button. Google's famous for having people design buttons that are so perfect. And it's like, how is AI going to do that? Like, they could give you all the ideas, but...