Yann LeCun
๐ค SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
The way we reason is that when we're faced with a complex problem or a complex question, we spend more time trying to solve it and answer it, right? Because it's more difficult.
The way we reason is that when we're faced with a complex problem or a complex question, we spend more time trying to solve it and answer it, right? Because it's more difficult.
Okay, whether it's difficult or not, the near future will say, because a lot of people are working on reasoning and planning abilities for dialogue systems. I mean, even if we restrict ourselves to language, just having the ability to plan your answer before you answer in terms that are not necessarily linked with the language you're going to use to produce the answer.
Okay, whether it's difficult or not, the near future will say, because a lot of people are working on reasoning and planning abilities for dialogue systems. I mean, even if we restrict ourselves to language, just having the ability to plan your answer before you answer in terms that are not necessarily linked with the language you're going to use to produce the answer.
Okay, whether it's difficult or not, the near future will say, because a lot of people are working on reasoning and planning abilities for dialogue systems. I mean, even if we restrict ourselves to language, just having the ability to plan your answer before you answer in terms that are not necessarily linked with the language you're going to use to produce the answer.
So this idea of this mental model that allows you to plan what you're going to say before you say it. That is very important. I think there's going to be a lot of systems over the next few years that are going to have this capability. But the blueprint of those systems would be extremely different from autoregressive LLMs. So
So this idea of this mental model that allows you to plan what you're going to say before you say it. That is very important. I think there's going to be a lot of systems over the next few years that are going to have this capability. But the blueprint of those systems would be extremely different from autoregressive LLMs. So
So this idea of this mental model that allows you to plan what you're going to say before you say it. That is very important. I think there's going to be a lot of systems over the next few years that are going to have this capability. But the blueprint of those systems would be extremely different from autoregressive LLMs. So
it's the same difference as the difference between what psychologists call system one and system two in humans, right? So system one is the type of tasks that you can accomplish without like deliberately, consciously think about how you do them. You just do them, you've done them enough that you can just do it subconsciously, right? Without thinking about them. If you're an experienced driver,
it's the same difference as the difference between what psychologists call system one and system two in humans, right? So system one is the type of tasks that you can accomplish without like deliberately, consciously think about how you do them. You just do them, you've done them enough that you can just do it subconsciously, right? Without thinking about them. If you're an experienced driver,
it's the same difference as the difference between what psychologists call system one and system two in humans, right? So system one is the type of tasks that you can accomplish without like deliberately, consciously think about how you do them. You just do them, you've done them enough that you can just do it subconsciously, right? Without thinking about them. If you're an experienced driver,
You can drive without really thinking about it, and you can talk to someone at the same time or listen to the radio, right? If you are a very experienced chess player, you can play against a non-experienced chess player without really thinking either. You just recognize the pattern and you play. Right? That's system one.
You can drive without really thinking about it, and you can talk to someone at the same time or listen to the radio, right? If you are a very experienced chess player, you can play against a non-experienced chess player without really thinking either. You just recognize the pattern and you play. Right? That's system one.
You can drive without really thinking about it, and you can talk to someone at the same time or listen to the radio, right? If you are a very experienced chess player, you can play against a non-experienced chess player without really thinking either. You just recognize the pattern and you play. Right? That's system one.
So all the things that you do instinctively without really having to deliberately plan and think about it. And then there is all the tasks where you need to plan. So if you are... and not to an experienced chess player, or you are experienced when you play against another experienced chess player. You think about all kinds of options, right? You think about it for a while, right?
So all the things that you do instinctively without really having to deliberately plan and think about it. And then there is all the tasks where you need to plan. So if you are... and not to an experienced chess player, or you are experienced when you play against another experienced chess player. You think about all kinds of options, right? You think about it for a while, right?
So all the things that you do instinctively without really having to deliberately plan and think about it. And then there is all the tasks where you need to plan. So if you are... and not to an experienced chess player, or you are experienced when you play against another experienced chess player. You think about all kinds of options, right? You think about it for a while, right?
You're much better if you have time to think about it than you are if you play Blitz with limited time. So this type of deliberate planning, which uses your internal world model, that's system two. This is what LLMs currently cannot do. So how do we get them to do this? How do we build a system that can do this kind of planning or reasoning that devotes
You're much better if you have time to think about it than you are if you play Blitz with limited time. So this type of deliberate planning, which uses your internal world model, that's system two. This is what LLMs currently cannot do. So how do we get them to do this? How do we build a system that can do this kind of planning or reasoning that devotes
You're much better if you have time to think about it than you are if you play Blitz with limited time. So this type of deliberate planning, which uses your internal world model, that's system two. This is what LLMs currently cannot do. So how do we get them to do this? How do we build a system that can do this kind of planning or reasoning that devotes