Yann LeCun
๐ค SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
I mean, certainly scale is necessary, but not sufficient. Absolutely. So we certainly need computation. I mean, we're still far in terms of computer power. from what we would need to match the compute power of the human brain. This may occur in the next couple of decades, but we're still some ways away. And certainly in terms of power efficiency, we're really far.
I mean, certainly scale is necessary, but not sufficient. Absolutely. So we certainly need computation. I mean, we're still far in terms of computer power. from what we would need to match the compute power of the human brain. This may occur in the next couple of decades, but we're still some ways away. And certainly in terms of power efficiency, we're really far.
I mean, certainly scale is necessary, but not sufficient. Absolutely. So we certainly need computation. I mean, we're still far in terms of computer power. from what we would need to match the compute power of the human brain. This may occur in the next couple of decades, but we're still some ways away. And certainly in terms of power efficiency, we're really far.
So a lot of progress to make in hardware. And right now, a lot of the progress is not, I mean, there's a bit coming from silicon technology, but a lot of it coming from architectural innovation. And quite a bit coming from more efficient ways of implementing the architectures that have become popular, basically a combination of transformers and convnets, right?
So a lot of progress to make in hardware. And right now, a lot of the progress is not, I mean, there's a bit coming from silicon technology, but a lot of it coming from architectural innovation. And quite a bit coming from more efficient ways of implementing the architectures that have become popular, basically a combination of transformers and convnets, right?
So a lot of progress to make in hardware. And right now, a lot of the progress is not, I mean, there's a bit coming from silicon technology, but a lot of it coming from architectural innovation. And quite a bit coming from more efficient ways of implementing the architectures that have become popular, basically a combination of transformers and convnets, right?
So there's still some ways to go until... we're going to saturate, we're going to have to come up with new principles, new fabrication technology, new basic components, perhaps based on different principles than classical digital CMOS.
So there's still some ways to go until... we're going to saturate, we're going to have to come up with new principles, new fabrication technology, new basic components, perhaps based on different principles than classical digital CMOS.
So there's still some ways to go until... we're going to saturate, we're going to have to come up with new principles, new fabrication technology, new basic components, perhaps based on different principles than classical digital CMOS.
Well, if you want to make it ubiquitous, yeah, certainly. Because we're going to have to reduce the power consumption. A GPU today is half a kilowatt to a kilowatt. Human brain is about 25 watts. And a GPU is way below the power of the human brain. You need something like 100,000 or a million to match it. So we are off by a huge factor here.
Well, if you want to make it ubiquitous, yeah, certainly. Because we're going to have to reduce the power consumption. A GPU today is half a kilowatt to a kilowatt. Human brain is about 25 watts. And a GPU is way below the power of the human brain. You need something like 100,000 or a million to match it. So we are off by a huge factor here.
Well, if you want to make it ubiquitous, yeah, certainly. Because we're going to have to reduce the power consumption. A GPU today is half a kilowatt to a kilowatt. Human brain is about 25 watts. And a GPU is way below the power of the human brain. You need something like 100,000 or a million to match it. So we are off by a huge factor here.
So first of all, it's not going to be an event. The idea somehow, which is popularized by science fiction and Hollywood, that somehow somebody is going to discover the secret to AGI or human-level AI or AMI, whatever you want to call it, and then turn on a machine and then we have AGI. That's just not going to happen. It's not going to be an event. It's going to be gradual progress.
So first of all, it's not going to be an event. The idea somehow, which is popularized by science fiction and Hollywood, that somehow somebody is going to discover the secret to AGI or human-level AI or AMI, whatever you want to call it, and then turn on a machine and then we have AGI. That's just not going to happen. It's not going to be an event. It's going to be gradual progress.
So first of all, it's not going to be an event. The idea somehow, which is popularized by science fiction and Hollywood, that somehow somebody is going to discover the secret to AGI or human-level AI or AMI, whatever you want to call it, and then turn on a machine and then we have AGI. That's just not going to happen. It's not going to be an event. It's going to be gradual progress.
Are we going to have systems that can learn from video how the world works and learn good representations? Yeah. Before we get them to the scale and performance that we observe in humans, it's going to take quite a while. It's not going to happen in one day. Are we going to get systems that can have large amount of associative memory so they can remember stuff?
Are we going to have systems that can learn from video how the world works and learn good representations? Yeah. Before we get them to the scale and performance that we observe in humans, it's going to take quite a while. It's not going to happen in one day. Are we going to get systems that can have large amount of associative memory so they can remember stuff?
Are we going to have systems that can learn from video how the world works and learn good representations? Yeah. Before we get them to the scale and performance that we observe in humans, it's going to take quite a while. It's not going to happen in one day. Are we going to get systems that can have large amount of associative memory so they can remember stuff?
Yeah, but same, it's not going to happen tomorrow. I mean, there is some basic techniques that need to be developed. We have a lot of them, but to get this to work together with a full system is another story. Are we going to have systems that can reason and plan, perhaps along the lines of objective-driven AI architectures that I described before?
Yeah, but same, it's not going to happen tomorrow. I mean, there is some basic techniques that need to be developed. We have a lot of them, but to get this to work together with a full system is another story. Are we going to have systems that can reason and plan, perhaps along the lines of objective-driven AI architectures that I described before?