Mark Zuckerberg
π€ SpeakerAppearances Over Time
Podcast Appearances
I mean, it's not, it has issues just like any other human system.
But yes, I mean, the balance is, I mean, it's amazing what they've been able to achieve, but it's also not perfect.
And I think that there's still a lot of challenges.
And I think that there's also a lot of questions about whether the current architecture for LLMs
as you continue scaling it, what happens?
A lot of what's been exciting in the last year
is that there's clearly a qualitative breakthrough where, you know, with some of the GPT models that OpenAI put out and that others have been able to do as well, I think it reached a kind of level of quality where people are like, wow, this feels different and like it's gonna be able to be the foundation for building a lot of awesome products and experiences and value.
But I think that the other realization that people have is, wow, we just made a breakthrough.
If there are other breakthroughs quickly, then I think that there's the sense that maybe we're closer to general intelligence.
But I think that that idea is predicated on the idea that I think people believe that there's still generally a bunch of additional breakthroughs to make and that we just don't know how long it's going to take to get there.
And one view that some people have, this doesn't tend to be my view as much, is that simply...
scaling the current LLMs and getting to higher parameter count models by itself will get to something that is closer to general intelligence.
But I don't know.
I tend to think that there's probably more fundamental steps that need to be taken along the way there.
Oh, yeah.
I mean, I think that there are going to be a lot of amazing products and value that can be created with the current level of technology.
To some degree, I'm excited to work on a lot of those products over the next few years, and I think it would just create...
tremendous amount of whiplash if the number of breakthroughs keeps like if they're keep on being stacked breakthroughs because i think to some degree industry in the world needs some time to kind of build these breakthroughs into the products and experiences that we all use so we can actually benefit from them um but i don't know i think that there's just a a
like an awesome amount of stuff to do.
I mean, I think about like all of the, I don't know, small businesses or individual entrepreneurs out there who now we're going to be able to get help coding the things that they need to go build things or designing the things that they need, or we'll be able to, you know, use these models to be able to do customer support for the people that they're