Mark Zuckerberg
π€ SpeakerAppearances Over Time
Podcast Appearances
But I think my understanding is it's like 10 times bigger.
And I think Google's Palm model is also, I think, has about 10 times as many parameters.
Now, the Lama models are very efficient.
So they perform well for something that's around 65 billion parameters.
So for me, that was also part of this because there's this whole debate around
Is it good for everyone in the world to have access to the most frontier AI models?
And I think as the AI models start approaching something that's like a super human intelligence, that's a bigger question that we'll have to grapple with.
But right now, I mean, these are still...
you know, very basic tools.
They're, um, you know, they're, they're powerful in the sense that, you know, a lot of open source software like databases or web servers can enable a lot of pretty important things.
Um, but I don't think anyone looks at the, the, you know, the current generation of Lama and thinks it's, um, you know, anywhere near a super intelligence.
So I think that a bunch of those questions around, like, is it, is it good to, to kind of get out there and
I think at this stage, surely you want more researchers working on it for all the reasons that open source software has a lot of advantages.
And we talked about efficiency before, but another one is just open source software tends to be more secure because you have more people looking at it openly and scrutinizing it and finding holes in it.
And that makes it more safe.
So I think at this point, it's more... I think it's generally agreed upon that...
open source software is generally more secure and safer than things that are kind of developed in a silo where people try to get through security through obscurity.
So I think that for the scale of what we're seeing now with AI, I think we're more likely to get to good alignment and good understanding of kind of what needs to do to make this work well by having it be open source.
And that's something that I think is quite good to have out there and happening publicly at this point.
Yeah, I mean, again, I think for the stage that we're at in the development of AI, I don't think anyone looks at the current state of things and thinks that this is superintelligence.