Mark Zuckerberg
π€ SpeakerAppearances Over Time
Podcast Appearances
In those cases, I still think the ability to kind of have our AI systems grow in sophistication at a faster rate than theirs have, it's an arms race.
But I think we're at least currently winning that arms race.
So I don't know.
But this is like a lot of the stuff that I spend time thinking about is like, okay, yes, it is possible that...
whether it's Lama four or Lama five or Lama six.
Yeah.
We need to think about like what behaviors we're, we're observing.
And it's not just us.
I think part of the reason why you make this open source is that there are a lot of other people who study this too.
So yeah, we want to see what other people are observing, what we're observing, what we can mitigate, and then we'll make our assessment on whether we can make it, um, open source.
But yeah,
I think for the foreseeable future, I'm optimistic we will be able to.
And in the near term, I don't want to take our eye off the ball of what are actual bad things that people are trying to use the models for today, even if they're not existential, but they're like they're like pretty bad kind of day to day harms that we're familiar with and running our services.
That's actually a lot of what we have to, I think, spend our time on as well.
Well, I think it could within the parameter of whatever the model architecture is.
It's just that at some level...
I don't know.
I think like today is eight billion parameter models.
I just don't think you're going to be able to get to be as good as the state of the art multi hundred billion parameter models that are incorporating new research into the architecture itself.
But those will be open source as well, right?