Mark Zuckerberg
π€ SpeakerAppearances Over Time
Podcast Appearances
And the models that we're talking about, the Lama models here, are generally an order of magnitude smaller than what OpenAI or Google are doing.
So...
I think that, at least for the stage that we're in now, the equity is balanced strongly, in my view, towards doing this more openly.
I think if you got something that was closer to superintelligence, then I think you'd have to discuss that more and think through that a lot more.
And we haven't made a decision yet as to what we would do if we were in that position, but I think there's a good chance that we're pretty far off from that position.
So...
I'm certainly not saying that the position that we're taking on this now
applies to every single thing that we would ever do and you know certainly inside the company you know we probably do more open source work than you know most of the other big tech companies but we also don't open source everything right a lot of our the core kind of app code for whatsapp or instagram or something i mean we're not open sourcing that it's not like a a general enough piece of software that would be useful for a lot of people to do different things um you know whereas
the software that we do whether it's like a an open source server design or um or basically you know things like memcache right like a good you know it was probably our earliest project um that that i worked on it was probably one of the last things that i that i coded and and led directly for the company um but but basically this like caching tool um for for quick data retrieval um
These are things that are just broadly useful across anything that you want to build.
And I think that some of the language models now have that feel, as well as some of the other things that we're building, like the translation tool that you just referenced.
Yeah, I think being able to translate between all of these different pieces in real time, this has been a kind of common sci-fi idea that we'd all have, you know, whether it's
I don't know, an earbud or glasses or something that can help translate in real time between all these different languages.
And that's one that I think technology is basically delivering now.
So yeah, I think that's pretty exciting.
Well, a lot of what we're doing is taking the first version, which was primarily this research version, and trying to now build a version that has...
all of the latest state-of-the-art safety precautions built in.
And we're using some more data to train it from across our services, but a lot of the work that we're doing internally is really just focused on making sure that this is, you know, as aligned and responsible as possible.
And, you know, we're building a lot of our own, you know, we're talking about kind of the open source infrastructure, but,
the main thing that we focus on building here, a lot of product experience is to help people connect and express themselves.