Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Mark Zuckerberg

πŸ‘€ Speaker
See mentions of this person in podcasts
6446 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

a lot of the low-level infrastructure, and we make that open source, right?

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

Probably the biggest one in our history was Open Compute Project, where we took the designs for kind of all of our servers and network switches and data centers and made it open source and ended up being super helpful because, you know, I mean, a lot of people can design servers, but now, like, the industry standardized on our design, which meant that the supply chains...

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

basically all got built out around our design.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

The volumes went up, so it got cheaper for everyone and saved us billions of dollars.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So awesome, right?

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

Okay, so there's multiple ways where open source, I think, could be helpful for us.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

One is if people figure out how to run the models more cheaply.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

Well, we're going to be spending tens or like $100 billion or more over time on all this stuff.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So if we can do that 10% more effectively, we're saving billions or tens of billions of dollars.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

Okay, that's probably worth a lot by itself.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

Especially if there's other competitive models out there.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

It's not like our thing is giving away some kind of crazy advantage.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So is your view that the trading will be commodified?

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

I think there's a bunch of ways that this could play out.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

That's one.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

The other is...

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

is that so commodity kind of implies that it's going to get very cheap because um because there's lots of options the other direction that this could go in is qualitative improvements so um so you mentioned fine tuning right it's like right now it's it's um you know it's pretty limited what you can do with fine tuning major other models out there and there are some options but generally not for the biggest models um

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So I think being able to do that and be able to kind of do different app-specific things or use case-specific things or build them into specific tool chains, I think will not only enable kind of more efficient development, it could enable qualitatively different things.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

Here's one analogy on this.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So one thing that I think generally sucks about the mobile ecosystem is that you have these two gatekeeper companies, Apple and Google, that can tell you what you're allowed to build.