Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Mark Zuckerberg

๐Ÿ‘ค Speaker
See mentions of this person in podcasts
6434 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

There's all these different capabilities that I think you want to

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

basically train the models to focus on as well as getting a lot better at reasoning getting a lot better at memory which i think is is kind of its own whole thing it's i mean i don't think we're going to be you know primarily shoving context or or kind of things into a query context window um in the future to ask more complicated questions i think that there will be kind of different stores of memory or different custom models that um that are maybe more personalized to people but

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

I don't know.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

I think that these are all just different capabilities and then obviously making them big and small.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

We care about both because, you know, we want to, you know, if you're running something like Meta AI, then we have the ability to, that's pretty server based.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

But we also want it running on smart glasses and, you know, there's not a lot of space in smart glasses.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So you want to have something that's very efficient for that.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

I mean, our bet is that it's going to, this is basically going to change all of the products, right?

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So I think that there's going to be a kind of meta AI general assistant product.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

And I think that that will shift from something that feels more like a chat bot where it's like you just ask a question that kind of formulates an answer to things where you're increasingly giving it more complicated tasks and that goes away and does them.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So that's going to take a lot of inference.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

It's going to take a lot of compute in other ways too.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

Yeah.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

Then I think that there's a big part of what we're going to do that is like interacting with other agents for other people.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So whether it's businesses or creators, I guess a big part of my theory on this is that there's not just gonna be like one singular AI that you interact with, because I think, you know, every business is going to like,

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

want an ai that represents their interests they're not going to like want to primarily interact with you through an ai that is going to sell their competitors customers so sorry their competitors products um so um uh so yeah so i think creators is going to be a big one i mean there are about 200 million creators on our platforms they all basically have the pattern where um

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

They want to engage their community, but they're limited by hours in the day.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

And their community generally wants to engage them, but they're limited by hours in the day.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So if you could create something where that creator can basically own the AI and train it in the way that they want and can engage their community, I think that that's going to be super powerful, too.

Dwarkesh Podcast
Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

So I think that there's going to be a ton of engagement across all these things.