Mark Zuckerberg

Yeah.

So initially, it wasn't completely clear that you were going to need kind of full AGI to be able to support those use cases.

But then through working on them, I think it's actually become clear that you do, right?

They're in all these subtle ways.

So for example, you know, for Llama 2, when we were working on it, we didn't prioritize coding.

And the reason why we didn't prioritize coding is because people aren't going to ask Meta AI a lot of coding questions in WhatsApp.

No, they will.

Well, I don't know.

I'm not sure that WhatsApp is like the UI that people are going to be doing a lot of coding questions.

So we're like, all right, look, in terms of the things that, you know, or Facebook or Instagram or, you know, those different services, maybe the website or metadata.ai that we're launching, I think.

But the thing that was sort of, I think, has been a somewhat surprising result over the last 18 months is that

It turns out that coding is important for a lot of domains, not just coding, right?

So even if people aren't asking coding questions to the models, training the models on coding helps them just be more rigorous and answer the question and kind of help reason across a lot of different types of domains.

Okay, so that's one example where it's like, all right, so for Llama 3, we like really focused on training it with a lot of coding because it's like, all right, that's gonna make it better on all these things, even if people aren't asking primarily coding questions.

reasoning i think is another example it's like okay yeah maybe you want to chat with a creator or you know you're a business and you're trying to interact with a customer you know that interaction is not just like okay the person sends you a message and you just reply right it's a it's like a multi-step interaction where you're trying to think through how do i accomplish the person's goals and um you know a lot of times when a customer comes they don't necessarily

know exactly what they're looking for or how to ask their questions.

So it's not really the job of the AI to just respond to the question.

It's like you need to kind of think about it more holistically.

It's really becomes a reasoning problem, right?

So if someone else solves reasoning or makes good advances on reasoning and we're sitting here with a basic chat bot, then like our product is lame compared to what other people are building.