Mark Zuckerberg

Well, I mean, I think like the example that I gave for Lama 2, where, you know, we really, I mean, for Lama 2, the tool use was very, very specific.

Whereas Lama 3 has the ability to, has much better tool use, right?

So we don't have to like,

hand code all the stuff to have it use google to to go do a search um it just kind of can do that um so and similarly for coding and and kind of running code and just a bunch of stuff like that and um but i think once you kind of get that capability

then you get a peak of, okay, well, what can we start doing next?

Okay, well, I don't necessarily wanna wait until Llama 4 is around to start building those capabilities, so let's start hacking around it.

And so you do a bunch of hand coding and that makes the products better for the interim, but then that also helps show the way of what we wanna try to build into the next version of the model.

I think the nature of the stuff is it's like you get surprised.

So I think any specific thing that I sort of

thought would be valuable, we'd probably be building.

But I think you'll get distilled versions.

I think you'll get smaller versions.

I mean, one thing that I think is

8 billion, I don't think is quite small enough for a bunch of use cases, right?

I think like over time, I'd love to get, you know, a billion parameter model or a 2 billion parameter model, or even like a, I don't know, maybe like a 500 million parameter model and see what you can do with that.

Because I mean, as they start getting...

If with 8 billion parameters, we're basically nearly as powerful as the largest Lama 2 model, then with a billion parameters, we should be able to do something that's interesting, right?

And faster, good for classification or a lot of kind of like basic things that people do before kind of understanding the intent of a user query and feeding it to the most powerful model to kind of hone what the prompt should be.

So I don't know.

I think that's one thing that maybe the community can help fill in.