Mark Zuckerberg

I mean, as the name says, it's quite big.

So we're kind of trying to figure out how we make that useful for people.

It's so big that we've had to build a bunch of infrastructure just to be able to post-train it ourselves.

And we're kind of trying to wrap our head around how does the average developer out there, how are they going to be able to use something like this?

And how do we make it so it can be useful for distilling into models that are of reasonable size to run?

Because you're obviously not going to want to run

you know, something like that in a consumer model.

But yeah, I mean, there's a lot to go.

I mean, as you saw with the Llama 3 stuff last year, the initial Llama 3 launch was exciting.

And then we just kind of built on that over the year.

3.1 was when we released the 405 billion model.

3.2 is when we got all the multimodal stuff in.

So we basically have a roadmap like that for this year too.

So a lot going on.

I actually think that this has been a very good year for open source overall.

If you go back to where we were last year, what we were doing with Llama was the only real super innovative open source model

Now you have a bunch of them in the field.

And I think in general, the prediction that this would be the year where open source generally overtakes closed sources, the most used models out there, I think is generally on track to be true.

I think the thing that's been sort of an interesting surprise, I think positive in some ways, negative in others, but I think overall good is that it's not just Lama.

There are a lot of good ones out there.