Mark Zuckerberg

We have a roadmap of new releases coming.

That are going to bring multimodality, more multilinguality, bigger context windows to those as well.

And then, you know, hopefully sometime later in the year, we'll get to roll out the 405, which I think is in training.

It's still training, but...

For where it is right now in training, it is already at around 85 MMLU.

And we expect that it's going to have leading benchmarks on a bunch of the benchmarks.

So I'm pretty excited about all of that.

I mean, the $70 billion is...

is great too.

I mean, we're releasing that today.

It's around 82 MMOU and has leading scores on math and reasoning.

So I mean, I think just getting this in people's hands is going to be pretty wild.

Yeah, and the 8 billion is nearly as powerful as the biggest version of Llama 2 that we released.

So it's like the smallest Llama 3 is basically as powerful as the biggest Llama 2.

I think it was because we were working on reels.

So we got into this situation where we always want to have enough capacity to build something that we can't quite see that we're on the horizon yet.

And we got into this position with reels where we needed more GPUs to train the models.

It was this big evolution process.

For our services, where instead of just ranking content from people who you follow or your friends and whatever pages you follow, we made this big push to basically start recommending what we call unconnected content.

Basically, content from people or pages that you're not following.