Mark Zuckerberg

And, you know, we had this interesting experience early on where we took an early version of LAMA

And we translated it.

I think it was, it might've been into French or some other language.

And the feedback that we got, I think it was French, from French people was this sounds like an American who learned to speak French.

Like it doesn't sound like a French person.

It's like, well, what do you mean?

Does it not speak French well?

It's like, no, it speaks French fine.

It's just like the way that it thinks about the world is like, seems slightly American.

So I think there's like these subtle things that kind of get built into it.

Over time, as the models get more sophisticated, they should be able to embody different value sets across the world.

So maybe that's like a very kind of...

you know, not particularly sophisticated example, but I think it sort of illustrates the point.

And, you know, some of the stuff that we've seen in testing some of the models, especially coming out of China is like, they sort of have certain values encoded in them.

And it's not just like a light fine tune to get that to feel the way that you want.

Now the stuff is different, right?

So I think language models,

Or something that has like a kind of like a world model embedded into it have more values.

Reasoning, I think, is, I mean, I guess there are kind of values or ways to think about reasoning.

But one of the things that's nice about the reasoning models is they're trained on verifiable problems.