Mark Zuckerberg
๐ค SpeakerAppearances Over Time
Podcast Appearances
And the feedback that we got, I think it was French, from French people was this sounds like an American who learned to speak French.
Like it doesn't sound like a French person.
It's like, well, what do you mean?
Does it not speak French well?
It's like, no, it speaks French fine.
It's just like the way that it thinks about the world is like, seems slightly American.
So I think there's like these subtle things that kind of get built into it.
Over time, as the models get more sophisticated, they should be able to embody different value sets across the world.
So maybe that's like a very kind of...
you know, not particularly sophisticated example, but I think it sort of illustrates the point.
And, you know, some of the stuff that we've seen in testing some of the models, especially coming out of China is like, they sort of have certain values encoded in them.
And it's not just like a light fine tune to get that to feel the way that you want.
Now the stuff is different, right?
So I think language models,
Or something that has like a kind of like a world model embedded into it have more values.
Reasoning, I think, is, I mean, I guess there are kind of values or ways to think about reasoning.
But one of the things that's nice about the reasoning models is they're trained on verifiable problems.
So do you need to be worried about like cultural bias if your model is doing math?
Probably not, right?
I think that that's, you know, I think it's like the chance that like some reasoning model that was built elsewhere is like going to kind of incept you by like solving a math problem in a way that's devious, seems low.