Eric Schmidt
๐ค SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
In the audience, you all know open source means open code, open weights means open training data.
China is competing with open weights and open training data, and the US is largely and majority focused on closed weights, closed data.
That means that the majority of the world, think of it as the Belt and Road Initiative, are going to use Chinese models and not American models.
Now, I happen to think the West and democracies are correct.
And I'd much rather have the proliferation of large language models and that learning be done based on Western values.
It's not clear.
You know, Alex Wang's a good friend.
He's come in.
He's taken over.
He's obviously incredibly capable.
I would not hold...
I would not say that they're going fully closed, and I think also they got screwed up because the deep seek people, R1, did such a good job, right?
If you look at the reasoning model in deep seek, and in particular their ability to do reinforcement learning forward and back, forward and back, and forward and back, this is a major achievement, and it appears that they're doing it with less precision
than numeric precision than the American models.
As a bit of technical things, there's something called FP64, FP32, FP16.
The American models are typically using 16-bit precision for their training.
The Chinese are pushing 8 and now even 4.
Well, a number of the large companies have said that they want to be leaders in open source as well.
Sam Altman indicated that the smallest version of the O3 model would be released, I believe, open weights, and they have done so.
And he told me anyway that this model is much smaller than 10 to the 26th, it's much easier to train, and it will fit or can fit on your phone.