Elon Musk
π€ SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
So we know exactly where the limiting factors are.
And so effectively, the AI hardware and software teams are co-designing the chip.
Yeah, to be precise, the 40x is on, if you say like, compared to the worst limitation on AI4, which is running the softmax operation, we currently have to run softmax in around 40 steps in emulation mode, whereas that'll just be done in a few steps natively in AI5.
AI5 trip will also easily handle mixed precision models.
So it'll dynamically handle mixed precision.
There's a bunch of sort of technical stuff that AI5 will do a lot better.
In terms of nominal sort of raw compute, it's eight times more compute, about nine times more memory, roughly five times more memory bandwidth.
But because we're addressing some core limitations in AI4, you multiply that 8x compute improvement by another 5x improvement because of
optimization at a very fine-grained silicon level of things that are currently suboptimal in AI4, that's where you get the 4DX improvement.
So, now that said, I am confident that the current chips, AI4 chips that are in the cars, will achieve self-driving safety that is at least two to three times that of human, and maybe even 10X.
And the software that will be released for that is coming out over the next few months.
So version 14 will be the biggest upgrade in Tesla software since version 12.
We are increasing the parameter count by an order of magnitude.
There's a lot of reinforcement learning that's been used.
You can think of AI as a way of compressing reality, and some of those compression steps were too lossy, and we addressed the lossiness in the compression steps.
So these are all software updates that'll go out, so just over there are updates.
Your car is going to feel like it is sentient by the end of the year.
All right, cool.
So this is kind of a long-term thing.
It will allow...