Lex Fridman
๐ค SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
This is what peak video codec should look like
79.9% assembly, 90.6% C, and 0.5% other.
The compiler can do this.
So we should actually just articulate a little clearer.
So the intuition there from the software engineering folks, when you have code like, okay, let's just take an example, C++.
There's a compiler.
that's doing a lot of the optimization.
And the presumption is if you have a good enough compiler, if you continue to improve the compiler, you're going to generate code that can perform optimal performance.
You cannot possibly beat it.
And you're consistently challenging that thought.
By orders of magnitude, handcrafted assembly can outperform
So can we, I don't know if you can say something philosophically, because there's a lot of great software engineers, great engineers, great machine learning people.
Karpathy, listen to this and say, what's the intuition he's supposed to get from this?
We're running on all hardware from... Sorry to linger on it, but that's a really counterintuitive, almost revolutionary...
idea here that there's a huge amount of value to assembly.
What are we supposed to take away from that?
There's a bunch of people listening to this.
They're basically like, sorry, myself included.
I programmed for many, many years in C, C++, going up the standards of C++, fell in love with C++, even metaprogramming and so on, and then transitioned more and more because of machine learning about 15 years ago to Python.
For me, in this Python world,