Chris Lattner
๐ค SpeakerAppearances Over Time
Podcast Appearances
And so,
For years, us programming language nerds and compiler people have been saying, okay, well, how do we tackle multi-core, right?
For a while, it was like, multi-core is the future.
We have to get on top of this thing.
Then it was multi-core is the default.
What are we doing with this thing?
And then it's like, there's chips with hundreds of cores in them.
What happened, right?
And so...
I'm super inspired by the fact that, you know, in the face of this, you know, those machine learning people invented this idea of a tensor, right?
And what is a tensor?
A tensor is like an arithmetic and algebraic concept.
It's like an abstraction around a gigantic parallelizable data set, right?
And because of that, and because of things like TensorFlow and PyTorch, we're able to say, okay, we'll express the math
of the system.
This enables you to do automatic differentiations, enables you to do all these cool things.
And it's an abstract representation.
Because you have that abstract representation, you can now map it onto these parallel machines without having to control, okay, put that byte here, put that byte there, put that byte there.
And this has enabled an explosion in terms of AI, compute,
accelerators, like all the stuff.