Chris Lattner
๐ค SpeakerAppearances Over Time
Podcast Appearances
There's some really cool outcomes of that.
So one of the things that's really interesting is I published a talk at an LLVM conference in 2018, and this seems like so long ago, about graph program abstraction, which is basically the thing that's in PyTorch2.
And so PyTorch2 with all this Dynamo Rio thing, it's all about this graph program abstraction thing from Python bytecodes.
And so a lot of the research that was done ended up pursuing and going out through the industry and influencing things.
And I think it's super exciting and awesome to see that.
But the Swift for TensorFlow project itself did not work out super well.
And so there's a couple of different problems with that.
One of which is that you may have noticed Swift is not Python.
There's a few people that write Python code.
And so it turns out that all of ML is pretty happy with Python.
And so if you're saying, I'm going to solve a machine learning problem where all the programmers are Python programmers, and you say the first thing you have to do is switch to a different language, well, your new thing may be good or bad or whatever, but if it's a new thing, the adoption barrier is massive.
It's still possible.
It's still possible.
Yeah, absolutely.
The world changes and evolves, and there's definitely room for new and good ideas, but it just makes it so much harder.
And so, lesson learned, Swift is not Python, and people are not always in search of learning a new thing for the sake of learning a new thing.
And if you want to be compatible with all the world's code, turns out,
meet the world where it is.
Second thing is that a lesson learned is that Swift as a very fast and efficient language, kind of like Mojo, but a different take on it still,
really worked well with eager mode and so eager mode is something that pytorch does and it proved out really well and it enables really expressive and dynamic and easy to debug programming um tensorflow at the time was not set up for that let's say that was not the timing is also important in this world yeah yeah intensive flow is a good thing and it has many many strengths but uh