Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Chris Lattner

๐Ÿ‘ค Speaker
See mentions of this person in podcasts
2524 total appearances

Appearances Over Time

Podcast Appearances

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

Why can't I deploy it?

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

And if you dig into this,

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

Every layer is problematic.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

So if you look at the language piece, I mean, this is tip of the iceberg.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

It's a very exciting tip of the iceberg for folks, but you've got Python on one side and C++ on the other side.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

Python doesn't really deploy.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

I mean, it can theoretically, technically in some cases, but often a lot of production teams will want to get things out of Python because they get better performance and control and whatever else.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

So Mojo can help with that.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

If you look at serving, so you talk about gigantic models.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

Well, a gigantic model won't fit on one machine, right?

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

And so now you have this model, it's written in Python, it has to be rerun in C++.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

Now it also has to be carved up so that half of it runs on one machine, half of it runs on another machine.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

or maybe it runs on 10 machines.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

Well, so now suddenly the complexity is exploding, right?

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

And the reason for this is that if you look into TensorFlow, PyTorch, these systems, they weren't really designed for this world, right?

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

They were designed for, you know, back in the day when we were

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

starting and doing things where it was a different, much simpler world.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

Like you want to run resonant 50 or some ancient model architecture like this.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

It was just a, it was a completely different world than train on one GPU.

Lex Fridman Podcast
#381 โ€“ Chris Lattner: Future of Programming and AI

Exactly.