Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Tim Davis

๐Ÿ‘ค Speaker
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But, you know, we are sort of working on that programming model evolving.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And then on top of that, and so you can think of Mojo and that programming language called Mojo, you can think of that as a comparator to say CUDA, which is a low level programming model for programming GPUs.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

The primary difference is we can go across any type of hardware.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

not just GPUs.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Then above that, one of the things we realized at Google, and this is sort of a long-winded story, is we realized we needed to build essentially a new AI framework.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And we call that MAX.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

It is a modeling and serving framework.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And so really, this was carried through all of the lessons and the mistakes and the learnings that we took from building TensorFlow as a high-performance,

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

AI framework, TensorFlow now has sort of fallen off in terms of popularity and you have PyTorch and other things.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But what's interesting and what we realized was, I'll go back to one of the comments I said earlier, we realized we needed to build a framework that could realize this vision of what you train is what you serve.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And back in 2017, 2018 at Google, we saw the inference training flip.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

We saw it all the way back then.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And it's a funny story because when we first went out and started pitching to get capital for Modular, a lot of the investors that we pitched to were like, yeah, no, inference is the thing.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Inference scales to the size of your user base, training scales to the size of your research team.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I assure you, inference is going to be the thing everyone wants to focus on.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And we were...

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I won't name names, but we were told at the time, oh, that's wrong.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Everyone should be doing training.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

You should be focused on training.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And we were like, yeah, I think training is going to become a lot smaller.