Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Tim Davis

๐Ÿ‘ค Speaker
552 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Or just ping us on social media and we respond as fast as we can.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And we believe that we're building against what people are asking us to build.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And so for us, it's just come and join the mission and help us change the world.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I think now we've done a lot of the legwork for serving, so we are still an inference platform.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I think PyTorch is still wonderful as a training platform, and the team at Meta have done a really incredible job there.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

I believe our vision, though, is actually in the long term to make people's lives easier.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

When you deploy a container today with VLLM in it, you have to download one for NVIDIA, and it's about 10 gigabytes.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

If you download it for Rockum, which is the AMD platform, I think it's like 20 gigabytes.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

We have a single container that can execute across both those platforms now that's under a gigabyte.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And the reason for that is when you rebuild something, you scoop out all the dependencies and you basically then reduce the overall footprint.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And why that matters is

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

When you think of cold start time and you're deploying on Kubernetes instances and you need to scale these containers all over the place, every bit counts.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

It really does.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And so our goal is to get there.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Grant, there's no question.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

The only way we're going to get there is with a motivated group of people.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But we do have a lot of knowledge that I think we want to impart on our platform too.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

But at the end of the day,

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

Any platform is a function of its community and the people that choose to invest in it.

The Neuron: AI Explained
The "Android Moment" for AI Infrastructure: Why Modular Just Raised $250M

And so we're very conscious of that.