Chris Lattner

There's this whole world of people who know how to write high-performance servers with zero copy networking and all this fancy asynchronous I.O.

and all these fancy things in the serving community.

very little that has pervaded into the machine learning world, right?

And why is that?

Well, it's because, again, these systems have been built up over many years.

They haven't been rethought.

There hasn't been a first principles approach to this.

And so what modular is doing is we're saying, okay,

We've built many of these things.

So I've worked on TensorFlow and TPUs and things like that.

Other folks on our team have worked on PyTorch Core.

We've worked on Onyx Runtime.

We've worked on many of these other systems.

And so built systems like the Apple accelerators and all that kind of stuff.

Our team is quite amazing.

And so one of the things that roughly everybody at Modular is grumpy about is that when you're working on one of these projects, you have a first-order goal.

Mm-hmm.

get the hardware to work, get the system to enable one more model, get this product out the door, enable the specific workload or make it solve this problem for this product team, right?

And nobody's been given a chance to actually do that step back.

And so we as an industry, we didn't take two steps forward.