Tim Davis
๐ค SpeakerAppearances Over Time
Podcast Appearances
Or just ping us on social media and we respond as fast as we can.
And we believe that we're building against what people are asking us to build.
And so for us, it's just come and join the mission and help us change the world.
I think now we've done a lot of the legwork for serving, so we are still an inference platform.
I think PyTorch is still wonderful as a training platform, and the team at Meta have done a really incredible job there.
I believe our vision, though, is actually in the long term to make people's lives easier.
When you deploy a container today with VLLM in it, you have to download one for NVIDIA, and it's about 10 gigabytes.
If you download it for Rockum, which is the AMD platform, I think it's like 20 gigabytes.
We have a single container that can execute across both those platforms now that's under a gigabyte.
And the reason for that is when you rebuild something, you scoop out all the dependencies and you basically then reduce the overall footprint.
And why that matters is
When you think of cold start time and you're deploying on Kubernetes instances and you need to scale these containers all over the place, every bit counts.
It really does.
And so our goal is to get there.
Grant, there's no question.
The only way we're going to get there is with a motivated group of people.
But we do have a lot of knowledge that I think we want to impart on our platform too.
But at the end of the day,
Any platform is a function of its community and the people that choose to invest in it.
And so we're very conscious of that.