Grant Harvey
π€ SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
So let's maybe zoom this out a little bit more.
So what I'm hearing is that you're pretty bullish on not necessarily needing bigger and bigger models, or maybe many more smarter, more efficient, more niche models.
Or do you think it's a combo of the two?
Where do you think this is all heading?
Is Samba Nova ever going to create your own models?
Have you considered that or have you created them?
Or are you just staying focused on infrastructure?
Or like Anthropix whole thing where Dario Almeda was basically like, yeah, you know, it's basically each model has its own business.
So it's like, yeah, maybe you train a model for 200 million and that's profitable, but then you have to go make another business, train a model for a billion, and then you have to make that profitable.
Agreed.
It's sort of like the dream of the custom GPT marketplace, but just like custom open source models everywhere.
Yeah.
Looking ahead 12 months, what should our audience be watching out for in terms of AI infrastructure?
What are the signals that this inference bottleneck is getting solved?
Is it just Samba Nova crushing it?
What do you think the next 12 months we should be looking for?
Do you think that's a memory problem or like what, I mean, we jokingly ask like the hard questions that are like trillion dollar questions, but like, do you think that, like if you could solve it, you're probably in the money, but do you think that's like a memory problem that makes them more consistent?
What do you think is the true...
That's what I thought, punk.
As ready as I'll ever be.