Rory Driscoll
๐ค SpeakerAppearances Over Time
Podcast Appearances
So metering that demand relative to the cost to produce is, as it were, the business challenge.
And you're seeing that across the board.
I mean, in Entropic, you're seeing all these, yeah, their $200 plan, the $20 plan, and then they have those few people who are doing $1,000 of tokens on their $200 plan, and what do you do about that?
So...
But again, so that's what's happening out here, which is everyone's trying.
And that's if you're the model producers.
If you're a SaaS vendor like you and I are investing in, an AI apps vendor, and inference is one of your biggest costs now.
It used to be five years ago, AWS would be one of your biggest costs.
It would hit 10%.
And everyone would lose their shit in the board meeting.
And you'd say, let's get it down.
And you'd manage the process and get it down to eight or nine with efficiencies.
Now you're right.
It's inferences.
The big cost.
If you're a high priced app, maybe it's 10 or 15%.
If you're a coding type app, maybe it's 50, 60, 70% of your revenue.
And if you don't manage that correctly, you don't have a business.
You have the irritating habit of asking exactly the right question.
No, I totally...