Kwasi Ankomah

And at SambaNova, we kind of work with the ability that you can host multiple models around the same thing because you might not need this expensive model for everything.

You might have this cheaper model that might be able to run some of your workload as well.

So people are now really zeroing in on this because you can have, if I have a whole product, say, and it's costing me, let me give you an illustrative example, 3 million pounds a month to host.

Now, if you just take a slice of that and you actually put that onto like an open source model, you might be able to reduce that cost by, again, a factor of like four or five.

You might be able to get it down to like 100K.

And now businesses are realizing that this is, as they put more and more stuff into production,

This is becoming a huge thing.

So as you said, Corey, it's starting to really...

hit home.

And I think with most things, doesn't matter if it's AI, the moment it hits the balance sheet and the profit and loss, then people do start to get interested very quickly because then it's like, okay, hey, like, well, you know, how can we make it more efficient so that we can scale as well?

I think this is definitely an interesting statistic.

I think like with a lot of things in business, if the initiatives aren't properly thought out or people haven't thought about those costs, then they will skyrocket.

getting these things off the ground has been expensive, especially if you've been using only a large, only like a, what we'll call a frontier level model as your only model, because the cost of that will be astronomical.

Maybe you're talking 20 to 40 times what you could do on other systems.

So I think that definitely, Goran, is a key factor into why the ROI is going into negative.

The second one that I think I'll kind of talk a little bit about is that I think a lot of projects like we all, when business intelligence first came and the cloud first came, they've been run not without, I would say, observability and evals from day one.

And I think that's, you know, one of the principles I would serve building agents, especially is that you need to have that visibility from day one.

I think, and this is, you know, once you, once you want to get frontier tech out, I think lots of people are very keen to kind of see does it work?

Does it work right now?

From day one, we always talk to folks about the fact, having that observability allows you to kind of think about the cost.