Podcast Appearances
So again, it's complicated because I know the training costs are a big part of it.
The R&D department is hugely expensive, but long-term inference makes sense as a business.
I think it always will.
Yeah, so across the whole stack of GPUs, everything from producing the GPU to supporting hardware to labor, everything is super tight right now.
The demand for inference is growing.
I don't think it's linearly growing.
I think it might even be exponentially growing.
But we haven't made our production of GPUs grow exponentially.
That's kind of a linear process.
So as those lines intersect, there's going to be tightening.
So for us, we have GPUs that we need to reserve.
We have to pay a lot up front.
Everyone is now hoarding because everyone's kind of expecting this crunch to kind of continue.
It's very hard to get capacity for inference.
And the other thing that's crazy, I think I posted about this,
You know, we see things like, oh, a company has raised $2 billion or whatever to do something in AI.
And that feels like a crazy amount.
Like, wow, that's a huge amount.
Like, you have to be like a crazy startup to do that.
The big tech companies are spending like tens of billions in a year.