Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing
Dax Raad

Dax Raad

πŸ‘€ Speaker
820 total appearances

Appearances Over Time

Podcast Appearances

The Pragmatic Engineer
Building OpenCode with Dax Raad

So again, it's complicated because I know the training costs are a big part of it.

The Pragmatic Engineer
Building OpenCode with Dax Raad

The R&D department is hugely expensive, but long-term inference makes sense as a business.

The Pragmatic Engineer
Building OpenCode with Dax Raad

I think it always will.

The Pragmatic Engineer
Building OpenCode with Dax Raad

Yeah, so across the whole stack of GPUs, everything from producing the GPU to supporting hardware to labor, everything is super tight right now.

The Pragmatic Engineer
Building OpenCode with Dax Raad

The demand for inference is growing.

The Pragmatic Engineer
Building OpenCode with Dax Raad

I don't think it's linearly growing.

The Pragmatic Engineer
Building OpenCode with Dax Raad

I think it might even be exponentially growing.

The Pragmatic Engineer
Building OpenCode with Dax Raad

But we haven't made our production of GPUs grow exponentially.

The Pragmatic Engineer
Building OpenCode with Dax Raad

That's kind of a linear process.

The Pragmatic Engineer
Building OpenCode with Dax Raad

So as those lines intersect, there's going to be tightening.

The Pragmatic Engineer
Building OpenCode with Dax Raad

So for us, we have GPUs that we need to reserve.

The Pragmatic Engineer
Building OpenCode with Dax Raad

We have to pay a lot up front.

The Pragmatic Engineer
Building OpenCode with Dax Raad

Everyone is now hoarding because everyone's kind of expecting this crunch to kind of continue.

The Pragmatic Engineer
Building OpenCode with Dax Raad

It's very hard to get capacity for inference.

The Pragmatic Engineer
Building OpenCode with Dax Raad

And the other thing that's crazy, I think I posted about this,

The Pragmatic Engineer
Building OpenCode with Dax Raad

You know, we see things like, oh, a company has raised $2 billion or whatever to do something in AI.

The Pragmatic Engineer
Building OpenCode with Dax Raad

And that feels like a crazy amount.

The Pragmatic Engineer
Building OpenCode with Dax Raad

Like, wow, that's a huge amount.

The Pragmatic Engineer
Building OpenCode with Dax Raad

Like, you have to be like a crazy startup to do that.

The Pragmatic Engineer
Building OpenCode with Dax Raad

The big tech companies are spending like tens of billions in a year.