Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing
Dax Raad

Dax Raad

πŸ‘€ Speaker
820 total appearances

Appearances Over Time

Podcast Appearances

The Pragmatic Engineer
Building OpenCode with Dax Raad

And obviously there's like other infrastructure, there's like operations staff, there's stuff like that.

The Pragmatic Engineer
Building OpenCode with Dax Raad

But we have seen models that,

The Pragmatic Engineer
Building OpenCode with Dax Raad

that we look at the sticker price of it and we know like the, because we rent GPUs at scale to run the models.

The Pragmatic Engineer
Building OpenCode with Dax Raad

And we still use middlemen, by the way.

The Pragmatic Engineer
Building OpenCode with Dax Raad

So we're not like going all the way down to the floor.

The Pragmatic Engineer
Building OpenCode with Dax Raad

Even for us, there are some models, the sticker price and the cost to us, there's like an 80% margin in there.

The Pragmatic Engineer
Building OpenCode with Dax Raad

And I think the other thing that people don't notice is prices have gone up.

The Pragmatic Engineer
Building OpenCode with Dax Raad

It's confusing because it seems like they haven't.

The Pragmatic Engineer
Building OpenCode with Dax Raad

But they've gone up from the point of view is we used to all use Sana as our default because Opus was too expensive.

The Pragmatic Engineer
Building OpenCode with Dax Raad

Then they made Opus cheaper.

The Pragmatic Engineer
Building OpenCode with Dax Raad

So that we started to use Opus as our default, but it was still way more expensive than Sonnet.

The Pragmatic Engineer
Building OpenCode with Dax Raad

So the prices have gone up and the cost to host these models haven't changed.

The Pragmatic Engineer
Building OpenCode with Dax Raad

So that's one aspect of it being really profitable.

The Pragmatic Engineer
Building OpenCode with Dax Raad

And Anthropic, of course, they have an OpenAI crazy scale.

The Pragmatic Engineer
Building OpenCode with Dax Raad

They have the biggest GPU deals that they've done.

The Pragmatic Engineer
Building OpenCode with Dax Raad

So I wouldn't be surprised if they're looking at like 90% margin at current prices.

The Pragmatic Engineer
Building OpenCode with Dax Raad

I don't think that's like a defensible margin long-term.

The Pragmatic Engineer
Building OpenCode with Dax Raad

That's crazy to be able to make that much with the amount of money going through as well.

The Pragmatic Engineer
Building OpenCode with Dax Raad

There's always negative sentiment that exists for any business that's getting hyped.

The Pragmatic Engineer
Building OpenCode with Dax Raad

They have no incentive to correct it.