Gavin Baker
speaker
1,686 appearances
2 recordings
1 series
first heard May 2026
last heard 4 Aug
Gavin Baker’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 2 in all, peaking in Aug 2026 with 1.
Appearances
So you can take your data, customize an open source model, and then get something that you can put behind a router.
And the router routes it to often first your model and then quad frontier model, whatever quad grok checks it.
And you can, in a lot of cases, get slightly better outcomes.
at half the cost.
But again, that half the cost, I think a lot of people hear that.
They're like, that's bad for AI demand.
It's actually not at all because the cost the user pays is just a function of the margin on the tokens.
And you're literally just shifting tokens from really expensive tokens with like 90% gross margins to tokens with maybe let's call it a 30% gross margin.
That's where the savings are coming from, but the tokens cost the same amount of compute to produce.
And then also all these things are kind of happening on different cycle times.
All these big public companies are like, oh my God, my AI spin is 20x.
I've burned my budget in three months.
So they set up a router and that actually cuts their AI spin, but it doesn't really impact.
It may actually increase the
the amount of tokens that they are generating just by shifting them to these cheaper open source tokens.
And that's just more compute.
So a company getting smarter about which model to use for which task, that may lead to a stabilization of their spend or even a decline, but it actually has nothing to do with the amount of GPU compute hours they are effectively consuming behind the
these model layers of this router.
The GPU computer hours probably are going up as you shift to these cheaper tokens you can use more of.
That's happening to like a cutting edge of public companies.
Showing 301–320 of 1,686 · page 16 of 85
← Previous
Next →