David Friedberg
π€ SpeakerAppearances Over Time
Podcast Appearances
Off-ramp number one is what's called a cross-subsidy.
which is essentially to say that they pay a rate card, which they can absorb with all their free cash flow, materially higher than what other rate payers would pay in that geographic area.
So the homeowner, his or her electricity costs stay flat to down, the data center costs are higher, and it's the Metas, the Googles, the Apples, the Amazons who have hundreds of billions of free cash, they absorb it.
That was idea number one.
And idea number two is to start to set up some mechanism so that they can install things like batteries at every single home in and around these data centers to allow those homes to have a better chance of actually absorbing some of this inflation without having to pay it.
I was just trying to paint the case that my economic model for going to open source is better because I can't pay $3 an output token.
and then also pay for all this stuff.
Yeah, so when I first started 8090, my only solution was Bedrock, which is a service that Amazon provides that allows you to essentially get inference as a service, right?
So as we are building our product, and we need inference and we need inference tokens.
Bedrock basically handles everything.
So it's what AWS is, but for this vertical of AI, right?
So they have the servers.
These are in American data centers.
They're managed by Americans.
And what they do is they take a handful of models
And they make sure that they can support usage of those models.
That was how we started.
But as with everything, we have to manage our costs and our operating profile.
And so we're always looking for, are there other models and other places other than Amazon that can service our needs?
Because in fairness, Amazon is very expensive.