Gavin Baker
π€ SpeakerVoice Profile Active
This person's voice can be automatically recognized across podcast episodes using AI voice matching.
Appearances Over Time
Podcast Appearances
But is Cloudflare in the token path if they're the one finally sending you the packet of tokens at the edge?
Or does that not count?
How do you think about that?
Most of the tokens are happening internally, and then you just get the result.
Yeah.
I mean, Matthew was talking about co-locating NVIDIA servers.
on the edge, specifically for the delivery of voice models because you want those to be very low latency.
Maybe you want your coding model to go off and cook in Virginia for 20 minutes or an hour and then come back to you with the final result.
But if you're trying to actually talk to a model, you probably want it as fast as possible.
What about on the opposite end?
GPUs are going everywhere.
Going in your bed eventually.
Yeah, and I mean, the Tesla Powerwall is like a version of that for storing energy.
It doesn't store compute, but it stores energy locally on the edge.
off the grid and there's a lot of powerful things that get unlocked by that.
What about land?
Is land in the token path at some point on the extreme other end?
Because people are obviously searching for going further and further upstream.
They found a toilet company that makes a particular material that goes into semiconductor supply chain.
People are hunting for like the final ingredient.