Akshat Bubna
speaker
405 appearances
1 recordings
1 series
first heard Jul 2026
last heard 8 Jul
Akshat Bubna’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
And it's not just one model that they deploy.
All these companies deploy lots of different models in different regions.
And so the autoscaling problem becomes even harder because then you have to scale within a certain region.
And those cycles sort of are offset.
So different times you need to scale up in different regions.
Yeah, I mean, the thing that we have actually specialized in is the autoscaling aspect.
Because we found that it's not universally true that everyone else can autoscale.
And we've gone deeper into it on the tech side, but we've incorporated GPU snapshotting into the product so we can actually take the GPU state, like your Torch compiler model, snapshot it, and that's cold starts way faster.
And so going back to your question, it's...
That's why you need a lot of burstiness for inference.
But then people also do a lot of on-demand training.
Like for RL stuff, your rollouts are bursty, as you said.
People also do a lot of batch jobs.
So we'll see a lot of companies, before they have a training run, they'll need thousands of GPUs to run encoding or something like that.
And I think those things are much more bursty than, I agree that agents are not that bursty.
Sandboxes are, except when you're doing RL.
RL is insanely bursty.
Yeah.
Yeah, like when you're doing rollouts, you sometimes need 100,000 sandboxes.
As you said, we're fortunate to work with a number of customers at the frontier and grab some of our customers.
Showing 81–100 of 405 · page 5 of 21
← Previous
Next →