Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Satya Nadella

👤 Person
655 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So we should have enough data center footprint to be able to give that.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

But at the end of the day, these are all anyway becoming so big, even in terms of if you say, take pre-training scale and if it needs to keep going, even pre-training scale at some point has to cross data center boundaries.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

It's all more or less there.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So great.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

Once you start crossing pre-training data center boundaries, is it that different than anything else?

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

Right?

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So therefore, so the way I think about it is, hey, distributed computing will remain distributed.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So go build out your fleet such that

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

It's ready for large training jobs.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

It's ready for test time compute.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

It's ready.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

In fact, if this RL thing, the thing that might happen is you build one large model, and then after that, there's tons of this RL going on and test.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

To me, it's kind of like, again, more training flops, because you want to create these highly specialized distilled models for different tasks.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So you want that fleet.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

And then the serving needs, right?

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

At the end of the day, speed of light is speed of light.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So you can't sort of have one data center in Texas and say, I'm going to serve the world from there.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

You got to serve the world based on having an inference fleet everywhere in the world.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

Right.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So that's kind of how I think of our build out a true hyperscale fleet.