Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing
1271 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

The best news to be is in a big market that can accommodate a couple of winners and you're one of them.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

That's what I meant by the hyperscale.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

Got it.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

In the model layer, one is models need ultimately to run on some hyperscale compute.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So that's sort of that nexus I feel is sort of going to be there forever, right?

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

Because again, it's just not the model, but the model needs state.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

That means it needs storage and it needs to regular compute for running these agents and the agent environments.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

And so that's kind of how I think about why the limit of one person running away with one model and building it all

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

It may not happen.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

It's a good point.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

I mean, like, so the way...

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

We have built out, at least the way we want to build out the fleet is, in some sense, ride Moore's law.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

I think that this will just be like what we have done with everything else in the past, which is you kind of every year sort of keep refreshing the fleet.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

You depreciate it over whatever the lifetime value of these things are, and then get very, very good at the placement of the fleet such that you can run different jobs at it with high utilization, right?

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So sometimes they are very big training jobs that need to have highly concentrated peak flops that are provisioned to it.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

that also need to cohere or what have you, that's great.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So we should have enough data center footprint to be able to give that.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

But at the end of the day, these are all anyway becoming so big, even in terms of if you say, take pre-training scale and if it needs to keep going, even pre-training scale at some point has to cross data center boundaries.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

It's all more or less there.

Dwarkesh Podcast
Satya Nadella – Microsoft’s AGI Plan & Quantum Breakthrough

So great.