Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Jaeden Schaefer

๐Ÿ‘ค Speaker
2075 total appearances

Appearances Over Time

Podcast Appearances

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

Like you're not going to, I think in the olden days or olden days, but like in the past, it was kind of like, hey, we need like an AI model that's going to go and

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

run through and do this massive project it's going to get this huge batch done for us and then we're going to be done when you're looking at like how consumers and how the enterprise is using it today people are pinging this all day every day always it needs to always be on no one wants latency and so it needs to kind of accommodate for that not just like this huge fluctuating big usage and then a lull it's it's kind of like we're getting this constant steady usage so

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

Beyond just like the performance, I think the power efficiency is a really key part of all of this.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

Data centers right now, they're already straining against energy constraints.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

We have even to the top levels of the government talking about, look, you guys need to be building power generation or power creation in some way alongside your data centers because there just isn't enough.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

And that cost gets passed on to the consumer.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

Like if you live in an area with a

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

And they're all getting subsidized.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

You are paying for it.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

Essentially, your power is going to be more expensive.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

So I think the AI workloads are getting really intense right now.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

But essentially, by designing this chip and creating its own silicone, Microsoft can tune Maya specifically to its data center layouts, which is a really interesting thought.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

Microsoft being, you know, one of the biggest players buying and building these data centers, they could build a chip that's specifically designed for how they structure and run their data centers.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

That's, you know, that's like the cooling systems and it's kind of the software framework and they can do all of this to reduce any sort of wasted power and they can smooth out the deployment at scale.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

So I think that's a really interesting vertical integration.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

It's difficult to achieve with any sort of off the shelf GPU alone that you might get from NVIDIA or anyone else.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

And so I think this kind of Maya 200 chip is also reflecting a really big shift in the whole industry, right?

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

The whole world's largest cloud providers, more and more they're getting into designing their own chips to try to reduce their reliance on NVIDIA.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

And let's be honest, NVIDIA's GPUs have become basically the backbone of the AI boom.

AI HR
Microsoft Reveals Maya 200 AI Inference Chip

But I think it also...