Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Azeem Azhar

πŸ‘€ Speaker
6819 total appearances

Appearances Over Time

Podcast Appearances

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

These models will be highly, highly tuned.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

And of course, we shouldn't forget that there's an enormous amount of capex that is required and will continue to be required over the coming years, which is going to potentially be a constraint, right?

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

If the debt providers and credit providers are not willing to back this build-out,

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

which they are so far, and I think will do for another 18 months or so, that could end up being a constraint.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

And the next constraint will be energy, whether the American energy system in particular will be able to cope with ongoing demands.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

I mean, it already seems like most

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

Demand growth for the next few years will get soaked up by AI data centers.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

I mean, on this front, of course, OpenAI has built relationships in the Middle East and up in Norway and elsewhere so that it can start to serve customers in those geographies.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

A quick note.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

If you want to support us in bringing more of these conversations to the world, please consider subscribing to the show.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

But perhaps one of the big unknowns is what might happen with alternative architectures.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

Large language models pushing for scale are doing kind of amazing and interesting things, but they are pretty lumbering.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

And there are other approaches.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

You know, there are alternative architectures that people are using today.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

For example, Liquid AI, which is an MIT spin-out, which has

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

Models that are about 10 times as efficient as transformers.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

You've got Yann LeCun at Meta talking about his framework, that what is needed to move beyond these autoregressive, exponentially decaying large language models are frameworks that have a much better, stronger sense of the world.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

Demis Hassabis is a Nobel laureate, runs DeepMind, built some of the greatest AI technologies of the moment.

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

What we'll say, look,

Azeem Azhar's Exponential View
My OpenAI thought experiment: $500B to $1.5T?

We don't know whether there aren't going to be really big breakthroughs required to get to the next level of AI capability.