Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Craig Scroggie

👤 Speaker
322 total appearances

Appearances Over Time

Podcast Appearances

ABC Business Daily
Craig Scroggie on AI’s hunger for power

So Australia has actually really punched above its weight, Alan, in our role in cloud computing and will now, because of the abundance of land and the ability to grow and scale renewable energy, solar, wind, battery, we will have an outsized opportunity for Australia to be a global leader in the development of digital infrastructure for artificial intelligence.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

uh when when these tokens are created and the extent of power and so on that's required yeah let's go back in history just to touch alan to give context to digital infrastructure so traditionally computers were hosted in office buildings so if you're a bank or a telco you ran your own systems over the course of the last decade we've moved those computers out of on-premise office buildings

ABC Business Daily
Craig Scroggie on AI’s hunger for power

into specialized data centers that allowed us to improve energy efficiency and to improve sustainability outcomes.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

And that's been really the role of data centers over the last decade.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

Most recently, the emergence of artificial intelligence has meant that we moved from CPUs predominantly to GPUs.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

So those GPUs from companies like Nvidia

ABC Business Daily
Craig Scroggie on AI’s hunger for power

Yeah, the central processing unit or the graphics processing unit, essentially the difference between linear transactions.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

So in a CPU, like in your laptop, it was linear transactions, lots of them very quickly.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

In the NVIDIA world for GPUs,

ABC Business Daily
Craig Scroggie on AI’s hunger for power

you're able to do parallel processing.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

And that came predominantly from their history in the gaming industry, where rendering graphics was a very, very memory and system intensive use.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

And so the design of these GPUs was to allow parallel processing of information in real time.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

And as it turns out, the parallel processing of information was highly relevant and useful for artificial intelligence systems for large language models.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

So when we go from the traditional data center, its role was largely to store and protect information and to share it.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

It has security classifications.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

It's a physical perimeter, not just a digital perimeter as well.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

But when we move into the IR world, we're moving into the production of tokens.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

And essentially, that is the GPU producing a word.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

That token is essentially the economic unit of output.

ABC Business Daily
Craig Scroggie on AI’s hunger for power

And for AI to scale, we need more GPU computing capacity so that more tokens can be produced for people who are using large language models like ChatGPT or Claude from Anthropic.