Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Eve Bodnia

๐Ÿ‘ค Speaker
495 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

You don't really play in a guessing game anymore.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

You see your energy landscape, you know where the right answer is, and you just know where to go right away.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And this is what's saving your time.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So our models are very small.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

We scale in this model from 20 million parameter to 200 million parameter, and there is a range in between.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And we run it on the cheapest H100 GPU.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

That's impressive.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

Yeah, I was a lot inspired by your brain, right?

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

As you're speaking to me right now, if somebody says, hey, can I create a digital twin of yours?

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And I'm trying to map like your internal body state, the information you process as you're listening to me, your visuals.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

It's going to take like enormous amount of GPUs and energy and orchestration, but your brain just naturally can do it like less than 20 Watts.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So if you make the architecture right, well, I'm not comparing people like full disclosure with the machines because we evolved.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

like for many years.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So there's some very hardcore evolution behind, but here the idea is that if you make it right, it's not supposed to take you that many GPUs.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

Yeah, so it can be quite deep discussion because there is so many different versions of diffusion models.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And to me, to have a technical discussion, I always want to define things first so we don't go on ambiguous, right?

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

But there's some similarities with diffusion models, obviously.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And the ideas of energy-based models in general, they're not that new.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

They've been out there for like 20 years and some early science even 40 years ago.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

The problem was nobody tried to build energy-based reasoning model.