Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Eve Bodnia

๐Ÿ‘ค Speaker
495 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

But if there is a regime when LLM dominating, you still need the GPUs.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So it's

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

The short answer here, it's probably going to depend on the use case.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

If you're working with a use case when you have to process a lot of language in real time, so most likely there's going to be a portion when the LLM is going to be dominating if you're using the hybrid of the EBMs.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

But we don't know until we like actually test test, but

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

When I saw this phase transition, and phase transition is a very standard term in physics, you typically see it in condensed matter, and there's beautiful mathematics behind of these models, and that was a part of my PhD studies.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And when I saw it, it blew my mind.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

It's crazy that it happens.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

When I was studying, so okay, full disclosure, nobody knows how the brain works.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

There are theories out there.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

There are theories, there are hypotheses.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And what makes you a good theory is if you take a model, you're trying to map it in real data.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And you see what you actually see in real life, but you also can make a little bit of prediction and then prediction to some degree comes true.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So that's what makes it a good model.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And there are good models for how the visual cortex, for example, performs in humans and animals.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And some of it is adopted to AI, especially for the image recognition.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So there are techniques for using the energy-based principles.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

But is this the model to describe the brain?

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

Nobody knows.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

But again, it's a very open scientific question.