Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Eve Bodnia

๐Ÿ‘ค Speaker
495 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

Evolution has a very well-defined task, like, hey, we're living beings, we want to survive.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

For different AIs, there's going to be some forms of it that's going to try to minimize the resources it's using, time for computing the things.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And also, if you give a task, if you are an AI-driven self-driving car, you want to reach your final destination, and you don't want it...

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

randomly dropping you off in the forest just because like, oh, next word is going to be here.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

Sorry, we're going to go a different way.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

Yeah, yeah, yeah.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

It's like, this is why we're focusing on

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

building the models for specifically this kind of situations because, you know, the world is going to have AI everywhere.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

Like five years from now, AI is going to be everywhere and we just want to make sure that we as people are safe in this AI-driven world and whatever AI we put in our system, it helps us and it actually does what it's meant to be doing.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

so back to your point on hallucinations like your brain hallucinates naturally so is mine like all of us we're not precise machines this is why if you want to build a house or like a bridge you go to engineering school right you like you're learning the formal methods to help to to narrow your thinking and have some measures to check it so this ci is the same way like naturally it's

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

It's not precise, but there are ways to make it self-aligned and there are ways to make it formally precise.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

Yeah, so because it's token-free model and your input data already mapped in your energy landscape,

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

You can, as an engineer or as a human, you can set up where the constraints are during your training.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So you're still going to train it a little bit, right?

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

You're going to show it some complete dataset with the answers, or you can show it some sparse data with the answers.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And there, what it's going to tell you internally is going to map the shape of this energy landscape.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So the highest point on this energy landscape is going to be less probable scenarios, and the lowest is going to be highly probable scenarios.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And this is very much matching sort of this theoretical physics modeling when we always want to minimize the energy.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

So typically, if you're good at theoretical physics, you're going to write the Lagrangian, which is going to reflect your kinetic and potential energy in your system.

The Neuron: AI Explained
Why Energy-Based Models Could Be the Next Big Shift in AI

And you're going to minimize this Lagrangian and derive equations of motion.