Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Dr. Jeff Beck

๐Ÿ‘ค Speaker
455 total appearances

Appearances Over Time

Podcast Appearances

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

And so what do we do?

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

We run a VA that we do the pre-processing.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

And we do it by, the pre-processing step,

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

completely independent right from the actual algorithm that's going to be tasked with solving the problem of interest and you know that's not something that

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

we necessarily have to stick with, right?

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

It would be very nice if there was a way of, again, jointly, we're getting right back to JEP again.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

What we'd like to do is we'd like to choose our pre-processing algorithm in a manner that, not a priori, not do it first.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

We'd like to choose the pre-processor that works the best in this space.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

And I think that that's the ultimate motivation for a lot of this work is like, what's the right embedding?

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

One of my favorite tricks, like, of course, I pre-process the VAs all the time.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

In fact, every time someone hands me a new neural data set, the first thing I do, I'm not ashamed to admit, I run PCA on it and pass it through a VAE and then sort of take a look, right?

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

It's the first thing you do with your data because it gives you a good idea of what the signal-to-noise ratio is in the data set itself.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

Then what do I do?

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

I subsequently do most of my analysis in that discovered embedding space.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

I don't see a huge problem with that from a purely pragmatic perspective, but it's certainly cleaner to have a single algorithm and approach and not just be stringing these things together in an ad hoc way.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

When doing PCA, PCA is a really great example of this.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

There's a failure mode for principal component analysis.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

which is actually really common in neural data.

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

Because principal component analysis basically says, well, where's the most variability?

Machine Learning Street Talk (MLST)
VAEs Are Energy-Based Models? [Dr. Jeff Beck]

Okay, I'm going to worry about that.