Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Brian Gerkey

๐Ÿ‘ค Speaker
502 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

That has been just revolutionized by AI.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

And we at Intrinsic have built what we call the Intrinsic Vision Model, which is a foundation model based on neural networks that we pre-trained it on a huge volume of data, some real, some synthetic.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

And what we found is that it's producing really, really good results for answering the particular question of if I give it a camera image and I give it a CAD model for the object I want to find in that image, even if we never trained on that CAD model, we never saw it before.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

We can find it in the scene with incredibly high precision, and then we can go pick it up.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

And that turns out to be, that's a capability that's really, really important.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

If you go back to that, you know, what I was saying earlier about these small manufacturing operations, if you're a business and you're, what you're doing is in the morning, you get a, you decide to run a job and you're going to manufacture a hundred of something, some kind of widget.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

You've got the CAD for it because you're manufacturing it, but you don't have time to, you know, custom train any, any part of your automation system.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

Yeah, that's a great question.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

Honestly, what happens right now is you just don't use automation.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

There's some threshold where...

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

It's, it's just not, it's not worth your time to, to train it, to customize it.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

And so you just, you just don't, you're not able to use automation, which then means, well, okay, now I've got to, I've got to find people to do it, which can be tricky depending on the, you know, where you are.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

It might be difficult to find people with the right training or people who are willing to work a third shift.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

They're, they're constrained on that side.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

And so what that might mean for a small business is you might just not be able to take that job.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

It might mean that you've got customer demand, but you don't have the bandwidth to fulfill it.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

And so you can, there's a productivity gap that we think we can close there.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

So what the vision model does then is that it allows you to basically learn almost any object that you want to manipulate, give it a camera edge, we see where it is, now we can pick it up.

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

And what that means is that you can provide, put in front of the robot, a collection of objects, and it can reliably pick them up and then do whatever you need to do, whether that's

The Neuron: AI Explained
Google's Secret Robotics Play That Nobody's Talking About

pack them or put them into a machine.