Andrew (Google Beam lead)

There's six color cameras, just like webcams that we have today, taking video streams and feeding them into our AI model and turning that into a 3D video of you and I. It's effectively a light field.

So it's kind of an interactive 3D video that you can see from any perspective.

That's transmitted over to the second thing, and that's a light field display.

And it's happening bidirectionally.

I see you and you see me both in our light field displays.

These are effectively flat televisions or flat displays, but they have the sense of dimensionality, depth, size is correct.

You can see shadows and lighting are correct.

And everything's correct from your vantage point.

So if you move around ever so slightly and I hold still,

you see a different perspective here.

You see kind of things that were occluded become revealed.

You see shadows that, you know, move in the way they should move.

All of that's computed and generated using our AI video model for you.

It's based on your eye position.

Where does the right scene need to be placed in this light field display for you just to feel present?

No, no, I hope not.

I think it's you and I together, real time.

That's what you need for real communication.

And at a quality level, this is awesome.

realistic.