Kieran Kunhya
π€ SpeakerAppearances Over Time
Podcast Appearances
And that's the biggest difference compared to what we've done so far, is that I need video to have a feedback on something that is happening live, whether it's a drone flying, whether it's controlling a humanoid robot from distance, whether it's controlling a rover, whether it's playing a video game in the cloud gaming, because this is...
what I did on a previous job, right?
I was CTO of a cloud gaming startup.
And this is a very interesting topic because you push to the limit the network.
You need to care not about the quality like we've done on video and we've talked about with X264.
You care about
latency, because a millisecond is meaningful when you're controlling a car, right?
Well, you've seen, you've used Waymos, right?
When Waymos don't work, and that happens, even if 1% of the time, there is someone that is basically remote controlling that.
And this is exactly the stuff that we're building.
It's really an SDK platform to do end-to-end control of machines.
Yes, and what we do is a bit different from everyone else, is that we take only one socket, one connection, which is a quick protocol based on UDP, which is interesting because it's done for low latency.
It doesn't have two of the, what we call the TCP end-of-line problem and the HTTP end-of-line problem.
It's sifted by default, but on the same wire, we send multiple streams, like multiple tracks.
We send audio, we send video, but we also send the comments, right?
Mouse, keyboard, gamepad, and so on.
And we do that while maintaining coherence, right?
Synchronization.
Because what people don't realize is that all the clocks
actually drift.