Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Pricing

Panos Panay

👤 Person
570 total appearances

Appearances Over Time

Podcast Appearances

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And now you just have a series of experts basically sitting on top, and one of them is conversational. That's not just an LLM. That's a series of – and by the way, if you look at any one of these other products, they're not just LLMs. They're basically – they're mainly, I don't know, overstating it, understating it, so not to be rude, but they're chatbots.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And now you just have a series of experts basically sitting on top, and one of them is conversational. That's not just an LLM. That's a series of – and by the way, if you look at any one of these other products, they're not just LLMs. They're basically – they're mainly, I don't know, overstating it, understating it, so not to be rude, but they're chatbots.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And now you just have a series of experts basically sitting on top, and one of them is conversational. That's not just an LLM. That's a series of – and by the way, if you look at any one of these other products, they're not just LLMs. They're basically – they're mainly, I don't know, overstating it, understating it, so not to be rude, but they're chatbots.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And they're pretty good. They're damn good. And then when you start typing, you know, long form and rewriting and dropping in summaries, very powerful. Yeah. creating videos, creating photos, isolated but powerful. But the idea that these experts all sit on top of the stack and basically there's a runtime that orchestrates and says, okay, call these experts.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And they're pretty good. They're damn good. And then when you start typing, you know, long form and rewriting and dropping in summaries, very powerful. Yeah. creating videos, creating photos, isolated but powerful. But the idea that these experts all sit on top of the stack and basically there's a runtime that orchestrates and says, okay, call these experts.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And they're pretty good. They're damn good. And then when you start typing, you know, long form and rewriting and dropping in summaries, very powerful. Yeah. creating videos, creating photos, isolated but powerful. But the idea that these experts all sit on top of the stack and basically there's a runtime that orchestrates and says, okay, call these experts.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

These two experts have to work together. Got it. And then it operates. That's just not simple. You know, the first thing I was asked when I got there was, Hey, why don't you just change the brain with an LLM and everything will be fine?

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

These two experts have to work together. Got it. And then it operates. That's just not simple. You know, the first thing I was asked when I got there was, Hey, why don't you just change the brain with an LLM and everything will be fine?

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

These two experts have to work together. Got it. And then it operates. That's just not simple. You know, the first thing I was asked when I got there was, Hey, why don't you just change the brain with an LLM and everything will be fine?

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

You might have.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

You might have.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

You might have.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And I go, well, which one? And it won't work. All you'll do is talk and it'll be super verbose and it'll sound like you're talking to the internet. It's just not that. It doesn't work. And then everything else breaks. Which is the hardest thing. I don't think anyone else is doing what we're doing. We've got thousands of APIs now that we're able to call.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And I go, well, which one? And it won't work. All you'll do is talk and it'll be super verbose and it'll sound like you're talking to the internet. It's just not that. It doesn't work. And then everything else breaks. Which is the hardest thing. I don't think anyone else is doing what we're doing. We've got thousands of APIs now that we're able to call.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

And I go, well, which one? And it won't work. All you'll do is talk and it'll be super verbose and it'll sound like you're talking to the internet. It's just not that. It doesn't work. And then everything else breaks. Which is the hardest thing. I don't think anyone else is doing what we're doing. We've got thousands of APIs now that we're able to call.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

You're able to get these, if you will, experts or agents, whatever you want to call them. It's not a real word. It's just being able to talk to each other at the right time. The invocation is like there's something invoked. And now the LLM at the bottom is arbitrating like, oh, what's she trying to do? What's he trying to do? Got it. Route it to the right model. Route it to the right expert.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

You're able to get these, if you will, experts or agents, whatever you want to call them. It's not a real word. It's just being able to talk to each other at the right time. The invocation is like there's something invoked. And now the LLM at the bottom is arbitrating like, oh, what's she trying to do? What's he trying to do? Got it. Route it to the right model. Route it to the right expert.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

You're able to get these, if you will, experts or agents, whatever you want to call them. It's not a real word. It's just being able to talk to each other at the right time. The invocation is like there's something invoked. And now the LLM at the bottom is arbitrating like, oh, what's she trying to do? What's he trying to do? Got it. Route it to the right model. Route it to the right expert.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Got it. This expert needs to talk to that expert. Give you an example if you want it. There's nothing simple about it. It's why you haven't seen it. It's why it doesn't exist outside of videos. So the biggest thing I needed was to not do a demo, but to use the product live. Meaning you can code a demo just to be a demo. Like, you know, it's code. Like for that moment, make it look like.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Got it. This expert needs to talk to that expert. Give you an example if you want it. There's nothing simple about it. It's why you haven't seen it. It's why it doesn't exist outside of videos. So the biggest thing I needed was to not do a demo, but to use the product live. Meaning you can code a demo just to be a demo. Like, you know, it's code. Like for that moment, make it look like.