Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Panos Panay

👤 Speaker
678 total appearances

Appearances Over Time

Podcast Appearances

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Correct. Exactly right. And so hopefully everyone understands that concept. But since it's not deterministic and now you're going to ask a question, even if Alexa doesn't do it, she's going to talk about what you're trying to solve and you're going to actually get to an answer. Yeah. As opposed to, I don't know.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Correct. Exactly right. And so hopefully everyone understands that concept. But since it's not deterministic and now you're going to ask a question, even if Alexa doesn't do it, she's going to talk about what you're trying to solve and you're going to actually get to an answer. Yeah. As opposed to, I don't know.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

That's exactly right. And some we'll do on the edge, too. You don't have to do it all. If it's point and shoot, old command, we'll do it in a simpler way.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

That's exactly right. And some we'll do on the edge, too. You don't have to do it all. If it's point and shoot, old command, we'll do it in a simpler way.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

That's exactly right. And some we'll do on the edge, too. You don't have to do it all. If it's point and shoot, old command, we'll do it in a simpler way.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Okay.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Okay.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Okay.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

The orchestrator picks the model that's right for the job. The how, I won't get into the details, but there's some awesomeness here. One of the things that inspired most people is that we're using a multi-model approach, which I think is a little bit novel. But at the end of the day, it depends on what the task is. It depends on what's being asked for.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

The orchestrator picks the model that's right for the job. The how, I won't get into the details, but there's some awesomeness here. One of the things that inspired most people is that we're using a multi-model approach, which I think is a little bit novel. But at the end of the day, it depends on what the task is. It depends on what's being asked for.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

The orchestrator picks the model that's right for the job. The how, I won't get into the details, but there's some awesomeness here. One of the things that inspired most people is that we're using a multi-model approach, which I think is a little bit novel. But at the end of the day, it depends on what the task is. It depends on what's being asked for.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Think right now, you're seeing 70% of the utterances running through Amazon Nova, 30% running through...

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Think right now, you're seeing 70% of the utterances running through Amazon Nova, 30% running through...

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Think right now, you're seeing 70% of the utterances running through Amazon Nova, 30% running through...

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

uh anthropic something at that rate it changes just depends on how you use the product and what you're using it for um it is also non-deterministic basically there's a model that's like what's the best model to pick and then you're looking for accuracy and speed understand you know just first understanding then accuracy then speed and you target um then you move it you pick the right model and then you fire to the expert and there's a small model in the expert if you will sometimes and then those all orchestrate together and that's how it works

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

uh anthropic something at that rate it changes just depends on how you use the product and what you're using it for um it is also non-deterministic basically there's a model that's like what's the best model to pick and then you're looking for accuracy and speed understand you know just first understanding then accuracy then speed and you target um then you move it you pick the right model and then you fire to the expert and there's a small model in the expert if you will sometimes and then those all orchestrate together and that's how it works

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

uh anthropic something at that rate it changes just depends on how you use the product and what you're using it for um it is also non-deterministic basically there's a model that's like what's the best model to pick and then you're looking for accuracy and speed understand you know just first understanding then accuracy then speed and you target um then you move it you pick the right model and then you fire to the expert and there's a small model in the expert if you will sometimes and then those all orchestrate together and that's how it works

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Inside of that is the way that you talk to your partners. Mm-hmm.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Inside of that is the way that you talk to your partners. Mm-hmm.

Decoder with Nilay Patel
Amazon’s Panos Panay on the long road to Alexa’s AI overhaul

Inside of that is the way that you talk to your partners. Mm-hmm.