Pete Huang

So in essence, it was more like a voice remote control than an actual assistant.

So in this lens, Apple's choice to reboot Siri is completely right.

By combining three new ingredients with Apple intelligence, we now have the tech to actually live up to the original vision.

Those three ingredients are one, natural language, number two, access to everything on your device, and three, linking up AI to actions in your app.

Here's how all those pieces work.

The natural language part is easy to understand.

It's the same magic that ChatGPT introduced.

We can just say what we want and the AI model will understand what we want.

The second and third parts are way more interesting.

Apple intelligence adds a layer of software that is constantly scanning your phone and what you see on your screen and sort of memorizing it in a way that makes it easy for you to reference using those voice commands.

So in their demo, they made it very clear that you can just say things like, play the song that Ray sent me, and it knows to go into that memory and pull up whatever song had been sent in a text message that Ray had sent you.

Every single thing that you see will get scanned and put into that memory.

And finally, the AI actions in your app.

Anything that you would normally do by tapping buttons on a screen in an app can also be turned into code.

So for example, if you're in Spotify, pressing the play button, you can write a piece of code to do that.

Or if you're in the United Airlines app and you wanted to search for a flight, you normally type something and tap a few buttons.

And again, all that can be written as code.

The same AI models that power ChatGPT also know when they have to use outside tools and how to use them.

So just an example, if you go to ChatGPT and say, search online for the latest news in the healthcare industry, it's gonna know that search online means it has to go to a search engine and conduct a search and summarize the results back to you.

And doing that search is actually ChatGPT writing a piece of code that does the search and summarizing.