Andy Halliday
๐ค SpeakerAppearances Over Time
Podcast Appearances
And, you know, they had difficulties at the outset just because the transaction management of actually...
creating the cart and closing out the cart interactively through that perplexity interface wasn't very reliable.
But those things are getting fixed.
And Google has offered shopping closure based on AI conversations.
But now ChatGPT is coming out with something.
And ChatGPT, I think, has demonstrated an ability to conceive and deliver
new models of user experience design that really work.
And so I'm curious and excited to see what ads look like in ChatGPT.
And I think we're going to see those before Christmas, right?
We're going to see those coming out.
And then the big question is, how do you present a sponsored ad and also label that and make it unobtrusive and at the same time make it feel like your assistant isn't being seconded by its commercial intent?
I gotta say, I don't feel very special as a Plus user.
I want to talk about research that was just published by NVIDIA and the University of Hong Kong
about smarter orchestration using smaller models, but coupling that with orchestration technology using a smaller model, matching and in some cases exceeding the frontier models that are packaged as a single monolith.
So they developed a term of art in this area called tool orchestra.
So this tool orchestra method trains an orchestrator model that decides when to reason internally and when to call specialized tools and models.
That's what orchestration is all about.
You can imagine an N8N orchestration process where there's an agent that actually calls which tools it's going to use.
Well, this is creating a model that's trained to do this very, very well.