Azeem Azhar
π€ SpeakerAppearances Over Time
Podcast Appearances
It's given a prompt to be unduly difficult and to not answer my questions directly and to leave with open questions or critical perspectives.
and also to push harder than it thinks I might understand.
So I'm constantly confused by the answers and I have to put them into another LLM to make sense of them.
But my experience there is designed to push me as a cognitive partner.
So I can tell the difference.
I would also say that in our experience with an exponential view, where we run a bunch of AI-based workflows in the background, helping us with research and analysis, we can also
not necessarily tell the difference, but different models perform differently on a cost and latency basis.
And does it work for this particular use case?
And so, you know, I have a particular workflow which still uses Gemini 2.5 Flash, which is the quick
Google Gemini model.
If I put it into 2.5 Pro, it doesn't work as well.
If I put it into Claude or GPT-4, it doesn't work as well.
And I think that that is an interesting observation.
The models will have many different classes of capabilities.
And the question is, will you be able to serve a sufficient portfolio of them?
And I do think that these open source models will be something of a threat.
Let's just come back to the original question, which is, would you be a buyer or a seller of OpenAI at that price?
My simplified math, which I'll talk about tomorrow in my essay, did suggest, and it surprised me, that there is this sort of path.
It's not beyond the bounds of reasoning.
It was a really fun thought experiment.