Andy Halliday
๐ค SpeakerAppearances Over Time
Podcast Appearances
So we're rapidly getting to the point where it's not going to be simply a function of the sort of inertia that people are stuck on chat GPT or whatever, but many tools will emerge that will let you chat or let your assistant or agents chat with any of the models through a single point of contact as LLM Gateway demonstrates.
So
It's a fluid market out there, and the Chinese are arguably ahead in many ways.
Yeah, I saw that it apparently generates 1,600 tokens for a single sentence compared to DeepSeek R1's 110 per sentence.
So it's really thinking hard about that.
And a comment about Kimmy K2 was that it's really good for novels or really long form content.
If you're going to do a long research paper, Kimmy K2 thinking would have a creative writing edge for you.
So just it's a trillion parameter model, but it activates 32 billion at a time.
So it knows it has a smart router in effect that says, okay, for this portion of this inference run, I need only this set, this 32 billion to attend to.
I don't have to run every token through every single one of the trillion.
So it's efficient in that way.
Yeah.
Okay, well, today I want to talk about one of the most useful applications from one of the greatest AI companies in the world, and it's Notebook LM from Google.
So Notebook LM made a big splash early on because of their voice technology.
podcast model of digesting source material that you upload to it and giving you an audio way to be taught about that subject whatever or the topic that's in in those articles and it's a note taking system as well because you have you can add
hundreds of sources into a single notebook, and you can dynamically select those sources and generate different outputs, distill the output in the form of a briefing doc or a study guide or an audio or video thing, and you can then
Add that as one of the sources so that this distillation process happens.
Well, they've made an update to it and they've also drawn my attention to the fact that there is an application, a mobile application for Notebook LN.
So this is not just accessing it through the mobile browser.
This is a full-on iOS and Android application for Notebook LM.