Avi Schiffmann
👤 PersonAppearances Over Time
Podcast Appearances
therapist bots, assistants, you know, mentor things, just fun little games, you know, toys, even kind of more what I'm doing, which is this kind of like, embodied Tamagotchi friend type thing. Regardless, you know, to to have a chatbot that you send more than a couple messages to you want it to, you know, have a good memory system.
And there's a couple ways people are trying to build memory systems these days, I think, At the end of the day, it's really just rag, which is still honestly kind of a fake way to build a memory system. But it works for the time being and, you know, for the near future, for sure. And what I really want to see is like memory as a service.
And there's a couple ways people are trying to build memory systems these days, I think, At the end of the day, it's really just rag, which is still honestly kind of a fake way to build a memory system. But it works for the time being and, you know, for the near future, for sure. And what I really want to see is like memory as a service.
And there's a couple ways people are trying to build memory systems these days, I think, At the end of the day, it's really just rag, which is still honestly kind of a fake way to build a memory system. But it works for the time being and, you know, for the near future, for sure. And what I really want to see is like memory as a service.
Essentially, I want to see more people build tools that make it easier for you to extract memories from conversations and, you know, have a very good eval system for your own kind of conversations that happen with your bot. to make sure it's generating those memories, and a very quick, low-latency query system for these memories.
Essentially, I want to see more people build tools that make it easier for you to extract memories from conversations and, you know, have a very good eval system for your own kind of conversations that happen with your bot. to make sure it's generating those memories, and a very quick, low-latency query system for these memories.
Essentially, I want to see more people build tools that make it easier for you to extract memories from conversations and, you know, have a very good eval system for your own kind of conversations that happen with your bot. to make sure it's generating those memories, and a very quick, low-latency query system for these memories.
I think people would probably be worried about maybe offloading such a crucial part of their application, but I honestly think it's enough of an issue that has just not been solved that people should really be focusing on this. I've taken a look now at nearly every
I think people would probably be worried about maybe offloading such a crucial part of their application, but I honestly think it's enough of an issue that has just not been solved that people should really be focusing on this. I've taken a look now at nearly every
I think people would probably be worried about maybe offloading such a crucial part of their application, but I honestly think it's enough of an issue that has just not been solved that people should really be focusing on this. I've taken a look now at nearly every
way of doing this in every project out there and i honestly think the only the only people doing a semi good job of this is i would say dot from new computer um they've really nailed uh like the whole memory system because the trickiest part about this i would say is um updating old memories and and having everything be connected to each other because very often i might um
way of doing this in every project out there and i honestly think the only the only people doing a semi good job of this is i would say dot from new computer um they've really nailed uh like the whole memory system because the trickiest part about this i would say is um updating old memories and and having everything be connected to each other because very often i might um
way of doing this in every project out there and i honestly think the only the only people doing a semi good job of this is i would say dot from new computer um they've really nailed uh like the whole memory system because the trickiest part about this i would say is um updating old memories and and having everything be connected to each other because very often i might um
Well, for starters, you're often changing your old memories. One day you might like a Ferrari, the next day you might like a Porsche, whatever, these things change. But more importantly, you want to be able to connect memories that are not semantically related to each other, because I might say I like
Well, for starters, you're often changing your old memories. One day you might like a Ferrari, the next day you might like a Porsche, whatever, these things change. But more importantly, you want to be able to connect memories that are not semantically related to each other, because I might say I like
Well, for starters, you're often changing your old memories. One day you might like a Ferrari, the next day you might like a Porsche, whatever, these things change. But more importantly, you want to be able to connect memories that are not semantically related to each other, because I might say I like
i don't know i i like cars but somehow there is like a memory that's not really semantically related to cars or ferrari or something like that but it's still relevant to the conversation we're having right now like maybe i don't know like my girlfriend uh got in this car accident ages ago like somehow that's like relevant um basically it's a really complicated problem but uh you know i'm sure people can solve this and
i don't know i i like cars but somehow there is like a memory that's not really semantically related to cars or ferrari or something like that but it's still relevant to the conversation we're having right now like maybe i don't know like my girlfriend uh got in this car accident ages ago like somehow that's like relevant um basically it's a really complicated problem but uh you know i'm sure people can solve this and
i don't know i i like cars but somehow there is like a memory that's not really semantically related to cars or ferrari or something like that but it's still relevant to the conversation we're having right now like maybe i don't know like my girlfriend uh got in this car accident ages ago like somehow that's like relevant um basically it's a really complicated problem but uh you know i'm sure people can solve this and
I've taken a look online at some tools and I think the only real open source projects that exist for this is like MemGPT and MemZero, which are OK, simple implementations. But, you know, I would I think there's many people that would gladly pay for a service like this. So I'd like to discuss that with you, Greg.