Ray Fernando
👤 PersonAppearances Over Time
Podcast Appearances
I don't think app store app store. I'm going to see if I can go here. Apollo. Let's see. Okay. Private local AI.
I don't think app store app store. I'm going to see if I can go here. Apollo. Let's see. Okay. Private local AI.
I don't think app store app store. I'm going to see if I can go here. Apollo. Let's see. Okay. Private local AI.
yes so i have this app on my phone and they allow you to download the models directly just like you would with olama as well but it's it has its own interface which is really nice and so um i wonder if i could share my screen i think i can so on your phone yeah yeah they have a phone mirroring exactly apollo Okay. Oh, I have to lock my phone. Okay, cool.
yes so i have this app on my phone and they allow you to download the models directly just like you would with olama as well but it's it has its own interface which is really nice and so um i wonder if i could share my screen i think i can so on your phone yeah yeah they have a phone mirroring exactly apollo Okay. Oh, I have to lock my phone. Okay, cool.
yes so i have this app on my phone and they allow you to download the models directly just like you would with olama as well but it's it has its own interface which is really nice and so um i wonder if i could share my screen i think i can so on your phone yeah yeah they have a phone mirroring exactly apollo Okay. Oh, I have to lock my phone. Okay, cool.
So I lock it and then it should be able to connect. Okay, cool. Nice. Awesome. So yeah, let me kind of minimize this here and yeah. Okay. Let me just go to a different screen here. Probably one that's less cluttered and do phone. Whoops. Put that over here. Cool. Maybe this will work. I think. Yeah. Yeah. Sweet. Yeah, I actually have the yes.
So I lock it and then it should be able to connect. Okay, cool. Nice. Awesome. So yeah, let me kind of minimize this here and yeah. Okay. Let me just go to a different screen here. Probably one that's less cluttered and do phone. Whoops. Put that over here. Cool. Maybe this will work. I think. Yeah. Yeah. Sweet. Yeah, I actually have the yes.
So I lock it and then it should be able to connect. Okay, cool. Nice. Awesome. So yeah, let me kind of minimize this here and yeah. Okay. Let me just go to a different screen here. Probably one that's less cluttered and do phone. Whoops. Put that over here. Cool. Maybe this will work. I think. Yeah. Yeah. Sweet. Yeah, I actually have the yes.
Another place to get your models apparently is also through open router. And so, yeah, so this is kind of the Apollo app. You're like, OK, cool. I can. Can I start chatting with this? You know, as soon as I play with the thing, a couple of configurations you have to do is you hit this little hamburger menu at the very top left corner and then you hit settings.
Another place to get your models apparently is also through open router. And so, yeah, so this is kind of the Apollo app. You're like, OK, cool. I can. Can I start chatting with this? You know, as soon as I play with the thing, a couple of configurations you have to do is you hit this little hamburger menu at the very top left corner and then you hit settings.
Another place to get your models apparently is also through open router. And so, yeah, so this is kind of the Apollo app. You're like, OK, cool. I can. Can I start chatting with this? You know, as soon as I play with the thing, a couple of configurations you have to do is you hit this little hamburger menu at the very top left corner and then you hit settings.
So on the on the phone app, you hit settings and it's going to say AI providers settings. And when you click there, you have three different options. Open Router, which is another API provider. And you can also get access to pretty much every model there, which is also very handy. I think they give you some free credits, but then you would put your credits there.
So on the on the phone app, you hit settings and it's going to say AI providers settings. And when you click there, you have three different options. Open Router, which is another API provider. And you can also get access to pretty much every model there, which is also very handy. I think they give you some free credits, but then you would put your credits there.
So on the on the phone app, you hit settings and it's going to say AI providers settings. And when you click there, you have three different options. Open Router, which is another API provider. And you can also get access to pretty much every model there, which is also very handy. I think they give you some free credits, but then you would put your credits there.
And then you have the local model and then you have custom backends. So with the local model, they actually can tell how much memory you have on your device and they'll actually have a little download button for those models. The ones that are not available with the download button basically means you can't run that on your device because you don't have enough memory to run them.
And then you have the local model and then you have custom backends. So with the local model, they actually can tell how much memory you have on your device and they'll actually have a little download button for those models. The ones that are not available with the download button basically means you can't run that on your device because you don't have enough memory to run them.
And then you have the local model and then you have custom backends. So with the local model, they actually can tell how much memory you have on your device and they'll actually have a little download button for those models. The ones that are not available with the download button basically means you can't run that on your device because you don't have enough memory to run them.
So these downloads are pretty big, like four gigabytes, and some of them are several gigabytes. So just depending on the space on your phone. So you can actually run the distilled Lama 8-bit MLX version. And I have the distilled Quen version at 7B. So it just depends on your... Oh, that one's actually not compatible. Which one do I have downloaded? So I think on mine, let's see.
So these downloads are pretty big, like four gigabytes, and some of them are several gigabytes. So just depending on the space on your phone. So you can actually run the distilled Lama 8-bit MLX version. And I have the distilled Quen version at 7B. So it just depends on your... Oh, that one's actually not compatible. Which one do I have downloaded? So I think on mine, let's see.