Ray Fernando

And it's simple as just, you know, finding the model and so forth. So once you hit download, it's going to download for your machine and you install it. You'll see like the way that it's downloaded, you'll actually see this little llama guy that's at the very top and a little figure there. And that's how you know it's currently running.

And so once that's currently running there, you'll see the models that are currently listed here in the model section at the very top. And so DeepSeek R1 is going to be the one that we want to use here. So we'll go back to our web UI instance, and then we're going to go ahead and hit where it says user at the bottom. From there, we're going to go to the admin panel.

And so once that's currently running there, you'll see the models that are currently listed here in the model section at the very top. And so DeepSeek R1 is going to be the one that we want to use here. So we'll go back to our web UI instance, and then we're going to go ahead and hit where it says user at the bottom. From there, we're going to go to the admin panel.

And so once that's currently running there, you'll see the models that are currently listed here in the model section at the very top. And so DeepSeek R1 is going to be the one that we want to use here. So we'll go back to our web UI instance, and then we're going to go ahead and hit where it says user at the bottom. From there, we're going to go to the admin panel.

And from the admin panel, there's like a section, a settings area. And so this settings area has an area of our connections with a little cloud icon. And this is kind of where we're going to connect our other providers here. So let me make this a little bit bigger so that everyone can see. So as you can see, the Ollama API is already configured for us, which is nice.

And from the admin panel, there's like a section, a settings area. And so this settings area has an area of our connections with a little cloud icon. And this is kind of where we're going to connect our other providers here. So let me make this a little bit bigger so that everyone can see. So as you can see, the Ollama API is already configured for us, which is nice.

And from the admin panel, there's like a section, a settings area. And so this settings area has an area of our connections with a little cloud icon. And this is kind of where we're going to connect our other providers here. So let me make this a little bit bigger so that everyone can see. So as you can see, the Ollama API is already configured for us, which is nice.

And this is already going to have the Docker container there, which is great. And so when you hit the little pencil here and you hit plus, change the model, you can type in the model like deep seek. And if you don't see it available, which it may not be there, you'll see this option at the bottom that says pull deep seek from olama.com. And so that'll actually search olama here to get it for you.

And this is already going to have the Docker container there, which is great. And so when you hit the little pencil here and you hit plus, change the model, you can type in the model like deep seek. And if you don't see it available, which it may not be there, you'll see this option at the bottom that says pull deep seek from olama.com. And so that'll actually search olama here to get it for you.

And this is already going to have the Docker container there, which is great. And so when you hit the little pencil here and you hit plus, change the model, you can type in the model like deep seek. And if you don't see it available, which it may not be there, you'll see this option at the bottom that says pull deep seek from olama.com. And so that'll actually search olama here to get it for you.

So like, for example, if we wanted to download the fee four model, I'll just type that one in just as an example. So you can see fee four. So I have no, I don't have that model currently downloaded. I just can hit here and it's just going to go ahead and find it and it downloads it. So in no time, basically this model would just be downloaded on my machine.

So like, for example, if we wanted to download the fee four model, I'll just type that one in just as an example. So you can see fee four. So I have no, I don't have that model currently downloaded. I just can hit here and it's just going to go ahead and find it and it downloads it. So in no time, basically this model would just be downloaded on my machine.

So like, for example, if we wanted to download the fee four model, I'll just type that one in just as an example. So you can see fee four. So I have no, I don't have that model currently downloaded. I just can hit here and it's just going to go ahead and find it and it downloads it. So in no time, basically this model would just be downloaded on my machine.

And then I could just type in fee for, and I'll be able to use that in the future going forward. So what we can do is go ahead and type in, you know, we're starting a new chat and we're going to basically select the model deep seek dash R1. And you'll see it'll be colon latest is kind of what it's listed at. And that's actually how you know that that's the one that's currently running locally.

And then I could just type in fee for, and I'll be able to use that in the future going forward. So what we can do is go ahead and type in, you know, we're starting a new chat and we're going to basically select the model deep seek dash R1. And you'll see it'll be colon latest is kind of what it's listed at. And that's actually how you know that that's the one that's currently running locally.

And then I could just type in fee for, and I'll be able to use that in the future going forward. So what we can do is go ahead and type in, you know, we're starting a new chat and we're going to basically select the model deep seek dash R1. And you'll see it'll be colon latest is kind of what it's listed at. And that's actually how you know that that's the one that's currently running locally.

And so once you select that one, you can just say something like explain options training and then go ahead and hit enter. And so what this does is, you know, it's basically, you know, thinking and you can see the thinking tokens of what's going on when it's thinking. And so all of this is actually running on my computer, which is amazing.

And so once you select that one, you can just say something like explain options training and then go ahead and hit enter. And so what this does is, you know, it's basically, you know, thinking and you can see the thinking tokens of what's going on when it's thinking. And so all of this is actually running on my computer, which is amazing.

And so once you select that one, you can just say something like explain options training and then go ahead and hit enter. And so what this does is, you know, it's basically, you know, thinking and you can see the thinking tokens of what's going on when it's thinking. And so all of this is actually running on my computer, which is amazing.

One of the ways that I can tell is there's this command line called asitop. And it actually shows us all of the resources that it's eating up. Thankfully, I have 128 gigabytes on my machine because I do live streams. I do all this stuff at the same time. And you can kind of see how much RAM it takes up right now with me hosting the stream plus running this model locally.