Ray Fernando
speaker
138 appearances
1 recordings
1 series
first heard Jan 2025
last heard Jan 2025
Ray Fernando’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
Today, we're going to talk about prompting. And we're going to be specifically prompting with the new reasoning models with DeepSeq R1. And there are a lot of caveats as far as these models because they're now able to think and reason. And what that can do is can even lead to superhuman capabilities.
And so what does that mean is that these models have now become so advanced and this specific one from DeepSeq is out of China. And what that allows you to do is basically they've made it open source so that it's available for us to study. But it's apparently also on par with ChatGPT's like O1 model, O1's reasoning models.
And why it's taken the world by storm is because the fact that it's also free to use on their website. So deepseek.com. And when we say free, there's also a little bit of a caveat if you don't really know.
So I just want to also kind of cover a little bit of the architecture today and explain what you're going to get into if you use something like DeepSeq and then maybe how you can also run this in something that can run like in a container like in North America or in some other area because your data is really important, especially if you're doing anything for business.
And then also the third kind of secret bonus there would be how to actually run this locally on your machine so you can get the capability of these models and run that locally for your own private businesses, whether you're a lawyer, you're a doctor or whatever. There's a lot of different implications that you probably want to look into.
So I think that this episode is going to be super helpful if you're even just beginning and you don't really know some of the advanced stuff or know code. That's OK. It just takes learning English or using English to describe these things. to get the output and the intelligence of these models to do some really cool stuff. So I'm pretty excited. All right, let's get into it. Cool. Excellent.
To start out, to use these models, you have a couple of options. And one is going directly to deepseek.com. And this is actually currently hosted in China. So a little bit of background here is that your computer is here. Like, for example, I'm in North America. And if I go to deepseek.com or download the app from the App Store, the app will actually be talking to a region over in China.
And for what it may be, whenever you send your data over to another country, they have their own rules and laws and regulation. So I would be very careful as far as anything you put into the system, as far as if you have any sensitive data, because it would not belong to a region that you may live in or have control in.
There are other alternatives which we're going to cover, which would be using a web UI and going to these different API providers like Fireworks or Grok. And then we're also going to do something like covering running something locally on your machine so it doesn't go out to any of these providers. And you can even run this if you're flying on a plane, which is really exciting.
So as an example for DeepSeek, we're just going to do this because this is something that's currently public information and I don't really mind having this stuff sent out. So as far as prompting, one thing that I frequently do is I have a live stream and I basically transcribe my videos and stuff. So I basically, you know, I made a little app that will transcribe videos.
And I just take my live stream here and just run it through the transcriber there. And what it will do is just generate transcripts from the video. And it usually does it pretty fast. It processes on my device and then it sends it up to Grok for the endpoint. So when it's done, it looks basically something like this.
And you're able to copy this transcript and put it into something like DeepSeek if you wanted to. And so in order for you to use the model, what you can do on DeepSeek.com is to just go ahead and click where it says DeepSeek. So when it turns blue, that means the DeepThink is enabled. And that means it's also there. If you wanted to enable web search, you can do that.
So we can probably do that for the next prompt here. So I paste in my transcript here, I hit shift and I hit enter a couple of times. And so what we can do is give it additional instructions for it to do what we want to do.
And one of the things that I like to do is I actually have built a little prompt that I'll actually share with y'all so that you can actually do some analysis and generate a blog post of a transcript. And so that is actually located here in my little Notion thing. And so one of the things I have is we're going to cover how to do some of these prompts and stuff.
And I'll actually show you how you can generate some of these advanced chaining prompts because this will really take advantage of these models to think through all of that text and do some work on our behalf. So this is really, really cool. It's basically like hiring an admin to go through all of your stuff and make things for you. So we're going to go ahead and hit submit.
That's correct. And you may want to ask your app providers what they do. One of my favorite apps for coding is actually Cursor. And I asked them, hey, where do you have your DeepSeek model hosted? And they told me they use the Fireworks API. And that's actually not in China. So that's great. So it's like, OK, cool. That's awesome. And they're using the full model.
So these models have these parameters that you may hear of. And like, you know, like the really large parameter model, like 600 billion plus parameters, just means that it has more intelligence to leverage. And it tends to take longer in its thinking. But the results are really, really, really great.
And some of the models that will probably run locally on the machine a little bit later, they're going to be like distilled. So you just basically take the essence of it and then those models basically are going to run. They run a lot faster and they're just as efficient, but they may not think as long or they may not give the results.
And it's really up to you to try out, which I highly encourage. So one of the problems is that sometimes the server is really busy. And that can happen because right now it's so popular. And I probably after the publishing of this video, it probably be even more popular. So you can hit this little pencil and you can hit send again to try to resend it. And so that's kind of where I thought, well,
If I'm sending this over and there's a bunch of reliability issues, why don't I try to do something like, you know, that I can host my own or just hit the API themselves? If Cursor is doing that, why can't I do it as well? So I can actually show you a technique for how to do this so you can hit the API and so you don't send your data to China.
Showing 1–20 of 138 · page 1 of 7
Next →