Casey Liss
👤 SpeakerAppearances Over Time
Podcast Appearances
Yeah, exactly.
But right now, this is something that I'm going to look at these kind of uses in the future, especially because once I'm done transcribing the back catalog for as many podcasts as I can, these are going to be at a third to half capacity.
so i'm gonna have a lot of extra computing power and i mentioned before i'm i would definitely want to move some of my heavier tasks from the main servers that are you know the main linux servers i'd love to remove a lot of those tasks to these you know to whatever degree that's reasonably possible but that's not going to work for everything so i'm still going to need a bunch of servers so i will have to maybe get creative on like what do i do with this computing power that i have here and uh
Ideally, things that can stay within one machine are better because it's easier to scale that.
It's easier to share code between the iPhone and the servers.
So ideally, I would just keep doing more things with Apple's foundation models.
And we'll see this summer at WWDC, there might be updates to the foundation models.
And maybe they get things like larger context windows, which would make them more useful in a lot of ideas I have on how to use them.
So we'll see how these go in the future.
Right now, they are being criminally underused in the sense that they, let's see, my current, my memory use, I just pulled one of them up here.
One of them that's under like, you know, full transcription load right now is using about seven gigs of its memory, of its 16 gigs.
So I have about half the memory that I could play with.
Also, they are really not using their GPUs much at all.
That will change once I move image resizing to them, but it won't change that much.
So I think I'm going to have a lot of GPU capacity that I could use and a decent amount of RAM.
So we'll see how I can play with that over time.
But right now, I'm still going through back catalogs, and maybe we'll see what the summer brings.
We are sponsored this episode by Squarespace, the all-in-one website platform designed to help you stand out and succeed online.
Whether you're just starting out or scaling a business, Squarespace gives you everything you need to claim your domain, showcase your offerings with a professional website, grow your brand, and get paid all in one place.
What I love about Squarespace is that they can host any kind of website you need to host, and they do it so easily.