Gerhard Lazu
๐ค SpeakerAppearances Over Time
Podcast Appearances
So you keep pulling these files over and over again, and maybe even just fragments of them.
So even though the client never receives them, you may be pulling hundreds of files
and the client just goes away.
So you're not pulling the entire file, but you're still pulling enough and not able to fit it anywhere and just becomes a mess.
This reminds me of the 90s when you used to go jean shopping, right?
Well, what, what can we do then?
What's going on here?
Exactly.
So this was one of the things which I had to deep dive and understand what on earth is going on.
Like where do we store, like what's happening?
So there's a lot, lot more that went into this pull request.
It's pull request 44.
I'm calling you the elephant in the room.
I'm going to switch to the browser just to have a look at that.
So the title of the pull request is storing MP3 files in the file cache.
but that's like the tip, right?
Like the most obvious thing is, well, you either have lots and lots of memory to give Varnish, which honestly would be impractical in the sense that would be way too expensive to store all these files in memory.
the next best thing is to have something like a file cache and by the way we're talking about open source varnish that's really important like anyone can use this anyone can configure this you can configure a file cache which will basically pre-allocate a file on disk and that's where these large files will be stored pull request 44 the one that we're looking at is in the pipeline repository
That's what this adds.
But there's significantly more stuff.