Cian Butler

Yeah.

And it was really good.

At the end of it all, we had a test scenario that showed we were able to push about 2x per compute resources than we previously were.

And there's a lot of reasons for that.

One is we were running less intermediate services.

We weren't running Nginx after this.

We weren't running HAProxy.

And Gradient was effectively doing all of that for us in a nice Rust event loop and handing it off to background processes in Python.

And the Python was that original P50 gain was adding up along with all these less resources having to be run.

And I think that was the biggest one for us.

Management saw what we were saying.

We could squeeze more requests out of what we're already paying.

We said we could scale down, but we knew scaling down was not going to be what we were going to do.

We're signing customers on every day.

We're growing every day.

We're scaling up.

So the idea of compressing the amount of work we can do in compute is big for us.

it got us the time to experiment more and continue our testing and see what's next for us.

What can we improve?

Yeah, there was two big differences.