Ryan Worrell

Whereas if you're in the public cloud, you can show up and put a credit card down and start moving gigabytes a second across the network without asking anybody for permission, nothing. So you're paying kind of a tax for that flexibility of being able to show up without asking anybody, all of a sudden start moving a ton of data.

Whereas if you're in the public cloud, you can show up and put a credit card down and start moving gigabytes a second across the network without asking anybody for permission, nothing. So you're paying kind of a tax for that flexibility of being able to show up without asking anybody, all of a sudden start moving a ton of data.

And especially in terms of how spiky you can do it, like you can write 100 gigabytes a second for one minute never pay Amazon any money again. They have to do some capacity planning on their end, just like they do for every other service and why they charge higher on-demand rates for EC2 instances than if you go and buy a random server off the internet and put it in your house.

And especially in terms of how spiky you can do it, like you can write 100 gigabytes a second for one minute never pay Amazon any money again. They have to do some capacity planning on their end, just like they do for every other service and why they charge higher on-demand rates for EC2 instances than if you go and buy a random server off the internet and put it in your house.

The cost looks very different. Now, whether that cost is right, whether that reflects real economic realities, I don't think anybody can say without being inside of Amazon, but I think there's a pretty logical rationale for why it exists that way, because there are people that will consume bandwidth in a very different way.

The cost looks very different. Now, whether that cost is right, whether that reflects real economic realities, I don't think anybody can say without being inside of Amazon, but I think there's a pretty logical rationale for why it exists that way, because there are people that will consume bandwidth in a very different way.

You have to think about the worst case scenario users, basically, of your service, the people that you might even call it abusers of your service in terms of your cost profile. So I think that's why, as you're saying, you're correct that LinkedIn can just decide to use Kafka in a different way internally to match their ability to provision infrastructure.

You have to think about the worst case scenario users, basically, of your service, the people that you might even call it abusers of your service in terms of your cost profile. So I think that's why, as you're saying, you're correct that LinkedIn can just decide to use Kafka in a different way internally to match their ability to provision infrastructure.

And Amazon can't really force you to do that in any way other than just charging you more money for it. So that's why they do.

And Amazon can't really force you to do that in any way other than just charging you more money for it. So that's why they do.

Yeah. So Richie and I met a little over five years ago now at a conference. We met at Percona Live. I think it was 2019 in Austin. Okay. And he was working at Uber at the time. Okay. And yeah, so we did eventually both end up joining Datadog, but that was a little later.

Yeah. So Richie and I met a little over five years ago now at a conference. We met at Percona Live. I think it was 2019 in Austin. Okay. And he was working at Uber at the time. Okay. And yeah, so we did eventually both end up joining Datadog, but that was a little later.

Yeah, so my co-founder, Richie, and I, after he left Uber, we started working on a prototype of a system that was... The idea was basically a snowflake for observability data. That was like the elevator pitch. And we were going around pitching that to investors at the time, and that's how we got to know some of our investors in Warframe today is we met them back in those days. And...

Yeah, so my co-founder, Richie, and I, after he left Uber, we started working on a prototype of a system that was... The idea was basically a snowflake for observability data. That was like the elevator pitch. And we were going around pitching that to investors at the time, and that's how we got to know some of our investors in Warframe today is we met them back in those days. And...

That eventually caught Datadog's attention. And we ended up joining Datadog together to build that system. Husky with some of our current colleagues at Workstream were also there at Datadog building that system with us. Basically, the idea there was to replace the legacy system inside of Datadog for a lot of the kind of

That eventually caught Datadog's attention. And we ended up joining Datadog together to build that system. Husky with some of our current colleagues at Workstream were also there at Datadog building that system with us. Basically, the idea there was to replace the legacy system inside of Datadog for a lot of the kind of

basically anything that you can think of that's not pre-aggregated time series metrics. The idea was to think of it as timestamp plus JSON. That was the data model, basically. And we wanted to move all that data to object storage for a ton of different reasons for it, similar to the reasons why WarpStream is useful.

basically anything that you can think of that's not pre-aggregated time series metrics. The idea was to think of it as timestamp plus JSON. That was the data model, basically. And we wanted to move all that data to object storage for a ton of different reasons for it, similar to the reasons why WarpStream is useful.

Yeah, over the three and a half years that my co-founder and I were there, we migrated all of the products that were using the legacy system over to ASCII.

Yeah, over the three and a half years that my co-founder and I were there, we migrated all of the products that were using the legacy system over to ASCII.