Menu
Sign In Pricing Add Podcast
Podcast Image

The Changelog: Software Development, Open Source

Reinventing Kafka on object storage (Interview)

Thu, 29 Aug 2024

Description

Ryan Worl, Co-founder and CTO at WarpStream, joins us to talk about the world of Kafka and data streaming and how WarpStream redesigned the idea of Kafka to run in modern cloud environments directly on top of object storage. Last year they posted a blog titled, "Kafka is dead, long live Kafka" that hit the top of Hacker News to put WarpStream on the map. We get the backstory on Kafka and why it's so widely used, who created it and for what purpose, and the behind the scenes on all things WarpStream.

Audio
Transcription

Full Episode

4.334 - 5.044 Host

Thank you.

0

24.141 - 45.631 Host

What's up, friends? Welcome back. This is The Change Law. We feature the hackers, the leaders, and those who are building data streaming platforms inspired by Kafka. Yes, today's conversation revolves around Kafka and data streaming. We're joined by Ryan Worrell, co-founder and CTO at WarpStream. Last year, they posted a blog titled Kafka is Dead, Long Live Kafka.

0

45.951 - 57.897 Host

And that, of course, hit the top of hacker news and put WarpStream on the map. Today, we get the backstory on why Kafka is so widely used and who created it and for what purpose, and more importantly, the story of WarpStream.

0

58.217 - 79.788 Host

And the question they asked themselves was this, what would Kafka look like if it was redesigned from the ground up today to run in modern cloud environments directly on top of object storage with no local disks to manage, but still had to support the existing Kafka protocol? Well, that's just the premise for today's conversation. A massive thank you to our friends and partners over at Fly.io.

0

80.068 - 104.253 Host

More than 3 million apps have launched on Fly, and we're one of them. Scalable full stack without the cortisol. No stress. Learn more at Fly.io. Okay, let's Kafka. What's up, friends? I'm here with a new friend of mine, Sagar Bachu, co-founder and CEO at Speakeasy.

104.273 - 132.371 Host

You know, I've had the pleasure of meeting several people behind the scenes at Speakeasy, and I'm very impressed with what they're doing to help teams to create idiomatic SDKs, enterprise-grade SDKs in nine languages, and it's just awesome. So, Sagar, walk me through the process of how Speakeasy helps teams to create enterprise-grade idiomatic SDKs at scale.

132.751 - 155.829 Sagar Bachu

You know, APIs are tough things to manage. For a company, the OpenAPI spec, this great standard, widely adopted standard to describe and document SDKs, is the best chance the company has towards documenting it, understanding point in time what is the API, and also ownership. What are the APIs? How are they grouped? Which teams are on them? What services do they get deployed to?

156.049 - 176.337 Sagar Bachu

There's a lot of questions there that often we see teams and companies kind of struggling to answer. So speakeasy is a forcing function for them to invest in making that open API spec as great as possible. Completely descriptive, fully enriched. Speakeasy helps with those gaps. We have deterministic and AI tools to kind of fill in the gaps for them.

176.778 - 192.827 Sagar Bachu

And so the better and better that OpenAPI spec gets, the better chance you have at serving your community. The end value is always to the end user who is actually integrating with your API. So if your open API has gaps in it, more likely they are into errors. They don't understand what they're implementing.

Comments

There are no comments yet.

Please log in to write the first comment.