How Apache Kafka got faster by switching ext4 to XFS

episode

The Backend Engineering Show with Hussein Nasser not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

Related

recent transcribed audio

NPR News: 09-29-2026 7AM EDT 4 min · 29 Sep 2026 · NPR News Now

7AM ET 09/29/2026 Newscast 3 min · 29 Sep 2026 · Fox News Hourly Update

Overmedicated To Death: Former FDA Officer on Presley Gerber & The Psychiatric Crisis in America w/ Dr. Mary Talley Bowden, Dr. Josef Witt-Doerring & Ronald Owens Jr. – Ask Dr. Drew – Ep 670 1h 19m · 29 Sep 2026 · Ask Dr. Drew

Federal boost for Navitas 6 min · 29 Sep 2026 · Wall Street Breakfast

1031: Tokenomics: Why Your Agentic AI Bill Is Exploding (and How to Fix It), with Tyler Cox and Ish Shah 1h 14m · 29 Sep 2026 · Super Data Science: ML & AI Podcast with Jon Krohn

Being a Real Housewife with Erin Lichy 46 min · 29 Sep 2026 · Disgraceful with Grace O'Malley

Report any issue

Source

Recorded29 Apr 2024

Publisheranchor.fm ↗

Handlerec:9885774

Show notes

https://oscourse.win Allegro improved their Kafka produce tail latency by over 80% when they switched from ext4 to xfs. What I enjoyed most about this article is the detailed analysis and tweaking the team made to ext4 before considering switching to xfs. This is a classic case of how a good tech blog looks like in my opinion. 0:00 Intro 0:30 Summary 2:35 How Kafka Works? 5:00 Producers Writes are Slow 7:10 Tracing Kafka Protocol 12:00 Tracing Kernel System Calls 16:00 Journaled File Systems 21:00 Improving ext4 26:00 Switching to XFS Blog https://blog.allegro.tech/2024/03/kafka-performance-analysis.html

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Sign in