Building Observable Systems with eBPF and Linux (with Mohammed Aboullaite)

How do you monitor distributed systems that span dozens of microservices, multiple languages, and different databases? The old approach of gathering logs from different machines and recompiling apps with profiling flags doesn't scale when you're running thousands of servers. You need a unified strategy that works everywhere, on every component, in every language—and that means tackling the problem from the kernel level up.Mohammed Aboullaite is a backend engineer at Spotify, and he joins us to explore the latest in continuous profiling and observability using eBPF. We dive into how eBPF lets you programmatically peek into the Linux kernel without recompiling it, why companies like Google and Meta run profiling across their entire infrastructure, and how to manage the massive data volumes that continuous profiling generates. Mohammed walks through specific tools like Pyroscope, Pixie, and Parca, explains the security model of loading code into the kernel, and shares practical advice on overhead thresholds, storage strategies, and getting organizational buy-in for continuous profiling.Whether you're debugging performance issues, optimizing for scale, or just want to see what your code is really doing in production, this episode covers everything from packet filters to cultural changes in service of getting a clear view of your software when it hits production.---Support Developer Voices on Patreon: https://patreon.com/DeveloperVoicesSupport Developer Voices on YouTube: https://www.youtube.com/@DeveloperVoices/joineBPF: https://ebpf.io/Google-Wide Profiling Paper (2010): https://research.google.com/pubs/archive/36575.pdfGoogle pprof: https://github.com/google/pprofContinuous Profiling Tools:Pyroscope (Grafana): https://grafana.com/oss/pyroscope/Pixie (CNCF): https://px.dev/Parca: https://www.parca.dev/Datadog Continuous Profiler: https://www.datadoghq.com/product/code-profiling/Supporting Technologies:OpenTelemetry: https://opentelemetry.io/Grafana: https://grafana.com/New Relic: https://newrelic.com/Envoy Proxy: https://www.envoyproxy.io/Spring Cloud Sleuth: https://spring.io/projects/spring-cloud-sleuthMohammed Aboullaite:LinkedIn: https://www.linkedin.com/in/aboullaite/GitHub: https://github.com/aboullaiteWebsite: http://aboullaite.meTwitter/X: https://twitter.com/laytounKris on Bluesky: https://bsky.app/profile/krisajenkins.bsky.socialKris on Mastodon: http://mastodon.social/@krisajenkinsKris on LinkedIn: https://www.linkedin.com/in/krisjenkins/

There are no comments yet.

Please log in to write the first comment.