Confluent Developer ft. Tim Berglund, Adi Polak & Viktor Gamov
Episodes
Making Apache Kafka Connectors for the Cloud ft. Magesh Nandakumar
13 Jan 2020
Contributed by Lukas
From previously focusing on Confluent Schema Registry to now making connectors for Confluent Cloud, Magesh Nandakumar (Software Engineer, Confluent) d...
Location Data and Geofencing with Apache Kafka ft. Guido Schmutz
08 Jan 2020
Contributed by Lukas
One way to put Apache Kafka into action is through geofencing and tracking the location data of objects, barges, and cars in real time. Guido Schmutz ...
Multi-Cloud Monitoring and Observability with the Metrics API ft. Dustin Cote
30 Dec 2019
Contributed by Lukas
The role of monitoring hosted services is evolving, but the ability to let go of the details to get what you are paying for with SaaS has always been ...
Apache Kafka and Apache Druid – The Perfect Pair ft. Rachel Pedreschi
23 Dec 2019
Contributed by Lukas
As the head of global field engineering and community at Imply, Rachel Pedreschi is passionate about engaging both externally with customers and inter...
Apache Kafka 2.4 – Overview of Latest Features, Updates, and KIPs
16 Dec 2019
Contributed by Lukas
Apache Kafka 2.4 includes new Kafka Core developments and improvements to Kafka Streams and Kafka Connect, including MirrorMaker 2.0, RocksDB metrics,...
Cloud-Native Patterns with Cornelia Davis
16 Dec 2019
Contributed by Lukas
Developing cloud-based applications requires unique patterns and practices that make them suitable for modern cloud platforms. Host Tim Berglund catch...
Ask Confluent #16: ksqlDB Edition
12 Dec 2019
Contributed by Lukas
Vinoth Chandar has led various infrastructure projects at Uber and is one of the main drivers behind the ksqlDB project. In this episode hosted by Gwe...
Machine Learning with Kafka Streams, Kafka Connect, and ksqlDB ft. Kai Waehner
04 Dec 2019
Contributed by Lukas
In this episode, Kai Waehner (Senior Systems Engineer, Confluent) defines machine learning in depth, describes the architecture of his dream machine l...
Real-Time Payments with Clojure and Apache Kafka ft. Bobby Calderwood
27 Nov 2019
Contributed by Lukas
Streamlining banking technology to help smaller banks and credit unions thrive among financial giants is top of mind for Bobby Calderwood (Founder, Ev...
Announcing ksqlDB ft. Jay Kreps
20 Nov 2019
Contributed by Lukas
Jay Kreps (original Co-creator of Apache Kafka and CEO, Confluent) introduces ksqlDB, an event streaming database. As the successor to KSQL, ksqlDB se...
Installing Apache Kafka with Ansible ft. Viktor Gamov and Justin Manchester
18 Nov 2019
Contributed by Lukas
“It’s one thing to get a distributed system up and running. It’s another thing to get a distributed system up and running well.” Ansible keeps...
Securing the Cloud with VPC Peering ft. Daniel LaMotte
13 Nov 2019
Contributed by Lukas
Everything is moving to the cloud, which makes it increasingly important to secure your cloud infrastructure and minimize the threat of potential atta...
ETL and Event Streaming Explained ft. Stewart Bryson
06 Nov 2019
Contributed by Lukas
Migrating from traditional ETL tools to an event streaming platform is a process that Stewart Bryson (CEO and founder, Red Pill Analytics), is no stra...
The Pro’s Guide to Fully Managed Apache Kafka Services ft. Ricardo Ferreira
04 Nov 2019
Contributed by Lukas
Several definitions of a fully managed Apache Kafka® service have floated around, but Ricardo Ferreira (Developer Advocate, Confluent) breaks down wh...
Kafka Screams: The Scariest JIRAs and How To Survive Them ft. Anna McDonald
30 Oct 2019
Contributed by Lukas
In today's spooktacular episode of Streaming Audio, Anna McDonald (Technical Account Manager, Confluent) discusses six of the scariest Apache Kaf...
Data Integration with Apache Kafka and Attunity
28 Oct 2019
Contributed by Lukas
From change data capture (CDC) to business development, connecting Apache Kafka® environments, and customer success stories, Graham Hainbach discusse...
Distributed Systems Engineering with Apache Kafka ft. Colin McCabe
23 Oct 2019
Contributed by Lukas
Colin McCabe shares about what it’s like being a distributed systems engineer on the Core Kafka team at Confluent, where he has worked previously, a...
Apache Kafka on Kubernetes, Microsoft Azure, and ZooKeeper with Lena Hall
16 Oct 2019
Contributed by Lukas
Lena Hall joins Tim Berglund in the studio to talk about Apache Kafka®, the various ways to run Kafka on Microsoft Azure, Kafka on Kubernetes (K8s), ...
Improving Fairness Through Connection Throttling in the Cloud with KIP-402 ft. Gwen Shapira
09 Oct 2019
Contributed by Lukas
The focus of KIP-402 is to improve fairness in how Apache Kafka® processes connections and how network threads pick up requests and new data. Gwen Sh...
Data Modeling for Apache Kafka – Streams, Topics & More with Dani Traphagen
07 Oct 2019
Contributed by Lukas
Helping users be successful when it comes to using Apache Kafka® is a large part of Dani Traphagen’s role as a senior systems engineer at Confluent...
MySQL, Cassandra, BigQuery, and Streaming Analytics with Joy Gao
02 Oct 2019
Contributed by Lukas
Joy Gao chats with Tim Berglund about all things related to streaming ETL—how it works, its benefits, and the implementation and operational challen...
Scaling Apache Kafka with Todd Palino
25 Sep 2019
Contributed by Lukas
Todd Palino, a senior SRE at LinkedIn, talks about the start of Apache Kafka® at LinkedIn, what learning to use Kafka was like, how Kafka has changed...
Understand What’s Flying Above You with Kafka Streams ft. Neil Buesing
23 Sep 2019
Contributed by Lukas
Neil Buesing (Director of Real-Time Data, Object Partners) discusses what a day in his life looks like and how Kafka Streams helps analyze flight data...
KIP-500: Apache Kafka Without ZooKeeper ft. Colin McCabe and Jason Gustafson
18 Sep 2019
Contributed by Lukas
Tim Berglund sits down with Colin McCabe and Jason Gustafson to talk about KIP-500. The pair, who work on the Kafka Core Engineering Team, discuss the...
Should You Run Apache Kafka on Kubernetes? ft. Balthazar Rouberol
16 Sep 2019
Contributed by Lukas
When it comes to deploying applications at scale without needing to integrate different pieces of infrastructure yourself, the answer nowadays is incr...
Jay Kreps on the Last 10 Years of Apache Kafka and Event Streaming
12 Sep 2019
Contributed by Lukas
As Confluent turns five years old, special guest Jay Kreps (Co-founder and CEO, Confluent) brings us back to his early development days of coding Apac...
Connecting to Apache Kafka with Neo4j
09 Sep 2019
Contributed by Lukas
What’s a graph? How does Cypher work? In today's episode of Streaming Audio, Tim Berglund sits down with Michael Hunger (Lead of Neo4j Labs) an...
Ask Confluent #15: Attack of the Zombie Controller
04 Sep 2019
Contributed by Lukas
Gwen Shapira (Core Kafka Software Engineer, Confluent) sits down to answer the questions you've had about event streaming, Apache Kafka®, Conflu...
Helping Healthcare with Apache Kafka and KSQL ft. Ramesh Sringeri
28 Aug 2019
Contributed by Lukas
In today’s episode of Streaming Audio, Tim Berglund sits down with Senior Applications Developer of Mobile Solutions Ramesh Sringeri to discuss Apac...
Contributing to Open Source with the Kafka Connect MongoDB Sink ft. Hans-Peter Grahsl
21 Aug 2019
Contributed by Lukas
Sink and source connectors are important for getting data in and out of Apache Kafka®. Tim Berglund invites Hans-Peter Grahsl (Technical Trainer and ...
Teaching Apache Kafka Online with Stéphane Maarek
19 Aug 2019
Contributed by Lukas
Streaming Audio welcomes Stéphane Maarek (CEO, Datacumulus) on the podcast to discuss how he got started hosting online Apache Kafka® tutorials and ...
Connecting Apache Cassandra to Apache Kafka with Jeff Carpenter from DataStax
12 Aug 2019
Contributed by Lukas
Whenever you see an Apache Cassandra™ in the wild, you probably also see an Apache Kafka®️. In this episode, Tim Berglund (Senior Director of Dev...
Transparent GDPR Encryption with David Jacot
08 Aug 2019
Contributed by Lukas
The General Data Protection Regulation (GDPR) has challenged many enterprises to rethink how they deal with customer data. Viktor Gamov chats with Dav...
Confluent Platform 5.3 | What's New in This Release
31 Jul 2019
Contributed by Lukas
A quick summary of the most important features in Confluent Platform 5.3. We discuss improved Kubernetes and Ansible support, improvements to Confluen...
How to Convert Python Batch Jobs into Kafka Streams Applications with Rishi Dhanaraj
29 Jul 2019
Contributed by Lukas
Zenreach is a company that makes tools to help retailers use digital marketing more effectively. If that sounds like a problem that only marketing peo...
Ask Confluent #14: In Control of Kafka with Dan Norwood
22 Jul 2019
Contributed by Lukas
Is Apache Kafka® actually a database? Can you install Confluent Control Center on Google Cloud Platform (GCP)? All this, plus some tips from Dan Norw...
Kafka in Action with Dylan Scott
15 Jul 2019
Contributed by Lukas
Author Dylan Scott tells all about his upcoming Manning title Kafka in Action, which shares how Apache Kafka® can be used by beginners who are just s...
Change Data Capture with Debezium ft. Gunnar Morling
10 Jul 2019
Contributed by Lukas
Friends don’t let friends do dual writes! Gunnar Morling (Software Engineer, Red Hat) joins us on the podcast to share a little bit about what Debez...
Distributed Systems Engineering with Apache Kafka ft. Jason Gustafson
02 Jul 2019
Contributed by Lukas
Ever wonder what it’s like to be a distributed systems engineer at Confluent? Core Kafka Engineer Jason Gustafson dives into the challenges of worki...
Apache Kafka 2.3 | What's New in This Release + Updates and KIPs
25 Jun 2019
Contributed by Lukas
Tim Berglund (Senior Director of Developer Experience, Confluent) explains what’s new in Apache Kafka® 2.3 and highlights some of the most importan...
Rolling Kafka Upgrades and Confluent Cloud ft. Gwen Shapira
25 Jun 2019
Contributed by Lukas
If you operate a Kafka cluster, hopefully you upgrade your brokers occasionally. Each release of Apache Kafka® includes detailed documentation that d...
Deploying Confluent Platform, from Zero to Hero ft. Mitch Henderson
18 Jun 2019
Contributed by Lukas
Mitch Henderson (Technical Account Manager, Confluent) explains how to plan and deploy your first application running on Confluent Platform. He covers...
Why Kafka Connect? ft. Robin Moffatt
12 Jun 2019
Contributed by Lukas
In this episode, Tim talks to Robin Moffatt about what Kafka Connect is and why you should almost certainly use it if you're working with Apache ...
Schema Registry Made Simple by Confluent Cloud ft. Magesh Nandakumar
03 Jun 2019
Contributed by Lukas
Tim Berglund and Magesh Nandakumar (Software Engineer, Confluent) discuss why schemas matter for building systems on Apache Kafka®, and how Confluent...
Why is Stream Processing Hard? ft. Michael Drogalis
29 May 2019
Contributed by Lukas
Tim Berglund and Michael Drogalis (Product Lead for Kafka Streams and KSQL, Confluent) talk about all things stream processing: why it’s complex, ho...
Testing Kafka Streams Applications with Viktor Gamov
20 May 2019
Contributed by Lukas
Tim Berglund is joined by Viktor Gamov (Developer Advocate, Confluent) to discuss various approaches to testing Kafka Streams applications.EPISODE LIN...
Chris Riccomini on the History of Apache Kafka and Stream Processing
16 May 2019
Contributed by Lukas
It’s a problem endemic to the tech world that we are always focused on what’s coming next, that we often forget to look at where we’ve been. Chr...
Ask Confluent #13: Machine Learning with Kai Waehner
08 May 2019
Contributed by Lukas
Gwen and Kai chat about machine learning architectures, and whether software engineers and data scientists can learn to get along.EPISODE LINKSBlogs o...
Diving into Exactly Once Semantics with Guozhang Wang
22 Apr 2019
Contributed by Lukas
It has been said that in distributed messaging, there are two hard problems: 2) exactly once delivery, 1) guaranteed order of messages and 2) exactly ...
Ask Confluent #12: In Search of the Lost Offsets
17 Apr 2019
Contributed by Lukas
Stanislav Kozlovski joins us to discuss common pitfalls when using Kafka consumers and a new KIP that promises to make consumer restarts much smoother...
Ben Stopford on Microservices and Event Streaming
08 Apr 2019
Contributed by Lukas
Microservices are pretty ubiquitous these days. Really “SOA done right,” they reimagine the services pattern in the context of the world we live i...
Magnus Edenhill on librdkafka 1.0
03 Apr 2019
Contributed by Lukas
After several years of development, librdkafka has finally reached 1.0! It remains API compatible with older versions of the library, so you won’t n...
Ask Confluent #11: More Services, More Metrics, More Fun
26 Mar 2019
Contributed by Lukas
Do metrics for detecting clients from old versions actually exist? Or is Gwen making features up? This and more useful advice is coming up on today&ap...
It’s Time for Streaming to Have a Maturity Model ft. Nick Dearden
18 Mar 2019
Contributed by Lukas
Nick Dearden explains the five stages of streaming maturity. They are not denial, anger, bargaining, depression and acceptance—that’s the Kübler-...
Containerized Apache Kafka On Kubernetes with Viktor Gamov
11 Mar 2019
Contributed by Lukas
Kubernetes provides all the building blocks needed to run stateful workloads, but creating a truly enterprise-grade Apache Kafka® platform that can b...
Catch Your Bus with KSQL: A Stream Processing Recipe by Leslie Kurt
04 Mar 2019
Contributed by Lukas
We all know that feeling of waiting when your ride is running late. Leslie Kurt shares about how you can use KSQL to calculate the difference between ...
KTable Update Suppression (and a Bunch About KTables) ft. John Roesler
27 Feb 2019
Contributed by Lukas
When you are dealing with streaming data, it might seem like tables are things that dwell in the far-off land of relational databases, outside of Apac...
Splitting and Routing Events with KSQL ft. Pascal Vantrepote
25 Feb 2019
Contributed by Lukas
Tim Berglund chats with System Engineer Pascal Vantrepote about a KSQL recipe he created based on a real-life customer use case in the financial servi...
Ask Confluent #10: Cooperative Rebalances for Kafka Connect ft. Konstantine Karantasis
20 Feb 2019
Contributed by Lukas
Want to know how Kafka Connect distributes tasks to workers? Always thought Connect rebalances could be improved? In this episode of Ask Confluent, Gw...
The Future of Serverless and Streaming with Neil Avery
14 Feb 2019
Contributed by Lukas
Neil Avery explores the intersection between FaaS and event streaming applications before taking a quick detour back in time to understand how we&apos...
Using Terraform and Confluent Cloud with Ricardo Ferreira
23 Jan 2019
Contributed by Lukas
Tim Berglund hosts Developer Advocate Ricardo Ferreira to discuss the concept of infrastructure as code, as well as the differences between Terraform,...
Ask Confluent #9: With and Without ZooKeeper
08 Jan 2019
Contributed by Lukas
Gwen asks: What happens when garbage collection causes Kafka to pause? And how do we run a Schema Registry cluster? We’ll find out in this episode o...
Ask Confluent #8: Guozhang Wang on Kafka Streams Standby Tasks
18 Dec 2018
Contributed by Lukas
Gwen is joined in studio by special guest Guozhang Wang, Kafka Streams pioneer and engineering lead at Confluent. He’ll talk to us about standby tas...
Ask Confluent #7: Kafka Consumers and Streams Failover Explained ft. Matthias Sax
03 Dec 2018
Contributed by Lukas
Gwen is joined in studio by special guest Matthias J. Sax, a software engineer at Confluent. He’ll talk to us about Kafka consumers and Kafka Stream...
Ask Confluent #6: Kafka, Partitions, and Exactly Once ft. Jason Gustafson
05 Nov 2018
Contributed by Lukas
Gwen is joined in studio by special guest Jason Gustafson, a Kafka PMC member and engineer at Confluent. He’ll talk to us about the big questions on...
Kafka Summit SF 2018 Panel | Microsoft, Slack, Confluent, University of Cambridge
18 Oct 2018
Contributed by Lukas
Neha Narkhede leads a panel discussion at Kafka Summit SF 2018 with Kevin Scott (CTO, Microsoft), Julia Grace (Head of Infrastructure Engineering, Sla...
Kafka Streams in Action with Bill Bejeck
27 Sep 2018
Contributed by Lukas
Tim Berglund interviews Bill Bejeck about the Kafka Streams API and his new book, Kafka Streams in Action. SEASON 2 Hosted by Tim Berglund, Adi Polak...
Joins in KSQL 5.0 with Hojjat Jafarpour
20 Sep 2018
Contributed by Lukas
KSQL 5.0 now supports stream-stream, stream-table and table-table joins. Tim Berglund interviews Hojjat Jafarpour about all three join types, how they...
Ask Confluent #5: Kafka, KSQL and Viktor Gamov
10 Sep 2018
Contributed by Lukas
Gwen is joined in studio by co-host Tim Berglund and special guest, Viktor Gamov, a new member of Confluent’s Developer Experience Team specializing...
KSQL Use Cases with Nick Dearden
06 Sep 2018
Contributed by Lukas
A discussion about how people actually use KSQL with Nick Dearden, stream processing expert at Confluent. Try KSQL!For more, you can check out ksqlDB,...
Nested Data in KSQL with Hojjat Jafarpour
29 Aug 2018
Contributed by Lukas
Interesting data isn't a polite little list of scalar types. Sometimes you have more complex structures and things like nesting. We'll see h...
UDFs and UDAFs in KSQL 5.0 with Hojjat Jafarpour
24 Aug 2018
Contributed by Lukas
KSQL has a solid library of built-in functions, but no library is ever good enough. What if you want to write your own? We’ll learn how today with H...
Ask Confluent #4: The GitHub Edition
16 Aug 2018
Contributed by Lukas
Want to see a feature implemented in KSQL or other Kafka-related project? Gwen answers your questions from YouTube and walks through how to use GitHub...
Deep Dive into KSQL with Hojjat Jafarpour
13 Aug 2018
Contributed by Lukas
Ever wonder what actually goes on when you run a KSQL query? Today, we take a deep dive into KSQL with Hojjat Jafarpour, a software engineer on the KS...
Ask Confluent #3: Kafka Upgrades, Cloud APIs and Data Durability
20 Jul 2018
Contributed by Lukas
Tim Berglund and Gwen Shapira have a discussion with Koelli Mungee (Customer Operations Lead, Confluent) and cover the latest Apache Kafka upgrades, c...
Ask Confluent #2: Consumers, Culture and Support
02 Jul 2018
Contributed by Lukas
Gwen Shapira answers your questions and interviews Sam Hecht (Head of Support, Confluent). This is the second episode of "Ask Confluent," a ...
Ask Confluent #1: Kubernetes, Confluent Operator, Kafka and KSQL
20 Jun 2018
Contributed by Lukas
Tim Berglund and Gwen Shapira discuss Kubernetes, Confluent Operator, Kafka, KSQL, and more. This is the first episode of "Ask Confluent," a...