Max Deichmann is the co-founder of Langfuse, the open-source LLM engineering platform that became the observability layer of choice for teams building production AI agents, before being acquired by ClickHouse. He started as a business student who taught himself to code via CS50 on a beach in Singapore, pivoted through Y Combinator, fired his own customers mid-batch, and built Langfuse out of a Sunday night conversation about what they'd actually want to build if nothing was in the way. In this episode, Tobi and Max dig into what it really means to build and operate AI agents in production, not the LinkedIn version, but the 3 am alert, copy-pasted into Codex version. They cover the full loop: from pre-production experimentation and prompt iteration, to tracing, online evaluation, and the emerging architecture of agentic incident response. Max is unusually honest about where Langfuse itself still falls short, and what the next 12 months of the engineer's job actually look like. What CTOs will take away: a clear mental model for LLM observability vs. traditional observability, a practical blueprint for agentic on-call workflows, and a grounded view of where agents are genuinely working in production today, and where the hype still outpaces reality. Topics covered: Why traditional observability tools fail for non-deterministic AI applications The Langfuse loop: pre-production testing, tracing, online evaluation, and iteration How the ClickHouse acquisition happened, and the half-page doc that decided it Open source as a go-to-market strategy: adoption without a sales team Agentic on-call: how Max's team handles 3 am incidents with Codex today The "decision inbox" model, what the engineer's job looks like when agents do the work Where agents are genuinely succeeding in production (and where LinkedIn is lying to you)

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Transcript

Related