On the podcast: about the cost of not tracking your experiments and decisions, how refunds and chargebacks quietly erase your paywall wins, and why stacking A/B test wins should compound your growth, but almost never does.This conversation is shorter than usual and will be featured in RevenueCat’s State of Subscription Apps report. Each episode in this series will explore one crucial topic and share actionable insights from top subscription app operators.Top Takeaways:💸 Every experiment has a costNot tracking your experiments and their long-term impact is like flying blind; a simple decision log that maps revenue changes to specific tests can reveal what’s truly driving growth.🤫 Refunds and chargebacks are silent killersA paywall “win” can quickly become a net negative if you aren’t tracking the downstream effects of refunds and chargebacks, which often hide the true cost of a seemingly successful experiment.📈 Your stacked wins are a fantasyIf your A/B test wins aren’t compounding into real-world growth, it’s a red flag that you’re over-optimizing for short-term metrics and ignoring the lagging indicators of long-term retention.About Sara Grana: 🚀 Revenue Strategy Lead at Yousician, a revolutionary music platform for anyone to learn, play, create, and teach music. 👋 LinkedInFollow us on X: David Barnard - @drbarnardJacob Eiting - @jeitingRevenueCat - @RevenueCatSubClub - @SubClubHQEpisode Highlights:[0:00] Introduction to Sara Grana, Revenue Strategy Lead at Yousician[1:05] The importance of tracking experiments and business decisions in subscription apps[2:19] Mapping revenue and understanding its evolution across different user segments[3:06] Tracking revenue changes and connecting them to business decisions[4:34] The pitfalls of focusing too much on early funnel metrics and ignoring long-term impacts[5:26] The impact of chargebacks and refunds on paywall performance and customer retention[7:20] Why understanding downstream effects is crucial for making smart pricing decisions[8:44] The challenges and opportunities of introducing new subscription plans (e.g., lifetime subscriptions)[9:43] How commercial strategy influences churn rates and renewals[13:13] The importance of rechecking experiments after months to measure long-term impact[14:52] Sara's advice on when to revisit experiments based on their impact on pricing and user behavior[15:49] Tracking cohort data for subscription retention and understanding renewal trends[16:21] Why surprising lifts in experiments may require deeper investigation[17:13] The mismatch between short-term experiment results and long-term growth expectations[18:02] Final thoughts on driving sustainable growth, tracking, and adapting strategies over time

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Transcript

Related