Isn't it strange when everyone is raving about something — but you just — don't get it? That's the position Dr David Watkins (@DrMurphy11) found himself in in 2017. Babylon had launched in the UK and promised to provide the powers of AI and telemedicine to the NHS. Babylon lets you video consult with a doctor, often on the same day. This was slightly controversial, but not compared to its other head. Babylon had developed a sophisticated chatbot AI. After a game of 20 questions, the chatbot would suggest a diagnosis — although crucially (from a regulatory point of view) it wouldn't diagnose you. You would then be directed (triaged) to appropriate care. Mild headache and flu-like symptoms? No problem! Stay at home and take paracetamol. One-sided weakness and slurring your words? Call 999 🚑 Dr Watkins installed the app and began testing it. The details of this testing are disputed — Babylon who refer to him as a 'troll' claim that he ran 2400 tests, Dr Watkins claims just hundreds. More insidiously, Dr Watkins began to notice mistakes the chatbot was making — mistakes that no doctor would ever make. In one test, a 59-year old male smoker presents with central chest pain and nausea. Cookie-cutter symptoms of a heart attack, and he is duly warned. The exact same situation but this time, the patient is a woman— She is warned of a panic attack. This week's podcast is the story of Dr Watkin's battle against Babylon Health.* *Views expressed are those of Dr Watkins'* This week's episode presents a single side of the story. For context, Babylon have done a lot of good in the world. They've brought affordable healthcare to Rwanda, created a clinical AI fellowship for doctors and generally offer lucrative remote working opportunities. —————— You can find Dr Watkins on Twitter @DrMurphy11. The title of this podcast episode is adapted from Dr Watkins' talk at the Royal Society of Medicine: "Cowboys and unicorns in #DigitalHealth — why validation is more important than valuation". You can find me on Twitter @MustafaSultan and subscribe to my newsletter on www.musty.io

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Transcript

Related