Dr. Adam Rodman

I don't know how good they are at wearable data, but I will tell you if a patient is going to give me like five years of their Apple Watch data, they're probably going to get a better from ChatGPT than from me pretending to look at five years of Apple Watch data because it's a 20-minute visit.

The yellow light, Casey, I think is a lot of the things that you're saying.

So I tell my patients it's okay to explore new symptoms.

It's

It's even okay to seek out second opinions when talking to a chatbot.

That can really help prepare you, as long as you understand that it's not a replacement for a doctor, and that is the first step to talking to a human being.

So, LLMs are really powerful, and I mean, there is some evidence, of course, that when any human uses them, you don't always get laboratory-level performance.

They can give you dangerous advice, but diagnosis and exploring symptoms, as long as you use it in a way to prep to see your doctor, can be very helpful.

The red light, what I tell them never to do is like ask medical management decisions.

Like don't say my doctor said to do this.

Is this right?

Like I have cancer.

God forbid you have cancer.

Is this the right chemotherapy option?

Like a lot of those decisions are so nuanced, taking so much information.

Those are things that the models don't do well.

And they're so sycophantic.

They can convince you that they're saying the right thing even when they're wrong.

Yeah, so that's making people way too worried about things they don't need to worry about.

And this is chat GPT, LLMs in general.