Dr. Adam Rodman

I mean, the dark side of talking to an LLM about your symptoms is they are so sycophantic, they can drive you into like the cyberchondria worry hole.

The evidence is not there yet that the sort of large routine testing functional medicine and putting it into an LLM does anything to improve health outcomes.

Now, if your LLM is telling you to work out and eat healthier, that's probably pretty good.

Sleep.

Not yet, but I think it could be at some point.

I mean, so ChatGPT for Health pulls in your data from the medical record and lets you chat with your medical records.

Now, reason number one for concern is privacy.

That's obviously going to have your entire medical history going to an AI company.

It's also going to not be redacted by you in a way to remove identifiable things.

Reason number two, I think, if we're talking about health record data, it's really messy.

They include tabular data.

They include copy-forwarded data that's been copied and pasted.

And they also, if you've ever read your health records, they include things that are wrong.

There's a lot of errors or misdocumented things in your health data.

And it turns out that just copying a bunch of information, like...

LLMs aren't magical.

You can't just copy your entire medical record in and think that you're going to get good performance.

And I would never bet against the technology.

I think that we will get to the point that we have ways to build representations of humans and understand their health.

But right now, there's like no advantage to just dumping everything in an LLM, which is what ChatGPT for Health theoretically would allow you to do in a way that would allow you to better understand your health.