Dr. Karthik V. Sarma

Yeah, I absolutely think that would be really helpful.

And in fairness to their credit, I think they are doing exactly that.

In fact, OpenAI somewhat recently hired a psychiatrist to be full-time on their staff to help them improve their model responses.

But I do think fundamentally there's a deeper problem.

For example, if somebody comes into my office, I'm a psychiatrist, and they start talking to me about what's going on in their life, both of us know that they're doing it because they're having a problem with their mental health and they want help.

That's not the same if someone walks into a lawyer's office and tells them about what's going on in their life.

The lawyer doesn't think, oh, this person's asking for mental health advice.

It's even worse for ChachiBT.

If someone talks to ChachiBT about something fantastical, maybe they're writing a novel.

or maybe they're having delusions, right?

And so it's much harder for ChachiBT as a general purpose agent to be able to be effective here because ChachiBT doesn't have the benefit of the context that a real doctor does or a real therapist.

And so I absolutely think that we need more effort to make these tools better, but I also think we need education.

I think we need to help people understand that

This is a general purpose tool.

It's like Microsoft Word.

It's not built for mental health.

Their intent isn't to make a mental health agent.

And if you're having a mental health problem, you've got to talk to a doctor.

So there are some, and the makers would call them safeguards.

There are safeguards that, for example, it's supposed to auto-detect if you're asking a medical question, they'll put in a label saying, hey, I'm not a doctor, you should talk to a doctor.