Psychiatrist vs. Alexa: Can a AI Give Safe Medical Advice?
Patients are already asking AI and home assistants medical questions, and we wanted to know whether the answers are accurate, complete, and safe.
In this episode of Sit and Stay, we ran a simple experiment. We asked RipsyTech Founder and CEO, Dr. Tom Tarshis a series of common mental health and medical questions. Then we asked Amazon’s most updated Alexa the same questions.
Tom answered first. Alexa answered second. Then Tom reacted.
What follows are short, abridged summaries of their answers. If you want the full context, nuance, and back-and-forth discussion, check out the full episode.
What Are Scientifically Proven Therapies for Treating Depression in Kids?
Tom’s Answer:
Cognitive Behavioral Therapy (CBT) is strongly validated. Interpersonal psychotherapy for depression also meets high evidence standards in the appropriate age group. Other therapies may help, but they do not meet the same level of research support.
Alexa’s Answer:
CBT is the most effective treatment for childhood depression, citing “60–70% success rates.” It also mentioned interpersonal and family therapy, and referenced medication.
Tom’s Reaction:
Alexa gave a solid first-line answer. But it required informed follow-up questions to clarify age differences and evidence strength.
Takeaway:
AI can provide a starting point. It does not replace clinical judgment.
What Is the Right Dose and Timing for Melatonin?
Tom’s Answer:
For most people, especially kids, the dose is closer to 0.5–1 mg, possibly up to 2–3 mg. It should be taken a couple of hours before bed, not right at bedtime. Start low. More is not better.
Alexa’s Answer:
Start with 0.5–1 mg about 30 minutes before bedtime. It acknowledged that taking it 90 minutes before bed is acceptable. It also noted that long-term effects are not fully understood.
Tom’s Reaction:
Alexa’s dosing guidance was surprisingly close. The larger issue is that many store products are sold in 5 mg or 10 mg tablets, far above typical starting doses.
Takeaway:
AI can offer reasonable guardrails. Marketing often pushes higher doses than needed.
Is Taking 50 mg of Zinc Daily Good for My Immune System?
Tom’s Answer:
Zinc is marketed for immune health. Some studies suggest zinc lozenges may shorten colds by about two days. That does not mean daily supplementation improves overall immunity. Evidence quality matters.
Alexa’s Answer:
The recommended daily intake is 8–11 mg for adults. 50 mg exceeds the 40 mg upper limit and could cause side effects. It cited placebo-controlled trials and a meta-analysis suggesting zinc reduced respiratory infection symptoms by about two days.
Tom’s Reaction:
Alexa did well flagging the dosage risk. It was less precise about the strength and limits of the evidence.
Takeaway:
AI may cite studies. It does not reliably interpret how strong those studies are.
Can Magnesium and Vitamin D Make My Anxiety Go Away?
Tom’s Answer:
There is no strong empirical evidence supporting magnesium or vitamin D as primary anxiety treatments. Deficiencies can cause problems. That is not the same as saying supplementation treats anxiety.
Alexa’s Answer:
Some studies suggest possible benefits, but the evidence is not definitive. It referenced a 2024 study of 12,232 adults linking higher vitamin D levels to lower anxiety risk and a 2022 randomized trial in elderly adults with pre-diabetes.
Tom’s Reaction:
Alexa acknowledged limitations when pressed. Most users will not press it. “Some studies suggest” can sound more convincing than the evidence warrants.
Takeaway:
Association is not treatment. Nuance matters.
What Is the Correct Starting Dose for Prozac?
Tom’s Answer:
Start low and go slow. For kids, he often begins at 5 mg, then increases to 10 mg. For adults, he may start at 10 mg (half of a 20 mg tablet) before increasing. Higher starting doses increase side effects and reduce adherence.
Alexa’s Answer:
The typical adult starting dose is 20 mg per day. It acknowledged that 10 mg can be appropriate in some cases and suggested dosing in lower-weight children.
Tom’s Reaction:
This is where nuance matters most. Medication decisions are individualized. Subtle errors can influence real treatment.
Takeaway:
Medication management requires clinical judgment, not just guideline recall.
Final Takeaway
Alexa was often reasonable. It gave general guidance, flagged obvious safety limits, and defaulted to “consult your doctor” when unsure. Not bad!
For low-risk questions, AI can help people get oriented. It can clarify basics. It can even prevent simple dosing mistakes. But the gap shows up in the more nuanced details.
AI does not reliably weigh the strength of the evidence, interpret the quality of a study, adjust for the individual’s context (unless it’s provided), or prioritize risk management in its suggestions.
It can retrieve information, but only a clinician can apply judgment. The difference is in responsibility.
You may use AI to gather background information, but you should always consult a clinician when making a decision.
In short, AI can inform. It cannot practice medicine.
If you’re in the early stages of starting a practice, we’ve created a free course that walks through how to set up everything, all in under two hours.
Learn more at ripsytech.com/practice.
Have a question or topic you’d like us to explore? Contact us at sitandstay@ripsytech.com.
And don’t forget to subscribe to the Sit and Stay Podcast for more insights on running a thriving mental health practice.
