MedicsMusings All episodes
Explained · the real medicine behind the jokes

Can you trust an AI chatbot with medical questions?

Our resident chatbot, Algo Chats-a-Lot III, recommends two bytes and a call in the morning. Real chatbots are more useful than that, and occasionally just as confident.

The short answer

General-purpose AI chatbots can be genuinely helpful for understanding a diagnosis, decoding medical jargon, or preparing questions for your appointment. They are not a substitute for a clinician who knows your history, can examine you, and has a license to lose if they're wrong. The chatbot has no license, no malpractice insurance and no stethoscope. It does have excellent grammar.

Where they actually help

Translating the lab report that reads like a ransom note. Summarizing what a condition is and how it's usually treated. Drafting a list of symptoms and questions so you don't forget everything the moment the doctor walks in. Rewriting instructions into plainer language, or another language entirely.

Where they fall on their face

They can state wrong information fluently and confidently, like a first-year resident at 3 a.m. They don't know your full history, medications or exam unless you tell them, and they can't examine you. Their training data may be out of date. And they tend to agree with however you phrase the question, so “isn't this probably nothing?” gets a very reassuring answer.

Privacy, briefly

Consumer chatbots are usually not covered by HIPAA. Check the app's privacy settings and leave out names, dates of birth, record numbers and anything else you wouldn't write on a postcard.

Red flags: close the app

Chest pain, trouble breathing, signs of stroke (face drooping, arm weakness, speech difficulty), severe bleeding, thoughts of harming yourself, or any symptom that feels like an emergency: skip the chatbot. Call 911 (or 988 for a mental health crisis in the U.S.) or go to the nearest emergency department.

Frequently asked questions

Is it safe to ask ChatGPT or Claude medical questions?

For general education and prepping for an appointment, often yes. For diagnosis or treatment decisions, check with a clinician; chatbots can be confidently wrong and don't know your full history.

Are AI chatbots HIPAA compliant?

Consumer chatbots generally aren't covered by HIPAA. Leave out identifying details and review the app's privacy settings.

When should I not use an AI chatbot for health?

In an emergency. Call 911, or 988 for a mental health crisis in the U.S., instead of typing symptoms into an app.

Hear it on the show

Not medical advice. This page is general information, written to explain terms our satire leans on; it isn't a substitute for advice from your own clinician. In an emergency, call 911.

Refill Reminder

New episodes, straight to your inbox.