Voice AI in healthcare:
where it helps, where it hurts
Voice is the most natural way people talk to each other, and now to software. Here is how I think about the three kinds of voice AI showing up in hospitals and clinics.
1. Ambient scribes
An ambient scribe listens to a visit, with permission, and drafts the clinical note. Done well, it lets a clinician look at the patient instead of the keyboard. The risk is a note that sounds right but records something that never happened, or misses something that did.
- Ask the patient before recording, every time, and respect a no.
- Read and correct every draft before you sign it. Your signature means you own it.
- Check medications, doses, laterality and negatives with extra care.
2. AI phone and messaging agents
Voice agents can schedule visits, send reminders and answer routine questions at any hour. They can also frustrate or mislead a frightened caller.
- Say clearly at the start that the caller is talking to AI.
- Route chest pain, stroke symptoms, breathing trouble and thoughts of self-harm to a human or to 911 immediately.
- Make it easy to reach a person at any point in the call.
3. Voice assistants for patients
Patients now ask voice assistants and chatbots about symptoms and medicines. I encourage using AI to prepare questions for a visit, not to replace the visit. My free safe prompt builder helps.
Questions to ask any voice AI vendor
- Where is the audio stored, for how long, and is it used for training?
- How are errors in transcripts found and corrected?
- How does it perform with accents, other languages and background noise?
- How does it hand off to a human, and how fast?
This guide is education, not legal or compliance advice. Follow your organization's policies on recording and patient consent, and state and federal law.
Written by Harvey Castro, MD, MBA, board-certified emergency physician. Last reviewed November 12, 2026.