Microsoft Dragon Copilot: Microsoft's Voice-and-Text Hybrid AI Medical Assistant 193

What is Microsoft Dragon Copilot?

Microsoft Dragon Copilot is a medical AI assistant released by Microsoft on March 4, 2025. It uses speech recognition and natural language processing to streamline clinical workflows and reduce the administrative burden on healthcare professionals.

Core Features

Streamlined Clinical Documentation:

• Automatically creates multilingual clinical notes and supports multi-participant conversation recording.

• Provides personalized templates and AI prompts, and supports natural-language dictation.

• Records information even in offline environments, processing it once the connection is restored.

Information Retrieval and Task Automation:

• Offers medical information search capabilities to retrieve reliable information from authoritative databases.

• Automatically generates referral letters, post-operative summaries, clinical evidence reports, and more.

Integration with Electronic Health Records (EHR):

• Seamlessly integrates with major EHR systems such as Epic, streamlining clinical workflows.

Improved Doctor-Patient Experience:

• With the voice assistant, doctors can focus more on interacting with patients and reduce their dependency on screens.

• Patient satisfaction increases significantly, with 93% of patients reporting that doctors appear more personable.

Technology Foundation

Dragon Copilot combines Nuance's Dragon Medical One (DMO) and DAX Copilot (DAX) technologies. DMO is a proven speech recognition tool that has helped physicians document billions of medical records; DAX uses ambient AI technology to capture doctor-patient conversations and generate structured documentation.

Advantages and Impact

• Improved efficiency: Doctors save about 5 minutes per patient visit and can schedule 13 additional appointments per month.

• Reduced burnout: 70% of doctors report reduced feelings of burnout.

• Enhanced patient experience: 93% of patients report that doctors are more focused on communication.

Technical Features

• Security and accuracy: Combines the natural-language voice dictation of DMO with the ambient listening capabilities of DAX Copilot, along with healthcare-specific security safeguards and fine-tuned generative AI.

• Personalized experience: Learns from each doctor's usage habits and preferences to deliver more personalized service.

Use Cases

Clinical workflows: During doctor-patient interactions, it can automatically record and edit information, and generate clinical notes and post-visit summaries.

Medical report drafting: When a patient needs to be referred, it can quickly generate referral letters and extract key medical history and test results.

How to Use Microsoft Dragon Copilot:

I. Prerequisites

• Integration with an Electronic Health Records (EHR) system is required.

• Ensure a stable network connection. Although offline recording is supported, processing requires an active connection.

II. Usage Steps

1. Launch Dragon Copilot

• Launch Dragon Copilot during the consultation, and it will automatically capture doctor-patient conversations.

• Access it via the web, mobile, or desktop versions, with no client installation required.

2. Customization

• Adjust document templates, formatting, and AI prompts according to personal preferences.

• Configure natural-language commands for document editing, queries, and navigation.

3. Document Generation and Editing

• Dragon Copilot converts speech to text in real time and generates professional, complete medical records.

• It supports multilingual input, allowing doctors to modify or supplement generated content at any time.

4. Information Retrieval and Task Automation

• Use natural-language commands to query patient information, such as medication records and family medical history.

• Automatically generate orders, medical record summaries, referral letters, follow-up summaries, and more.

5. Review and Modify

• Review the generated clinical documentation and make necessary edits.

• Once all information is confirmed accurate, synchronize the documentation to the EHR system.

The assistant is scheduled for full rollout in the United States and Canada in May 2025, followed by launches in the United Kingdom, Germany, France, and the Netherlands.