During the World Congress Patient Experience & Engagement Summit in Boston, I led a panel with these innovative health systems, discussing how they are using virtual health assistants (e.g. AI Chatbots, Voice) to increase efficiency in care delivery and enhance the patient experience.

Virtual Assistants in Healthcare

Consumers are demanding convenience and want to interact with companies any time anywhere. Companies across different industries such as retail, travel and financial services are responding with virtual assistant tools, enabling consumers to get answers and transact 24x7.

Within healthcare, innovation driven organizations are exploring how to empower patients with virtual health agents to access relevant care information (e.g. learn about how to prepare for a procedure, determine when to call the doctor following surgery), get tasks done (e.g. schedule and participate in a virtual visit) and get guidance on a care plan (e.g. reminders to refill medication, follow up doctor’s appointments).

The strong interest in AI driven virtual health assistants aligns with Accenture’s Digital Health Tech Vision 2019 trend #5 “MYMARKETS: Meeting customer’s needs at the speed of now”. The Accenture report explains “digital expectations have now evolved and a new opportunity to deliver better experiences is on the table: capturing moments. Technology has created a world of intensely customized and on-demand experiences, so healthcare organizations must reinvent themselves to find and capture those opportunities as they come”.

Value of Virtual Health Assistants

When you think about the gaps in healthcare efficiency today, you can envision how virtual health assistants can support patients and the care team.

There are many valuable use cases for Virtual Health Assistants to help patients prepare and manage their care, with reminders, education (e.g. health condition, procedure) and the capability to escalate to a care provider as needed.

On the clinical side, the care team can capture, monitor and communicate with patients. Instead of making outbound calls trying to reach patients, staff can see which patients are in pain, have questions/concerns or are in need of immediate care. 

Panelist Virtual Health Assistant Use Cases

When presenting their use cases for Virtual Health Assistants, panelists shared their specific business goals such as decreasing readmissions/ED visits and costs, increasing service utilization, improving care plan compliance and enhancing the patient experience. All panelists view these virtual health assistants as an “extension” of their care delivery.

Boston Children’s Hospital (BCH): In 2018, BCH teamed up with Seattle Children’s on an Alexa skill, Flu Doctor, providing parents with answers to questions about the flu which are “personalized, science-backed data and recommendations”. Panelist Devin Nadar, Senior Partnerships Manager, Innovation and Digital Health Accelerator discussed a more recent Alexa skill -“My Children’s Enhanced Recovery After Surgery (ERAS)”, which is part of the program for all cardiac patients undergoing specific surgeries at BCH.  Built on the Amazon platform, this skill to desgned to capture information from the parent about how the child is doing after the surgery and indicate if there is a follow up appointment scheduled. “We know that parents really don’t want to come back to the hospital after surgery”, Devin adds.  After accessing “My Childrens” through the Amazon Alexa Store, the parent begins to “check in” the day after the patient is discharged and receives pertinent information for that day.” Before this tool, it was “like a black box” about what happens while the patient is recovering. Now BCH can focus clinical resources on patients with priority needs.   

Dana-Farber/Brigham and Women's Cancer: “Earlier this year we developed and are planning to launch an Orbita powered health assistant to support prostate cancer patients who are on a “lifelong journey” with ongoing PSA testing” shares Rich Boyajian, NP Program Director, Virtual PSA Monitoring, Radiation Oncology. This chatbot will send a link to the patient to engage via text and/or voice on their phone. It is designed to  “onboard” him into the program, present the closest lab, deliver good PSA test results and enable him to request contact with a care team member. “Patients can select the modality for this follow up contact by email, a call or even a virtual visit”, explains Rich. “It was easy for me to write the virtual health assistant script (i.e. questions and answers) to engage with the patient since I do this all the time. We selected the Orbita platform because we can put this content in one time and it be accessed by the patient through their preferred modality”.

Northwell Health: In 2018, Northwell launched Health Chats, an AI text chatbot powered by Conversa Health, which empowers patients to stay connected to their care navigator through recovery. This gives the staff visibility into what is really happening when the patient leaves the hospital. “We selected Conversa Health because it is easy for the patient who doesn’t need to download an app. Instead the patient receives a chat notification through an email or SMS text message and simply clicks on the link to start the chat through their mobile phone”, explains Hallie Bleau, ACNP-BC, AVP Transitional Care Management, Health Solutions. The Health Chat engages the patient post discharge to “self -assess and manage symptoms”.  Since Northwell Health integrated the Health Chat into their care management system, the information that the patient types in (problems, pain level) is feed into an algorithm to flag the patient on the nurse’s dashboard for an immediate contact. The patient can connect with a nurse through the Health Chat application at any time.

Panelist Insights on Virtual Health Assistants

Many lessons learned were shared by the panelists including considerations for both patient and staff engagement. One common theme was that the planning for these Virtual Health Assistants takes time. “We needed 6-8 months to get staff buy- in and patient consent”, admits Hallie.

Patient Considerations:

Determine fit with the patient’s current technology. “With our 65+ Medicare population at Northwell Health, we realized that one big barrier was some patients still have a flip phone which will not work with our chatbot”, Hallie explains.

Understand patient expectations. “In our Alexa skill, we ask if the caregiver would like the doctor/nurse to call. We know there are differences in how long the call back will take so we need to set the proper expectations for when they can expect a return call ”, shares Devin.

All panelists expressed an interest in learning from patients about their experiences. “We built into the Alexa skill ‘did that answer your question’ so that we can capture their feedback and make changes to our script”, Devin explains.

Patients have shared insightful comments about their virtual health assistant interactions. “Our patients at Northwell Health feel that someone is always thinking about them. In a 30 day period, we are able to increase the number of touches by 5-6 contacts”.  Hallie went on to say “we thought that caregivers would be more interested in seeing these digital conversations with mom. We learned some didn’t because ‘she doesn’t live with me’. Several seniors do not want to ‘bother their daughter with this information’. We have also learned that patients who are hard of hearing really like to use the chatbot because it is easier to communicate with the care team”.  

Staff Considerations:  

During the planning stages, panelists feel it is important to educate their staff. They need to feel comfortable with this new digital interaction, understand how to describe it to patients and have a clear picture how this will impact their workflow. Specific considerations include:

Extensive staff education. “We were surprised at the amount of time/education required with our staff. They needed to understand why and what does it mean for them”, admits Hallie.

Devin adds “we train with our staff, demonstrate the app and provide a cheat sheet for reference, which tells about them about our Alexa skill, how to open it, start it, stop it, what you can ask and what it is used for”.

Stage the implementation. “We have limited the roll out of the voice app to 5-10 per week because we did not want to overwhelm our staff at BCH”, explains Devin.

Success Measures & Future Virtual Health Assistants

Later in the year, panelists will be evaluating their program from an experience (patient, staff), operational efficiency and clinical perspective.

“At BCH, we want to see if parents are completing the questions and determining where they drop off so that we can build a better experience”, describes Devin.

“Our virtual health assistant is replacing the manual labor from looking up the nearest lab to calling cancer patients about positive test results”, shares Rich. “As an extension of our care, we expect to decrease the number of follow up in person visits which will free us up to care for more patients”.

“Our staff is seeing the fruits of labor… ‘we don’t have to call him’, ‘we can quickly get to the root of the problem”, adds Hallie.

Panelists expressed the need in the future to capture and place pertinent information from the digital health interaction into the patient’s electronic medical record.

Future Plans: 

Refine conversation based on role. “At Northwell Health, we are talking about tweaking the conversation for the caregiver”, explains Hallie.

Expand languages. “We currently offer our chatbot in English and Spanish but will add other languages”, Hallie shares.  

Add new capabilities. “We plan to add more symptoms to our health assistant to provide more information for our PSA monitoring”, explains Rich.

Extend the Experience. “We are working on expanding the digital conversation from 30 to 90 days so that we have more insight into their receovery”, mentions Hallie.

Connect into Virtual Care. “At BCH, we are thinking about triggering a virtual visit when the parent indicates that she needs to speak with someone”, shares Devin. 

Northwell Health is planning to continuously launch Health Chats across their organization given their strategic investment in ConversaHealth. “We have already launched Health Chats to patients with head and neck cancer and are getting ready to roll out them out in our cardiac surgery department” Hallie concludes.

During the Voice.Health Summit in Boston last week, innovators gathered to explore opportunities, discuss issues and to experience different voice technology use cases.

BCH John Brownstein shares voice health use casesJohn Brownstein, Chief Innovation Officer at Boston Children’s Hospital is excited about the opportunity for healthcare to lead other verticals with this empowering technology which many of us use every day – Alexa tell me… Siri what is… ?

Since the year 2000, the health technology industry has evolved from websites (e.g. patient portals) to mobile applications (mhealth) and now to voice and conversational assistants. There are many use cases which help patients and providers in different settings.

• In hospital, the doctor asks to see the patient’s latest lab results.
• Following a hospital discharge, the patient interacts with his virtual robot to record side effects from his new medications.
• Preparing for an outpatient visit, a patient verbally responds to the pre-visit questions to share with her doctor.
• Days after a remote monitoring visit, a patient asks additional questions to help her manage her asthma.

Although voice health technology is in the early adoption stage, health innovators are convinced that these virtual voice assistants can address real problems -- the shortage of healthcare professionals, clinician burn out, inefficiencies in patient care, lack of patient engagement and the inability to personally support patients along their health journey outside of the hospital. Nuance’s Peter Durlach stresses the importance of using these technologies to free up the clinicians to take care of patients.

Voice has many unique benefits for healthcare. Dr. Rupal Patel, CEO VocalID describes the convenience (e.g. hands free), the capability to capture information and insights about the user (e.g. gender, size, bio- markers) and ability to generate trust through continuous listening and personalized responses. Other benefits include the ability to capture context (e.g. surroundings, urgency and intent) and empower the user (e.g. patient feels a sense of control). Amazon’s Emily Roberts, Sr. Marketing Manager adds the value of capturing “moments of the day” by incorporating voice into other devices (e.g. smart home/refrigerator, car).

Voice Health in Action

During the Voice.Health Summit, we saw what “voice-first” can deliver in five different care setting exhibits. Here are some interesting examples of use cases to bring value to patients and/or the care team.

1. Hospital/Patient. With the Joint Commission’s focus on “accurate screening and assessment of pain”, Dr. Samir Tulebaev, Geriatrician and the Center of Nursing Excellence at Brigham and Women’s Hospital are working with Orbita’s CEO Nate Treloar on the development of a post- operative pain management voice assistant. The patient tells her bedside teddy bear Briggie (which has a built in microphone) that she is in pain, describes where the pain is and indicates if the pain is intolerable. Her nurse immediately receives a secure text message to respond.

2. Hospital/Clinical. Cedars-Sinai uses Sopris Assistant to record, summarize, approve and place the patient care note into the EHR. The AI summons the listening technology, drives the summary and produces the intelligent note for physicians. Cedars-Sinai helped Sopris Health create an experience and workflow catered to hospitalist.

3. Senior Living & Home Health. Caregivers can engage an aging patient with the AI powered LifePod virtual assistant which serves as a personalized companion, delivers reminders, and monitors daily activities. LifePod’s CEO Stuart Patterson emphasized the importance of “proactive voice” which shares and captures essential information without relying on the person to ask (i.e. reactive voice).  

4. Consumer Home. Anne Weiler, CEO Wellpepper, the winner of the Alexa Diabetes Challenge, engages a patient who is recently diagnosed with type 2 Diabetes. She uses her voice to weigh herself, scan her feet for ulcers and track her care plan tasks. This voice assistant gives the patient an opportunity to proactively engage whenever she wants.

5. Vocal Biomarker Lab. Sonde Health is interested in capturing and using a patient’s voice samples as health measures for different physical (e.g. sinus congestion) and mental health conditions (e.g. depression, suicide risk). 

Lessons from Voice Health Innovators

As with any new technology, there is a lot to learn from the pioneers.

Real Problem Definition: Sara Holoubek, CEO Luminary Labs emphasized the importance of deciding who (e.g. newly diagnosed) and what (e.g. help with self-management) as a first step to focus the development planning process.

Patient/User Input: Deloitte's Debbie Hays, Specialist Executive discussed the patient journey research for the DeloitteASSIST voice solution which revealed the “challenges and delays” that needed to be addressed while the patient is in the hospital room.

Patient/User Feedback: Karin Beckstrom, Sr. Product Manager ERT Innovation Lab (formally PHT) described using voice to capture patient reported outcomes (PROs) on a daily basis. We ask-- how engaging was it? Are you willing to answer questions on a daily basis? How difficult was the skill? Did Alexa understand you?  

"Flu Doctor" from Seattle Children's Hospital Stacey UlaciaPersonalization: Stacey Ulacia, Sr. Communications Specialist at Seattle Children’s Hospital in partnership with Boston Children’s Hospital, developed the “Flu Doctor” voice skill. This brings more value since it is customized based on the zip code provided by the patient.

Opportunities for Voice to Solve Healthcare Problems

There are many use cases for voice technology to help drive the triple aim. 

UPMC’s Dr. Shivdev Rao believes it would be valuable to use voice to help triage a care situation, and capture information from the patient pre or post exam.

Boston Children’s Hospital Dr. Docktor shared Pediatrics Voice Hackathon examples including one which uses voice to help a patient prepare for his procedure at home with instructions and images that are tailored to his specific health issues (e.g. food problems).  

Cedars-Sinai Medical Center in Los Angeles is collaborating with Sumeet Bhalitia, Founder & CEO Avia to bring voice into the hospital room, giving the patient control over their experience and the ability to get assistance as needed (e.g. bathroom help) with the goal of increased patient satisfaction.  

Recent metrics for Answers by CignaCigna’s Laura Schuntermann, Global Head of Digital Strategy & Partnerships is excited by the growth of voice search. Gartner predicts by 2020, 30% of searches will be voice activated. Laura shared results from the voice solution Answers by Cigna which helps members get the information they need to make better health care decisions.

Novartis’s Robert Stevens, Executive Director of Digital Strategy & Medical Innovation described voice health use cases that help clinicians determine the diagnosis/clinical decision support, check guidelines, send RXs to pharmacy and order follow up patient education.   

Future Voice Health Considerations

Although there is excitement around voice health, innovators are working to remove speed bumps to accelerate adoption:

Addressing Privacy/Security. Several organizations are anxiously awaiting for HIPAA compliant voice devices. There is also a concern that the device is always listening, even without the “wake” word.  

Educating Patients about Voice. A few presenters admitted that patients do not know what they can ask. This means that either they are not using all of the voice capabilities or the patient has an unexpected experience -- Alexa says …. Hmm I do not know that one.

Mayo Clinic's Optimizing Voice Content Creating complete Patient Experiences. Mayo Clinic’s Jennifer Warner, Sr Editor Global Business Solutions explains that voice is additive and does not replace other consumer engagement methods. Therefore, it is important to provide an “omni-channel” experience to engage and support the patient through every touch point. 

Collaborating on Care Design. Maia Ottenstein, Digital Experience Design at Thomas Jefferson University Hospital (DICE/design group within the hospital) is working on the “smart patient concierge” which empowers the patient to access assistance and resources on demand.

It will take a community of patient and clinical stakeholders to define, design and deliver voice technologies that bring real value to the users. It is encouraging to see that these stakeholders are coming together in hospitals, accelerators and innovation hubs to bring these voice technologies to life.