Facial Mimicry and Doctor-Patient Satisfaction: The Feasibility of Artificial Empathy in a Clinical Video Data

Rahmanti, Annisa Ristya and Huang, Chih-Wei and Muhtar, Muhammad Solihuddin and Yang, Hsuan-Chia and Li, Yu-Chuan Jack (2024) Facial Mimicry and Doctor-Patient Satisfaction: The Feasibility of Artificial Empathy in a Clinical Video Data. Studies in Health Technology and Informatics, 310. pp. 1116-1120. ISSN 09269630

[thumbnail of 254_Annisa Ristya Rahmanti.pdf] Text
254_Annisa Ristya Rahmanti.pdf - Published Version
Restricted to Registered users only
Available under License Creative Commons Attribution.

Download (310kB) | Request a copy

Abstract

Good nonverbal communication between doctor and patient is essential for achieving a successful and therapeutic doctor-patient relationship. Increasing evidence has shown that nonverbal communication mimicry, particularly facial mimicry, where one mirrors another's facial expressions, is linked to empathy and emotion recognition. Empathy is also the key driver of patient satisfaction. This study explores how facial expressions and facial mimicry influence doctor-patient satisfaction during a clinical encounter. We used a facial emotion recognition-based artificial empathy model to analyze 315 recorded clinical video data of doctors and patients in a dermatology outpatient clinic. The results show a significant negative correlation between patients' emotions of sadness and neutral and doctor satisfaction, but no correlation between the duration of doctors mimicking patient emotions and patient satisfaction. These findings provide valuable insights into the future design of systems that can further enhance clinician awareness to maintain communication skills in the search for better doctor-patient satisfaction. © 2024 International Medical Informatics Association (IMIA) and IOS Press.

Item Type: Article
Additional Information: Cited by: 1; Conference name: 19th World Congress on Medical and Health Informatics, MedInfo 2023; Conference date: 8 July 2023 through 12 July 2023; Conference code: 198290; All Open Access, Hybrid Gold Open Access
Uncontrolled Keywords: Emotions; Empathy; Feasibility Studies; Humans; Physician-Patient Relations; Physicians; Face recognition; Medical informatics; Speech recognition; Video recording; Artificial empathy; Clinical video database; Doctor-patient satisfaction; Emotion recognition; Facial Expressions; Facial mimicry; Non-verbal communications; Patient's satisfaction; Video data; Video database; doctor patient relationship; emotion; empathy; feasibility study; human; physician; Emotion Recognition
Subjects: R Medicine > RB Biomedical Sciences
Divisions: Faculty of Medicine, Public Health and Nursing > Biomedical Sciences
Depositing User: Ngesti Gandini
Date Deposited: 18 Mar 2025 03:08
Last Modified: 18 Mar 2025 03:08
URI: https://ir.lib.ugm.ac.id/id/eprint/15809

Actions (login required)

View Item
View Item