Do you understand the words that are comin outta my mouth? Voice assistant comprehension of medication names.

Palanica, Adam; Thommandram, Anirudh; Lee, Andrew; Li, Michael; Fossat, Yan · NPJ Digit Med · 2019

other

Where this comes from

Abstract

This study investigated the speech recognition abilities of popular voice assistants when being verbally asked about commonly dispensed medications by a variety of participants. Voice recordings of 46 participants (12 of which had a foreign accent in English) were played back to Amazon's Alexa, Google Assistant, and Apple's Siri for the brand- and generic names of the top 50 most dispensed medications in the United States. A repeated measures ANOVA indicated that Google Assistant achieved the highest comprehension accuracy for both brand medication names (<i>M</i> = 91.8%, SD = 4.2) and generic medication names (<i>M</i> = 84.3%, SD = 11.2), followed by Siri (brand names <i>M</i> = 58.5%, SD = 11.2; generic names <i>M</i> = 51.2%, SD = 16.0), and the lowest accuracy by Alexa (brand names <i>M</i> = 54.6%, SD = 10.8; generic names <i>M</i> = 45.5%, SD = 15.4). An interaction between voice assistant and participant accent was also found, demonstrating lower comprehension performance overall for those with a foreign accent using Siri (<i>M</i> = 48.8%, SD = 11.8) and Alexa (<i>M</i> = 41.7%, SD = 12.7), compared to participants without a foreign accent (Siri <i>M</i> = 57.0%, SD = 11.7; Alexa <i>M</i> = 53.0%, SD = 10.9). No significant difference between participant accents were found for Google Assistant. These findings show a substantial performance lead for Google Assistant compared to its voice assistant competitors when comprehending medication names, but there is still room for improvement.