Evaluation Tools for Assistive Technologies: A Scoping Review.

Abstract

Assistive technologies (ATs) support independence and well-being in people with cognitive, perceptual, and physical limitations. Given the increasing availability and diversity of ATs, evaluating the usefulness of current and emerging ATs is crucial for informed comparison. We aimed to chart the landscape and development of AT evaluation tools (ETs; ATETs) across disparate fields in order to improve the process of AT evaluation and development. We performed a scoping review of ATETs through database searching of MEDLINE, Embase, CINAHL, HaPI, PsycINFO, Cochrane Reviews, and Compendex as well as citation mining. Articles explicitly referencing ATETs were retained for screening. We included ETs if they were designed to specifically evaluate ATs. We extracted 5 attributes of ATETs: AT category, construct evaluated, conceptual frameworks, type of end user input used for ATET development, and presence of validity testing. From screening 23,434 records, we included 159 ATETs. Specificity of tools ranged from single to general ATs across 40 AT categories. Satisfaction, functional performance, and usage were the most common constructs of 103 identified. We identified 34 conceptual frameworks across 53 ETs. Finally, 36% incorporated end user input and 80% showed validation testing. We characterized a wide range of AT categories with diverse approaches to their evaluation based on varied conceptual frameworks. Combining these frameworks in future ATETs may provide more holistic views of AT usefulness. ATET selection may be improved with guidelines for conceptually reconciling results of disparate ATETs. Future ATET development may benefit from more integrated approaches to end user engagement.