The Library
System usability scale benchmarking for digital health apps : meta-analysis
Tools
Hyzy, Maciej, Bond, Raymond, Mulvenna, Maurice, Bai, Lu, Dix, Alan, Leigh, Simon J. and Hunt, Sophie (2022) System usability scale benchmarking for digital health apps : meta-analysis. JMIR mHealth and uHealth, 10 (8). e37290. doi:10.2196/37290 ISSN 2291-5222.
|
PDF
WRAP-system-usability-scale-benchmarking-digital-health-apps-meta-analysis-Leigh-2022.pdf - Published Version - Requires a PDF viewer. Available under License Creative Commons Attribution 4.0. Download (367Kb) | Preview |
Official URL: https://doi.org/10.2196/37290
Abstract
The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS was not specifically designed to evaluate mobile apps, or in particular digital health apps (DHAs). The aim of this study was to examine whether the widely used SUS distribution for benchmarking (mean 68, SD 12.5) can be used to reliably assess the usability of DHAs. A search of the literature was performed using the ACM Digital Library, IEEE Xplore, CORE, PubMed, and Google Scholar databases to identify SUS scores related to the usability of DHAs for meta-analysis. This study included papers that published the SUS scores of the evaluated DHAs from 2011 to 2021 to get a 10-year representation. In total, 117 SUS scores for 114 DHAs were identified. R Studio and the R programming language were used to model the DHA SUS distribution, with a 1-sample, 2-tailed t test used to compare this distribution with the standard SUS distribution. The mean SUS score when all the collected apps were included was 76.64 (SD 15.12); however, this distribution exhibited asymmetrical skewness (-0.52) and was not normally distributed according to Shapiro-Wilk test (P=.002). The mean SUS score for "physical activity" apps was 83.28 (SD 12.39) and drove the skewness. Hence, the mean SUS score for all collected apps excluding "physical activity" apps was 68.05 (SD 14.05). A 1-sample, 2-tailed t test indicated that this health app SUS distribution was not statistically significantly different from the standard SUS distribution (P=.98). This study concludes that the SUS and the widely accepted benchmark of a mean SUS score of 68 (SD 12.5) are suitable for evaluating the usability of DHAs. We speculate as to why physical activity apps received higher SUS scores than expected. A template for reporting mean SUS scores to facilitate meta-analysis is proposed, together with future work that could be done to further examine the SUS benchmark scores for DHAs.
Item Type: | Journal Article | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Subjects: | R Medicine > R Medicine (General) | |||||||||
Divisions: | Faculty of Science, Engineering and Medicine > Engineering > WMG (Formerly the Warwick Manufacturing Group) | |||||||||
SWORD Depositor: | Library Publications Router | |||||||||
Library of Congress Subject Headings (LCSH): | Wireless communication systems in medical care, Medical Informatics, Telecommunication in medicine, Medical technology, User interfaces (Computer systems), Human-computer interaction | |||||||||
Journal or Publication Title: | JMIR mHealth and uHealth | |||||||||
Publisher: | JMIR Publications | |||||||||
ISSN: | 2291-5222 | |||||||||
Official Date: | 18 August 2022 | |||||||||
Dates: |
|
|||||||||
Volume: | 10 | |||||||||
Number: | 8 | |||||||||
Article Number: | e37290 | |||||||||
DOI: | 10.2196/37290 | |||||||||
Status: | Peer Reviewed | |||||||||
Publication Status: | Published | |||||||||
Access rights to Published version: | Open Access (Creative Commons) | |||||||||
Date of first compliant deposit: | 19 October 2022 | |||||||||
Date of first compliant Open Access: | 20 October 2022 | |||||||||
RIOXX Funder/Project Grant: |
|
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year