Abstract
Background:
Readability is a vital component of health information and providing this material at an appropriate literacy level may positively influence patient experience.
Objective:
To assess the readability of the information provided within total hip replacement and total knee replacement apps to understand more about the impact this could have on patients.
Method:
A systematic search was conducted across the 5 most popular smartphone app stores: iTunes, Google Play, Windows Mobile, Blackberry App World, and Nokia Ovi. Apps were identified for screening if they: targeted total hip replacement or total knee replacement patients; were free of charge; and were in English. App readability assessment was conducted independently by 3 reviewers using the Gunning Fog Index, the Flesch Reading Ease Score, and the Flesch-Kincaid Grade Level.
Results:
Fifteen apps met the inclusion criteria. Only one app was found “easy to read” (My THR).
Conclusion:
Findings suggest that the overall readability of information provided is written at a level which is difficult for patients to comprehend. App developers should engage patients in the design process of their apps, in order to enhance patient experience and for the potential impact of these innovative health technologies to be truly realized.
Keywords: smartphone, apps, patient experience, total hip replacement, total knee replacement
Introduction
Total hip replacement (THR) and total knee replacement (TKR) surgeries are 2 of the most commonly undertaken procedures worldwide. However, the experience of the patient undergoing rehabilitation following THR and TKR can be highly variable (1). This may be due to the fact that written materials and patient information sheets have been found to vary in quality (2) and readability (3). Meanwhile, technical advances (in particular the widespread use of smartphones) have indicated that smartphone apps may have potential in enhancing rehabilitation and encouraging self-management following THR/TKR.
A recent systematic review examined the quality of smartphone apps targeted toward THR and TKR patients (4). It found that despite a wide range of apps currently available to THR and TKR patients, there is significant variability in their aesthetics, functionality, engagement, and quality of information (4). In addition to these aspects, readability is a vital component of health information and providing this material at an appropriate literacy level may positively influence patient experience. Existing readability scales such as the Gunning Fog Index (GFI), the Flesch Reading Ease Score (FRES), and the Flesch-Kincaid Grade Level (FKGL) have traditionally been used for assessing the formal education a person needs to understand the text on the first reading (5,6), and more recently health-care websites (5,7,8). To date however, there has been no evaluation of the readability of information on smartphone apps and how this might impact upon patients. This study aims to build on existing studies related to THR and TKR smartphone apps and to assess the readability of the information present on such apps in order to understand more about the impact this could have on patients.
Method
The search strategy implemented in the study of Bahadori et al (4) was used to retrieve apps from the following sources: Android Google Play, Apple iTunes, BlackBerry World, Windows App Store, and Nokia Ovi Suite. These searches identified 2613 potentially relevant apps, of which 15 apps were include for analysis following the application of inclusion and exclusion criteria (4). Apps were excluded from evaluation if their primary focus was professional practice (ie, apps targeted toward surgeons/clinicians rather than patients); they were not available in the United Kingdom; required purchasing/special login access; outlined general physiotherapy exercises only; were a game (rather than an information app); were not in English; were an advertisement for a company; were solely journal or conference related; or were not related to THR or TKR.
The GFI, FRES, and FKGL are designed to indicate how difficult a passage in English is to understand (6,7). The GFI estimates the number of years of formal education required to understand the text on first reading. GFI scores range from 0 to 19+ and represent the reading level of the document. Scores of 0 to 6 correlate with low-literacy resources, 7 to 8 with resources comprehendible by junior high school students, 9 to 12 by high school students, 13 to 16 by college students, 17 to 18 by graduates, and 19 + by those with higher professional qualifications (9). An online tool was utilized to calculate the GFI for each app (10).
The FRES uses the length of sentences and the number of polysyllabic words to determine the overall FRES, while the FKGL utilizes the mean sentence and word length to calculate the complexity of the reading level (7). The FRES scores range from 0 to100, and a higher score is indicative of text that is easy to read (5). The FKGL scores range from 1 to 12 (corresponding to US educational school grades), with scores higher than 12 indicative of college level and domain-specific experts (5). The FRES is calculated using the formula 206.835 − (1.015 × average sentence lengths [ASLs]) − (84.6 × average number of syllables per word [ASW]). The FKGL is a modified version of the FRES scale and is calculated as (0.39 × ASL) + (11.8 × ASW) − 15.59. The inbuilt readability statistics feature of Microsoft Word 2007 was used to determine the FRES and FKGL for each app (7).
The lead author (S.B.) downloaded each of the apps and selected a body of text (approximately 150-250 words) from the main information page of each app (7). For each of the included apps the platform that they were available on was recorded, along with the clinical focus of the app (ie, THR, TKR, or both), provider (ie, governmental institution, nongovernmental institution [NGI]), and the characteristics of the app (ie, star rating, last update). The readability evaluation was carried out initially by the lead author (S.B.) and then repeated by one of the other members of the research team (T.W.W./O.H.A.), with verification occurring from cross-checking for consistency. Once all researchers had completed their assessment, results were pooled and where differences in the scoring existed, agreement was reached via consensus. This is in keeping with similar studies looking at readability of online health information (7).
Results
The 15 apps included for analysis are outlined in Table 1 alongside their GFI, FRES, and FKGL data. Readability scores ranged from 6.4 to 10.9 (mean = 9.1, standard deviation [SD] = 1.4) for GFI, 46.4 to 89.4 (mean = 56.9, SD = 11.3) for FRES, and from 7 to 12.4 (mean = 9.7, SD = 1.3) for FKGL. Only one app (“My THR”) could be interpreted as “easy to read,” that is, it had a readability score of FKGL below 3.3, a GFI below sixth grade, and an FRES above 85.
Table 1.
Basic Information of the Retrieved Apps and Their Readability Data.
Name of App | Platform | THR or TKR or Both | Star Rating | Last Updated | Providera | FRES (0-100) | FKGL (1-12) | GFI |
---|---|---|---|---|---|---|---|---|
BeeWell Orthopaedic Hip | Apple iTunes | THR | NR | June 22, 2017 | NGI | 54.2 | 6.7 | 9.1 |
Hip Miss Samantha Z Troos | Apple iTunes | Both | NR | November 10, 2018 | NGI | 49.8 | 10.4 | 9.4 |
BeeWell Orthopaedic Knee | Apple iTunes | TKR | 3.1 | June 22, 2017 | NGI | 44.8 | 8.3 | 8.7 |
GreenCare Guide for Knee | Apple iTunes | TKR | NR | September 13, 2016 | NGI | 59.0 | 9.4 | 10.1 |
My Knee | Apple iTunes | TKR | NR | August 11, 2017 | NGI | 46.4 | 12.4 | 6.8 |
My Knee Guide | Apple iTunes | TKR | 4.6 | June 07, 2016 | NGI | 54.0 | 9.2 | 9.9 |
My THR | Google Play | THR | 5.0 | March 15, 2017 | NGI | 89.4 | 3.3 | 5.8 |
CommonSurgeries | Google Play | Both | 3.9 | March 05, 2015 | NGI | 48.9 | 10.2 | 7.0 |
Pocket Physio | Google Play | Both | 4.3 | April 06, 2016 | NGI | 54.7 | 6.0 | 9.3 |
Knee Pain Relieving | Google Play | TKR | 4.4 | December 31, 2016 | NGI | 74.6 | 5.5 | 10.9 |
Knee Pain Protocol | Google Play | TKR | 4.6 | December 02, 2018 | NGI | 63.5 | 7.0 | 10.6 |
Sport Injury Clinic | Google Play | Both | 4.2 | April 20, 2012 | NGI | 49.9 | 9.3 | 9.2 |
Ortho | Google Play | TKR | 3.7 | June 03, 2017 | NGI | 55.3 | 6.9 | 9.6 |
Know About Surgery treatment | Google Play | Both | NR | May 30, 2017 | NGI | 60.3 | 7.3 | 10.8 |
Healthy Knee | Blackberry | TKR | NR | August 05, 2015 | NGI | 49.3 | 8.9 | 8.6 |
Mean | 56.9 | 9.7 | 9.1 | |||||
Standard deviation | 11.3 | 1.3 | 1.4 |
Abbreviations: FKGL, Flesch-Kincaid Grade Level; FRES, Flesch Reading Ease Score; GFI, Gunning Fog Index; NGI, nongovernmental institution; NR, none reported; THR, total hip replacement; TKR, total knee replacement.
aType of provider is determined by answering “Credibility” questions 18 of MARS (11).
Discussion
To the best of our knowledge, this is the first study to assess the readability of health information on smartphone apps. This is of importance because providing educational materials at an appropriate level of readability may help to enhance the patient experience.
An earlier evaluation of smartphone apps for THR and TKR patients suggested that despite a wide range of apps being available, there is significant variability in their quality (4). The findings from our study also suggest that the information on THR- and TKR-related smartphone apps is not written at a level which is easily comprehendible by the general public.
This is of concern, given that differences in patient health literacy have been associated with differences in health outcomes (6,12,13). Previous work from the United States has shown that a significant proportion of the general public struggle with comprehending health-care information in the printed format (14), with the recommendation made that health information should be targeted toward an FKGL of around 6 (15). Furthermore, the available health information should be at a GFI level which is easy to understand by the general public and is not lost behind medical vocabulary (5). Practically, there are several steps that can be taken to improve the readability of health information within a smartphone app. Several of our key recommendations for ensuring readability of future THR and TKR apps (and other health-care-related apps) are highlighted in Figure 1.
Figure 1.
Recommendations for enhancing the readability of health-related apps.
In addition, all of the apps identified in this study were developed by NGIs, and as such no appraisal can be made regarding the association between the level of readability within apps and the type of provider. Inviting patients to participate in the evaluation and testing of health apps is an important stage in ensuring that readability requirements are met, and that the patient is at the center of this process.
Conclusion
This study used the FRES and FKGL tools to evaluate the information on smartphone apps for THR and TKR patients. Findings suggest that the overall readability of information provided is written at a level which is difficult to read level for patients. App developers should engage patients in the design process of their apps, in order to enhance patient experience and for the impact of these innovative health technologies to be truly realized.
Author Biographies
Shayan Bahadori is a biomedical engineer, and is a research project manager at Bournemouth University.
Thomas W Wainwright is a physiotherapist, and is an associate professor in Orthopaedics at Bournemouth University.
Osman H Ahmed is a physiotherapist, and is a senior lecturer in Sports Therapy at Bournemouth University.
Footnotes
Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) received no financial support for the research, authorship, and/or publication of this article.
ORCID iDs: Shayan Bahadori
https://orcid.org/0000-0003-0201-9840
Thomas W Wainwright
https://orcid.org/0000-0001-7860-2990
References
- 1. Bandholm T, Wainwright TW, Kehlet H. Rehabilitation strategies for optimisation of functional recovery after major joint replacement. J Exp Orthop. 2018;5:44 doi:10.1186/s40634-018-0156-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Wainwright TW, Burgess LC. To what extent do current total hip and knee replacement patient information resources adhere to enhanced recovery after surgery principles? Physiotherapy. 2018;104:327–37. doi:10.1016/j.physio.2018.05.002. [DOI] [PubMed] [Google Scholar]
- 3. Shnaekel AW, Hadden KB, Moore TD, Prince LY, Lowry Barnes C. Readability of patient educational materials for total hip and knee arthroplasty. J Surg Orthop Adv. 2018;27:72–6. [PubMed] [Google Scholar]
- 4. Bahadori S, Wainwright TW, Ahmed OH. Smartphone apps for total hip replacement and total knee replacement surgery patients: a systematic review. Disabil Rehabil. 2018:1–6. doi:10.1080/09638288.2018.1514661. [DOI] [PubMed] [Google Scholar]
- 5. Ma Y, Yang AC, Duan Y, Dong M, Yeung AS. Quality and readability of online information resources on insomnia. Front Med. 2017;11:423–31. doi:10.1007/s11684-017-0524-9. [DOI] [PubMed] [Google Scholar]
- 6. Badarudeen S, Sabharwal S. Assessing readability of patient education materials: current role in orthopaedics. Clin Orthop Relat Res. 2010;468:2572–80. doi:10.1007/s11999-010-1380-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Ahmed OH, Sullivan SJ, Schneiders AG, McCrory PR. Concussion information online: evaluation of information quality, content and readability of concussion-related websites. Br J Sports Med. 2012;46:675–83. doi:10.1136/bjsm.2010.081620. [DOI] [PubMed] [Google Scholar]
- 8. Raj S, Sharma VL, Singh AJ, Goel S. Evaluation of quality and readability of health information websites identified through India’s major search engines. Adv Prev Med. 2016;2016:4815285 doi:10.1155/2016/4815285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Toogood PA, Abdel MP, Spear JA, Cook SM, Cook DJ, Taunton MJ. The monitoring of activity at home after total hip arthroplasty. Bone Joint J. 2016;98-B:1450–4. doi:10.1302/0301-620x.98b11.bjj-2016-0194.r1. [DOI] [PubMed] [Google Scholar]
- 10. Bond S. Gunning Fog Index. 2019, http://gunning-fog-index.com/index.html (accessed May 3, 2019).
- 11. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3:e27 doi:10.2196/mhealth.3422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Bobian M, Kandinov A, El-Kashlan N, Svider PF, Folbe AJ, Mayerhoff R, et al. Mobile applications and patient education: are currently available GERD mobile apps sufficient? Laryngoscope. 2017;127:1775–9. doi:10.1002/lary.26341. [DOI] [PubMed] [Google Scholar]
- 13. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155:97–107. doi:10.7326/0003-4819-155-2-201107190-00005. [DOI] [PubMed] [Google Scholar]
- 14. Clauson KA, Zeng-Treitler Q, Kandula S. Readability of patient and health care professional targeted dietary supplement leaflets used for diabetes and chronic fatigue syndrome. J Altern Complement Med. 2010;16:119–24. doi:10.1089/acm.2008.0611. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Vallance JK, Taylor LM, Lavallee C. Suitability and readability assessment of educational print resources related to physical activity: implications and recommendations for practice. Patient Educ Couns. 2008;72:342–9. doi:10.1016/j.pec.2008.03.010. [DOI] [PubMed] [Google Scholar]