Abstract
Limited health literacy is associated with poor patient health outcomes and increased hospitalization rates. Patient-provider communication plays an important role in patient health literacy and the understanding of medical terminology. This study demonstrates how a collaboration between clinical, academic, and community partners was instrumental in the design and implementation of a clinic readiness assessment and a clinic-based pilot intervention to encourage patient-provider communication and improve patient health literacy. A state hospital association, academic research team, and community adult literacy center director collaborated to develop a 60-item clinic readiness assessment and an evidence-informed pilot intervention. The clinic readiness assessment captured clinics’ motivation and capacity for pilot implementation and providers’ current communication strategies. The intervention centered around AskMe3™ educational materials and involved 2 patient visits (initial and follow-up visits). Data collection instruments for the intervention were administered verbally and included questions about patient demographics and communication needs, and a single-item health literacy measure. Descriptive statistics (frequencies/percentages) were used to analyze results from the clinic readiness assessment and pilot intervention. Establishment of the partnership, and collaborative, iterative development of the clinic readiness assessment and pilot intervention are described. This pilot project resulted in important lessons learned which led to critical modifications that will inform future expansion of the intervention. Collaboration between healthcare leaders, researchers, and community partners is recommended for developing clinic-based health literacy initiatives.
Keywords: partnership, health literacy, clinic readiness assessment, patient-provider communication
Introduction
Health literacy is “the degree to which individuals can obtain, process and understand the basic health information and services they need to make appropriate health decisions.”1,2 In the United States, nearly 40% of adults have limited health literacy, resulting in difficulty with or inability to read and understand medical information.3,4 Limited health literacy is associated with poor health, increased hospitalization rates and use of healthcare services, dissatisfaction with care received, and higher healthcare costs.5,6 The inability to read and understand health-related materials may lead to increased feelings of shame and stigma, a lack of appropriate communication regarding health issues, and ultimately a decrease in treatment plan adherence.7-10 Limited health literacy has been considered a stronger predictor of an individual’s health status than many common socioeconomic variables.6
Medical information is generally conveyed using technical language with patient-focused print and web-based materials often written at a high school level and beyond.11 The development and use of plain-language health information that incorporates user-friendly terms, materials, and communication methods is critical for improving patient-provider communication,11,12 patient experiences and outcomes, and healthcare provider burden.13,14 With its focus on the health and well-being of the nation, relevant objectives of Healthy People 2020 are to increase the proportion of individuals who report receiving plain language medical information from providers and to increase the proportion of individuals who report being asked by providers to share back a description of their medical instructions to ensure understanding.1 In 2007, the National Patient Safety Foundation (which then merged with the Institute for Healthcare Improvement in 2017) introduced AskMe3™, a patient-focused program designed to educate patients and enable their healthcare participation through the use of 3 questions: “What is my main problem?”, “What do I need to do about it?”, and “Why is it important for me to do this?”.15,16 AskMe3™ has demonstrated effective improvement of both patient awareness and engagement.17-20 Additionally, research indicates that providers tend to share more information with patients who ask a greater number of questions.21 Together, the active patient role and increased patient-provider dialog also appear to improve information retention by the patient.21 Communication effectiveness is increased as a result of modifications made by both provider and patient.
It is known that clinical-academic-community partnerships are effective in addressing patient-provider communication and health outcomes.22-26 Such collaborations pool greater resources and enable a broader reach of health messaging.22,24,25 The organization and success of these collaborations also requires identification of program champions within both administrative and clinical settings.27 The current study describes the establishment of a collaboration between clinical, academic, and community partners to develop a clinic readiness assessment and a clinic-based pilot intervention involving AskMe3™ materials.
Development of the Collaborative Partnership
A state hospital association quality advisory council (QAC) approached a university research team for guidance on the design of a health literacy intervention that would encourage patient involvement in their care and increase provider attention to patient health literacy. The research team presented information to the QAC on health literacy, patient-provider communication, steps for developing a pilot intervention, and the importance of determining an organization’s readiness prior to intervention implementation. Following this presentation, the researchers collaborated with QAC members, 2 readiness research experts28,29 and an established community adult literacy center director12,30-33 to develop both a clinic readiness assessment and a clinic-based pilot intervention.
During this development phase, regular communication occurred between university researchers, members of the QAC, and the community adult literacy center director via meetings, emails, and conference calls, with partners’ ideas documented in Microsoft Excel (Office 365, v16) by the university researchers. The research team members also provided progress reports on monthly QAC conference calls. In addition, all of the materials and protocols developed for this initiative were presented to the QAC to guide modifications as needed for future implementation. All materials and protocols were approved by the university’s Institutional Review Board.
Development of the Clinic Readiness Assessment
Prior to implementation of an intervention, it is important to examine readiness, or the extent to which an organization is willing and able to implement a particular innovation.28 Development of the clinic readiness assessment was guided by the Interactive Systems Framework (ISF) for Dissem-ination and Implementation29 using the R = MC2 heuristic for Readiness equals Motivation × General Capacity × Innovation-Specific Capacity28 and is an adaptation of the Readiness Diagnostic Score or RDS.34 The ISF, developed in part by the Centers for Disease Control and Prevention, was initially used in the fields of youth violence and child maltreatment prevention29 however, it has been implemented widely in a variety of settings.35,36 For our initiative, the innovation was the proposed intervention that would center around the AskMe3™ questions.
The clinic readiness assessment was collaboratively finalized by the university researchers, readiness experts, community literacy center director, and QAC through a stakeholder-engaged iterative process. This process has been successfully employed in other partnerships37-40 and is based on the continued sharing and incorporating of ideas and feedback from in-person discussions, and email and telephone correspondence. The final clinic readiness assessment consisted of 6 different question categories that encompassed clinic attributes and characteristics, including clinic resources, attitudes, and leadership, as well as strategic planning, current health literacy practices, and the ability to implement new programs. A 5-point Likert Scale (“strongly agree” to “strongly disagree”) with an additional option of “not applicable” was included for each construct item. Two additional categories of questions focused on provider communication with patients. A 4-point Likert Scale (“never,” “sometimes,” “usually,” “always”) was used for these items. In all, 60-items were included in the assessment, 52 focusing on clinic resources, motivation, and capacity for change, and 8 on provider communication strategies. Together these questions were used to determine readiness and capacity of clinics to implement the health literacy focused pilot intervention.
Development of Data Collection Instruments and Intervention Protocol
Data collection instruments for the pilot intervention were developed collaboratively and included an initial patient visit questionnaire and a follow-up patient visit questionnaire that were administered verbally with patients. The initial patient visit questionnaire consisted of questions regarding the presence of a translator, or any additional persons with the patient in the exam room, as well as the published single-item literacy screener (SILS), “How often do you need to have someone help you when you read instructions, pamphlets, or other written material from your doctor or pharmacy?”,41 and 8 questions regarding provider communication strategies employed in the patient’s previous clinic visit. Three additional questions addressed the method by which the patient learned what their main health problems was, what the treatment plan was, and why it was important for them to follow said plan. Specifically, patients were asked if they were given this information unprompted, or if they had to ask the doctor these questions. This segued into the introduction and explanation of the AskMe3™ intervention materials and the use of 3 questions: “What is my main problem?”, “What do I need to do about it?”, and “Why is it important for me to do this?”.15,16 Patients were then asked if they felt that the AskMe3™ materials would be helpful in a clinic setting, or any other setting. Questions regarding demographic data, including patient age, sex, race, education level, primary language, and household income closed out the questionnaire.
The follow-up patient visit questionnaire began with the same questions regarding presence of translator or any additional persons in the exam room, and the SILS. Next, patients were asked about communication strategies used by the doctor in their previous clinic visit as well as the method (were they told or did they have to ask) by which they learned of their main health problem, the plan to address it, and the importance of following their plan. Patients were then asked if they had used the AskMe3™ questions or materials in their previous clinic visit, or in any other setting since that visit. The follow-up patient questionnaire ended with a question regarding the impact of AskMe3™ materials on the patient’s communication with healthcare providers since its introduction in their previous clinic visit. Patients’ responses during this follow-up visit were specific to their experience with the on-site doctor during their initial visit.
Intervention Protocol
Upon arrival to the clinic, the patient was greeted by the office manager at the front desk and guided to an examination room by the clinic nurse. In the examination room, the nurse proceeded with assessment of vital signs and collection of information pertinent to the day’s visit. Following this, the nurse verbally administered the initial patient visit questionnaire and introduced the AskMe3™ intervention materials and questions. The nurse explained that the AskMe3™ questions are aimed to encourage patient involvement in healthcare decision-making and guide clear communication between patient and provider. The nurse then inquired as to its potential usefulness to the patient in this or any other health related setting and collected some demographic data. The patient then met with the doctor for the day’s visit. Upon completion of the visit, the patient left the clinic.
During the follow-up visit to the clinic, the patient was greeted and guided to an examination room. In the examination room, the nurse assessed vital signs and collected information pertinent to the day’s visit. Following this, the nurse verbally administered the follow-up patient visit questionnaire. The patient then met with the doctor for the day’s visit and left the clinic upon completion of the visit. No exclusion criteria were employed for this pilot intervention; the nurse implemented the intervention with patients with whom a second visit would likely be scheduled within the next 4 weeks.
De-identified responses from each visit questionnaire were scanned and emailed securely to the research team who entered the data into IBM SPSS Statistics for Windows, version 26.0 (IBM Corp, Armonk, NY, USA) for descriptive analysis (frequencies/percentages).
Posters demonstrating plain language options for common medical terminology were also placed in clinic breakrooms to encourage the nurse and doctor’s use of plain language when conversing with patients. Both the nurse and doctor were aware of the AskMe3™ materials that patients would receive, and therefore were aware of the 3 questions contained in the materials.
Selection of Implementation Sites
A clinician who co-chaired the QAC identified 2 clinics, 1 transitional care clinic and 1 AccessHealth clinic, within the hospital system for which he served as Chief Medical Informatics Officer, as possible sites for pilot intervention implementation. The clinic readiness assessment was administered electronically via Qualtrics (Provo, UT)42 and completed by the clinic director and 1 care team member at each clinic where the intervention would be piloted. High scores on the constructs of general capacity and motivation demonstrated the pilot clinics’ strong dedication to improvement of patient care and the capacity for successful implementation of a health literacy initiative. This commitment proved pivotal to the successful implementation of the pilot intervention. Data from the clinic readiness assessment were analyzed using descriptive statistics (frequencies/percentages). Pilot implementation began in November 2018 and lasted for 32 weeks (ending July 2019).
Preliminary Pilot Data
Eighty-nine patients participated in the initial patient visit questionnaire: 57% were male (43% female); average patient age was 48 years (range 20-79). Patients self-identified as African-American (51%), non-Hispanic White (45%), Hispanic (3%), and Asian (1%), with English as their primary language (100%). Roughly 74% of patients reported receiving a high school diploma or GED. Despite a much smaller sample size for the follow-up visit (n = 13), trends were similar across all demographics except sex, with a greater number of women than men attending a follow-up appointment. [Data from the follow-up visits are not presented in this paper.] During the initial patient visit questionnaire, when asked the SILS, 27% of patients replied “never,” 30% replied “rarely,” 18% replied “sometimes,” 20% replied “often,” and 5% replied “always.” Feedback regarding the use of AskMe3™ demonstrated that 100% of participants found it useful in the clinic setting.
Lessons Learned and Recommendations
While patients found the use of AskMe3™ materials useful, there are limitations of this current initiative. Researchers and clinicians would have benefited from even more regularly scheduled calls to allow for essential feedback and to enhance communication between the research team and clinical partners. Process evaluation highlighted the need for modifications to data collection instruments for the pilot intervention as well as to patient follow-up timelines. Per communication with the nurse implementer, original iterations of patient visit questionnaires were cumbersome for both the nurse and patient to complete due to the length of the questionnaire versus the allotted time for the patient visit. In addition, the nurse expressed feeling uncomfortable inquiring about a patient’s education and household income, and as a result would skip certain questions and attempt to complete other questions herself after the patient’s appointment was over. Taking this feedback into account, the patient visit questionnaires were shortened and questions about income were removed. Additionally, the flow of the patient visit questionnaires was reorganized to allow the nurse to transition seamlessly from 1 question to the next without needing to skip items based on patient responses. Regarding patient follow-up visits, with 1 pilot clinic serving as a transitional care clinic, individuals who took part in the first patient visit questionnaire may have been referred to primary care or another specialty clinic and did not take part in the follow-up patient visit questionnaire. As such, modifications regarding follow-up procedures and requirements may have enabled data collection from a greater number of individuals during a second visit. While follow-up procedures were not modifiable during the pilot, data collection instruments were modified as needed. A formal, structured communication timeline may have allowed changes to be implemented earlier, aiding in more streamlined implementation by the nurse. These real-time observations and process evaluations served to direct protocol modifications as well as inform future implementation strategies.
Vetting of intervention protocols and data collection materials is a natural part of the development and implementation process, especially in pilot programs.38-40 This allows for identification of a streamlined approach without compromising data collection or program evaluation. In this case, feedback from the community literacy center director was essential for ensuring clear wording was used on data collection instruments for patient visits, and input from the clinical healthcare team proved critical in modifying the clinic readiness assessment and pilot intervention protocol
Based on input and findings from the pilot intervention, future implementation strategies will include onsite, clinic-specific observation to allow for a clearer understanding/mapping of workflow within each unique clinic, checklist forms to monitor implementation, modification to allow for increased patient follow-up, and a structured training for all clinic intervention implementers. As we expand this work to other clinics, we will also consider extended follow-up through telephone calls. Further, assessment of the partnership will occur throughout the project period to ensure that all collaborators’ perspectives continue to be considered in the development and implementation of our health literacy work.24,25
Despite limitations, this pilot study and the successful development of a clinical-academic-community partnership allowed for important dialogue that confirmed the need for development of a clinic-based health literacy intervention in our state. Specifically, unified efforts of the groups’ members enabled identification of interested, invested, motivated, and capable champions (ie, clinic manager and nurse implementer at the pilot intervention clinics) who were dedicated to the collaborative, as well as iterative development and implementation of the clinic readiness assessment and the pilot intervention.27 Continued collaboration among partners can inform stakeholder needs and requirements for a scalable, statewide health literacy initiative. We recommend regular evaluation of the partnership and partner roles, intervention protocols, and data collection strategies for sustaining such efforts.24,25 Specific steps taken to form and evaluate this partnership and develop and implement clinic-based healthcare interventions may be relevant for other collaborative teams.
Footnotes
Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by The Duke Endowment [grant number 6816-SP].
ORCID iD: Daniela B. Friedman
https://orcid.org/0000-0002-9359-093X
References
- 1. U.S. Department of Health and Human Services. Healthy People 2020. HealthyPeople.gov. https://www.healthypeople.gov/. Published December 2010. Accessed October 29, 2019.
- 2. Ratzan SC, Parker RM. Introduction. In: Selden CR, Zorn M, Ratzan SC, Parker RM. (eds) National Library of Medicine Current Bibliographies in Medicine: Health Literacy. Bethesda, MD: National Institutes of Health, U.S. Department of Health and Human Services; NLM Pub. No: CBM 2000-1; 2000. [Google Scholar]
- 3. Parker RM, Williams MV, Weiss BD, et al. Ad Hoc committee on health literacy for the council on scientific affairs. Health literacy: report of the council on scientific affairs. JAMA. 1999;281:552-557. [PubMed] [Google Scholar]
- 4. U.S. Department of Health and Human Services. America’s health literacy: why we need accessible health information. http://www.aaaceus.com/courses/nl0610/article2.html. Published 2008. Accessed October 20, 2019.
- 5. MacLeod S, Musich S, Gulyas S, et al. The impact of inadequate health literacy on patient satisfaction, healthcare utilization, and expenditures among older adults. Geriatr Nurs. 2017;38:334-341. [DOI] [PubMed] [Google Scholar]
- 6. Quinlan P, Price KO, Magid SK, Lyman S, Mandl LA, Stone PW. The relationship among health literacy, health knowledge, and adherence to treatment in patients with rheumatoid arthritis. HSS J. 2013;9:42-49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Schillinger D, Piette J, Grumbach K, et al. Closing the loop: physician communication with diabetic patients who have low health literacy. Arch Intern Med. 2003;163:83-90. [DOI] [PubMed] [Google Scholar]
- 8. Baker DW, Gazmararian JA, Williams MV, et al. Functional health literacy and the risk of hospital admission among medicare managed care enrollees. Am J Public Health. 2002;92:1278-1283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Berkman ND, Sheridan SL, Donahue KE, et al. Health literacy interventions and outcomes: an updated systematic review. Evid Rep Technol Assess (Full Rep). 2011;199:941. [PMC free article] [PubMed] [Google Scholar]
- 10. Easton P, Entwistle VA, Williams B. How the stigma of low literacy can impair patient-professional spoken interactions and affect health: insights from a qualitative investigation. BMC Health Serv Res. 2013;13:319. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Choi SK, Seel JS, Yelton B, et al. Prostate cancer information available in health-care provider offices: an analysis of content, readability, and cultural sensitivity. Am J Mens Health. 2018;12:1160-1167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Kulkarni S, Lewis K, Adams SA, et al. A comprehensive analysis of how environmental risks of breast cancer are portrayed on the internet. Am J Health Educ. 2018;49:222-233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Aoki T, Inoue M. Association between health literacy and patient experience of primary care attributes: a cross-sectional study in Japan. PLoS One. 2017;12:e0184565. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Westlake C, Sethares K, Davidson P. How can health literacy influence outcomes in heart failure patients? Mechanisms and interventions. Curr Heart Fail Rep. 2013;10:232-243. [DOI] [PubMed] [Google Scholar]
- 15. Gandhi T, McGaffigan P, Lorincz C. Leveling the challenges of health literacy with ask me 3. National Patient Safety Foundation; https://cdn.ymaws.com/www.npsf.org/resource/resmgr/AskMe3/AskMe3_HealthLiteracyTrainin.pdf. Published 2016. Accessed October 19, 2019. [Google Scholar]
- 16. Institute for Healthcare Improvement. (n.d.). Ask me 3: good questions for your good health. http://www.ihi.org/resources/Pages/Tools/Ask-Me-3-Good-Questions-for-Your-Good-Health.aspx. Accessed November 4, 2019.
- 17. Six-Means A, Bauer TK, Teeter R, Segraves D, Cutshaw L, High L. Building a foundation of health literacy with Ask Me 3™. J Consum Health Internet. 2012;16:180-191. [Google Scholar]
- 18. Mika VS, Wood PR, Weiss BD, Trevio L. Ask Me 3: improving communication in a hispanic pediatric outpatient practice. Am J Health Behav. 2007;31:S115-S121. [DOI] [PubMed] [Google Scholar]
- 19. Lapiz-Bluhm MD, Weems R, Rendon R, Perez GL. Promoting health literacy through “Ask me 3.” JNPARR. 2015;5:31-37. [Google Scholar]
- 20. Wisconsin Collaborative for Healthcare Quality-Wisconsin Department of Health Services. Ask Me 3™ in Wisconsin’s community health centers evaluation report. https://www.dhs.wisconsin.gov/publications/p0/p00869.pdf. Published 2010. Accessed October 19, 2019.
- 21. Cegala DJ, Street RL, Jr, Clinch CR. The impact of patient participation on physicians’ information provision during a primary care medical interview. Health Commun. 2007;21:177-185. [DOI] [PubMed] [Google Scholar]
- 22. Giffords ED, Calderon O. Academic and community collaborations: an exploration of benefits, barriers and successes. Hum Serv Organ Manag Leadersh Gov. 2015;39:397-405. [Google Scholar]
- 23. Baijens SWE, Huppelschoten AG, Van Dillen J, Aarts JWM. Improving shared decision-making in a clinical obstetric ward by using the three questions intervention, a pilot study. BMC Pregnancy Childbirth. 2018;18:283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Friedman DB, Owens OL, Jackson DD, et al. An evaluation of a community-academic-clinical partnership to reduce prostate cancer disparities in the South. J Cancer Educ. 2014;29:80-85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Soltani SN, Kannaley K, Tang W, et al. Evaluating community–academic partnerships of the South Carolina healthy brain research network. Health Promot Pract. 2017;18:607-614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Soto Mas F, Cordova C, Murrietta A, Jacobson HE, Ronquillo F, Helitzer DA. Multisite community-based literacy intervention for Spanish speakers. J Community Health. 2015;40:431-438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Miech EJ, Rattray NA, Flanagan ME, Damschroder L, Schmid AA, Damush TM. Inside help: an integrative review of champions in healthcare-related implementation. SAGE Open Med. 2018;6:2050312118773261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Scaccia JP, Cook BS, Lamont A, et al. A practical implementation science heuristic for organizational readiness: R = MC2. J Community Psychol. 2015;43:484-501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Wandersman A, Duffy JL, Flaspohler PD, et al. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41:171-181. [DOI] [PubMed] [Google Scholar]
- 30. Yelton B, Lead JR, Adams SA, et al. How do African American community members’ perceptions about environmental risks of breast cancer compare with the current state of the science? [published online April 20, 2020]. J Cancer Educ. doi: 10.1007/s13187-020-01748-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Lewis KR, Kulkarni S, Adams SA, et al. “For lack of knowledge, our people will perish”: using focus group methodology to explore African American communities’ perceptions of breast cancer and the environment. Environ Int. 2018;121:111-118. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. McCracken JL, Friedman DB, Brandt HM, et al. Findings from the community health intervention program in South Carolina: implications for reducing cancer-related health disparities. J Cancer Educ. 2013;28:412-419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Friedman DB, Tanwar M, Yoho DW, Richter JVE. Disaster preparedness information needs of individuals attending an adult literacy center: an exploratory study. Community Lit J. 2010;4:55-73. [Google Scholar]
- 34. Scott VC, Kenworthy T, Godly-Reynolds E, et al. The readiness for integrated care questionnaire (RICQ): an instrument to assess readiness to integrate behavioral health and primary care. Am J Orthopsychiatry. 2017;87:520-530. [DOI] [PubMed] [Google Scholar]
- 35. Brodowski ML, Counts JM, Gillam RJ, et al. Translating evidence-based policy to practice: a multilevel partnership using the interactive systems framework. Fam Soc. 2013;94:141-149. [Google Scholar]
- 36. Lesesne CA, Lewis KM, White CP, Green DC, Duffy JL, Wandersman A. Promoting science-based approaches to teen pregnancy prevention: proactively engaging the three systems of the interactive systems framework. Am J Community Psychol. 2008;41:379-392. [DOI] [PubMed] [Google Scholar]
- 37. Adams SA, Rohweder CL, Leeman J, et al. Use of evidence-based interventions and implementation strategies to increase colorectal cancer screening in federally qualified health centers. J Community Health. 2018;43:1044-1052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Friedman DB, Kornegay V, Tanner A, et al. Partnering with the public library for healthcare education: an evaluation of affordable care act messages. Public Libr Q. 2016;35:1-22. [Google Scholar]
- 39. Best AL, Spencer SM, Hall IJ, Friedman DB, Billings DL. Developing spiritually-framed breast cancer screening messages in consultation with African American women. J Health Commun. 2015;30:290-300. [DOI] [PubMed] [Google Scholar]
- 40. Jackson DD, Owens OL, Friedman DB, Dubose-Morris R. Innovative and community-guided evaluation and dissemination of a prostate cancer education program for African-American men and women. J Cancer Educ. 2015;30:779-785. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Morris NS, MacLean CD, Chew LD, Littenberg B. The single item literacy screener: evaluation of a brief instrument to identify limited reading ability. BMC Fam Pract. 2006;7:21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Qualtrics Software 2005, Copyright 2019. Provo, UT, USA Version March 2018. [Google Scholar]
