Abstract
Objectives
To achieve consensus on a set of competencies in health literacy practice based on a literature review and expert consultation.
Setting
Hospitals and community health centres in Taiwan.
Method
A 2-stage modified Delphi study involving a literature review was conducted, followed by qualitative interviews and 3 rounds of email-based data collection over a 3-month period in 2011.
Participants
15 Chinese healthcare practitioners with more than 6 months’ experience in patient education were interviewed to collect data on health literacy practice. 24 experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the Delphi process.
Results
Qualitative data from the interviews were analysed and summarised to form 99 competency items for health literacy practice, which were categorised into 5 domains of health literacy practice including those pertaining to knowledge and skills. Consensus was reached on 92 of 99 competencies, using a modified Delphi technique.
Conclusions
The 92 competencies in health literacy practice embraced core components of patient education in the Chinese healthcare profession.
Keywords: health literacy, competencies, Delphi method, health profession
Strengths and limitations of this study.
To the best of our knowledge, this was the first study to develop a competency guide in health literacy practice for Chinese health professionals.
These competencies embraced core components of patient education in healthcare.
The main limitation of the study was that only 24 experts were recruited for the panel; however, we adopted subjective and objective methods to generate competencies in health literacy practice prior to achieving consensus in the Delphi process.
Competencies in health literacy practice may provide a starting point for increased integration of health literacy concepts and skills into professional and continuing education programmes.
Introduction
Health literacy, as defined by the WHO, represents cognitive and social skills that determine the individual's motivation and ability to access, understand, and use information in ways that promote and maintain good health.1 To determine the contribution that health literacy makes to health disciplines, the rediscovery of health education should be explored in alliances between health and educational sectors in pursuing the goal of improved literacy levels in the population.2 Accordingly, investment in sustainable health education requires competent healthcare professionals who contribute to the improvement of healthcare quality and reduce medical error.3
Health literacy practice involved the use of a set of patient-centred protocols and strategies to mitigate the effects of limited health literacy4 5 which should be considered in health education programmes. Healthcare providers' competencies in health literacy practice are vital in ensuring significant health outcomes through the efficiency of appropriate care plans.6 Healthcare professionals demonstrating assessment qualifications in their clinical practice could meet clients' care needs and could help design appropriate interventions to enhance self-care abilities at a level that clients understand.7 However, previous studies have shown that healthcare providers overestimate patients' health literacy because of misunderstanding or limited cognition concerning health literacy.
Health literacy as an outcome of health education and its practices, which has been explored in previous studies, could be categorised into three groups: health literacy assessment8 communication activities9 and educational strategies for patients with low health literacy (LHL).10 Although the importance of health literacy practice and use of a variety of health literacy techniques varied significantly across health disciplines, such as nutrition, nursing, and pharmacy,11 previous studies have demonstrated inadequate ability in health professionals with respect to limited recognition and awareness of health literacy,12 confidence9 and skills11 13 in caring for those with LHL. It is important that health professionals possess adequate awareness, knowledge, skills, and attitudes when treating patients with LHL.4 Accordingly, identifying key elements of competencies in health literacy practice is an essential step in promoting the quality of care provided for individuals with LHL.14 In this study, we reviewed the literature to identify the core domains of health literacy practice and use it as a guideline in interviews designed to collect information regarding health professionals' competencies. The Delphi technique was used to establish consensus on the proposed competencies.
Methods
A modified Delphi technique was used to achieve the aims of the study. The first round of the Delphi process was replaced by a literature review and face-to-face interviews designed to collect data regarding health literacy practice from clinical settings. This study was approved by the institutional review board at the institution with which the authors were affiliated.
Identifying the key domains of competencies in health literacy practice
We searched Medline, PsyclNFO, PubMed and OVID nursing collections for original studies and expert review papers concerning health literacy practice between 2005 and 2015. We entered ‘health literacy’ as the main keyword in the search to retrieve the relevant literature, and other related terms, such as training, teaching, practice, education and profession, were added with the Boolean operator ‘AND’ to refine our search. Only those literature on recommendations for health professionals related to health were included. However, articles which belonged to interviewing skills, cultural competency and motivational interviewing were generally not included.
Qualitative interviews with healthcare professionals to generate competency items for health literacy practice
The results of the literature review were used as interview guidelines to structure the interview framework. The recommended health literacy items identified through literature review were also confirmed in the interview process. The four interview questions included ‘describe the attributes of patients who were difficult to teach’, ‘describe ways in which clients with LHL can be assisted’, ‘describe the way that assessments are conducted’, and ‘describe the communication techniques used in your patient education practice’.
First, two experienced health educators were recruited via referrals from hospital managers. Snowball sampling, also known as accidental sampling, was used to identify other suitable interviewees, and additional participants were introduced by the interviewees. After agreeing to participate, they engaged in recorded one-to-one interviews conducted by trained investigators. At this stage, 15 healthcare practitioners with more than 6 months' experience in patient education, including five nurses working in clinical, internal and surgical wards; four case managers; two health educators; three nutritionists; and a pharmacist, were interviewed between 27 September and 12 November 2011. Thirteen interviews were conducted at participants' offices at the hospital, and two interviews with health educators were conducted at community health centres; the interviews lasted between 60 and 90 min. All interviews were conducted by authors with qualitative interview and health education experience. Moreover, the interview transcripts were analysed by the principle author, and the results were validated by all authors.
Delphi process
A Delphi process is defined as a multistage survey that ultimately attempts to achieve consensus on an important issue; its basic characteristics include anonymity, iteration, controlled feedback and statistical aggregation to create a group response.15 16 Moreover, the method is highly recommended for issues that have not been explored in-depth and it is based on the premise that pooled intelligence enhances individual judgement and captured the opinions through an anonymous enquiry process.17 The questionnaire for the second round of data collection contained the results of the first round, mainly in the form of median or arithmetic mean values and distribution parameters.18
The first round of data collection was replaced by a literature review and face-to-face interviews to elicit the opinions of the expert panel. The second to fourth rounds involved questionnaires distributed via mail and followed the classic Delphi approach.
Expert recruitment
With respect to the sample size for the Delphi process, Parente and Anderson-Parente19 recommended a lower limit of 10 participants after the deduction of potential dropouts. In Taiwan, health literacy research has attracted academic and practical experts since 2008, and the majority of the health literacy literature has focused on patient factors. Since the number of experts with experience in health literacy research or practice was limited, we searched for Delphi technique experts from a list of professionals who had received a government-funded health literacy grant. In addition, we examined a list of professionals who had published research articles in the area. Approximately eight Delphi technique experts and recommended health professionals (who were trained in health literacy practice), were invited to participate in the study. Twenty-four experts (12 academic scholars in health literacy and 12 professionals with training related to health literacy practice) were invited to participate in the second to fourth rounds of data collection.
Delphi procedure
The modified Delphi method used in this study consisted of three rounds of email-based data collection, each of which lasted for 1 month during a 3-month period from January to April 2012. In each round, the experts were invited to rate the importance of each question using a five-point Likert-type scale ranging from 1 (not important) to 5 (very important) as the grading system. These individuals were aware that questions scored higher than 3 would be considered as important items. Group consensus was achieved if the criteria, including a mean and mode of at least 4.0 and a SD of ≤1 were met. The quartile deviation was also provided to experts for consensus consideration in the Delphi process. Moreover, we also checked items that were ranked as 4 or greater on a Likert scale of 1–5 by more than 80% of respondents in the final round.
The questionnaire contained space for an answer and feedback or further comments for each statement. In statements for which consensus was not achieved, feedback and comments were used to adjust the statement for the following round. The statements for all three rounds of the Delphi process were retained to ensure that they were all equally as likely to gain the highest importance rating and level of consensus.20 Experts were provided with feedback and a summary of the results of the previous round, and their individual modified and amended items were colour coded to prevent confusion during reading in the second and third rounds.
Results
Literature review
Literature searches using the keywords ‘training’, ‘teaching’, ‘competence’ and ‘profession’ in combination with ‘health literacy’ produced 35, 35, 5 and 55 articles, respectively. A total of 106 articles were searched. After excluding duplicates (n=14), anonymous authors (n=6), non-English articles (n=6), and subjects that were not relevant to the health profession (n=18), 62 articles were relevant to the topic. Of these, 43 were discussion articles, and 19 were empirical studies, of which two were excluded, as the full text was not available. In the 17 complete articles, communication strategies (n=9, 52.94%) and understanding health literacy knowledge (n=8, 47.05%) were the most frequently mentioned health literacy practices. Assessment methods for LHL and appropriately written education materials or resources for patients were also crucial to health literacy practice. None of these studies or discussion articles were Chinese (table 1).
Table 1.
Themes in the literature | n (%) | Source |
---|---|---|
Assessment methods for low health literacy | 5 (29.4) | 14, 21–24 |
Appropriate written patient education materials or resources | 5 (29.4) | 14, 21, 22, 25, 26 |
Communication strategies | 9 (52.94) | 3, 14, 21, 23–25, 27–29 |
Understanding or knowledge of health literacy | 8 (47.05) | 3, 12, 14, 22, 23, 27, 28, 30 |
Association between literacy or health literacy and patient outcomes | 1 (5.8) | 27 |
Evaluating health literacy education | 2 (11.7) | 31, 32 |
Teaching information and methods | 2 (11.7) | 33, 34 |
Implementing a health literacy programme for patients | 2 (11.7) | 12, 33 |
Qualitative interview for health professionals
The deductive content analysis described by Elo and Kyngäs35 was used to confirm four domains of health literacy practice, based on a review of related literature. In total, 648 meaningful statements were extracted from the interviews. Interview results were summarised as health literacy practices and used to compare categorisation results from the literature review for further classification. Thereafter, 99 meaning units were identified and classified into two domains with six subdomains including those pertaining to knowledge (ie, knowledge of health literacy and recognition of the characteristics of patients with LHL) and skills (ie, designing a patient education plan for patients with LHL, assessing health literacy assessment, adopting low-literacy health education strategies and evaluating an educational plan for patients with LHL attributes). In the analysis, 56 questions were derived from interviews, and 43 questions were selected from health literacy research publications.
The consensus results of the Delphi process
Twenty-four experts have completed each round of Delphi survey. In the second round, 10 of 99 items did not reach consensus, eight items had mean or mode scores between 3.5 and 4.0 with a SD of >1, and two items had mean or mode scores between 3.0 and 3.5. In the third round, none of the 99 items had a mean or mode score of <3.0, while 92 reached consensus with 80% agreement, four had mean scores between 3.5 and 3.9 and three had scores of 4.0 with a SD of >1. Ultimately, in the final questionnaire, which was used in the fourth round and created according to experts' opinions, healthcare professionals' competencies in health literacy practice consisted of 92 consensus items, with seven items deleted (table 2).
Table 2.
Final round |
|||||||
---|---|---|---|---|---|---|---|
Competency item | Source | Roundaccepted | Percentage of ≥4 | Mean | Mode | SD | QD |
Knowledge domain | |||||||
Knowledge of health literacy | |||||||
K1. Health literacy refers only to a person's ability to read. (False) | Devraj et al36 | 2 | 83.3 | 4.0 | 4 | 1.0 | 0.5 |
K2. Adequate health literacy is the ability to read, understand, and process health information. (False) | Devraj et al36 | 2 | 91.7 | 4.3 | 4 | 0.7 | 0.5 |
K3. Those with low health literacy have poorer health outcomes relative to those with sufficient health literacy. (True) | Institute of Medicine4 | 2 | 87.5 | 4.6 | 5 | 0.7 | 0.5 |
K4. Age is a risk factor that decreases health literacy. (True) | Devraj et al36 | 3 | 83.3 | 4.0 | 4 | 0.7 | 0.5 |
K5. Patients with high educational levels may present with low health literacy. (True) | Interview | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
K6. Limited health literacy can produce barriers to clear, effective communication. (True) | Schwartzberg et al11 | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
K7. Using an appropriate tool is the best way to assess health literacy and identify patients with low health literacy. (True) | Institute of Medicine4 | 2 | 83.3 | 4.2 | 5 | 1.0 | 0.8 |
K8. Individuals with high educational levels also need an easy method of learning complicated health information. (True) | Interview | 2 | 83.3 | 4.3 | 5 | 1.0 | 0.8 |
K9. The general rule is to write consent documents at a 7th-grade reading level. (True) | Institute of Medicine4 | 2 | 83.3 | 4.0 | 4 | 1.0 | 1.0 |
K10. Suitable educational materials designed for people with low literacy should be understandable at levels below the 6th grade in elementary school. (True) | Institute of Medicine4 | Delete | 54.2 | 3.8 | 3 | 1.1 | 1.0 |
K11. People with low health literacy need extra medical support and therefore have higher healthcare costs. (True) | Weiss and Palmer37 | 2 | 87.5 | 4.4 | 5 | 0.9 | 0.8 |
K12. Health education materials should be written at or below a 7th-grade reading level. (True) | Institute of Medicine4 | 2 | 83.3 | 4.0 | 4 | 1.0 | 1.0 |
K13. Health literacy could affect physician-patient communication. (True) | Schwartzberg et al11 | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
K14. Persons with low health literacy experience limited comprehension of health information, leading to care problems. (True) | Institute of Medicine4 | Delete | 54.2 | 3.4 | 4 | 1.3 | 1.0 |
Recognition of attributes of patients with low health literacy (If you agree the attributes of LHL listed in following items, please marked ✓ in the box.) Patients with low health literacy… |
|||||||
A1. May pretend to understand what the health educator says and ask for help at home. □ | Interview | Delete | 45.8 | 3.8 | 3 | 0.8 | 0.8 |
A2. Will say, ‘I can do this, there is no need to teach me’ to cover up for their lack of understanding. □ | Interview | 2 | 91.7 | 4.6 | 5 | 0.7 | 0.5 |
A3. Will repeat the same questions. □ | Interview | 2 | 83.3 | 4.4 | 5 | 1.0 | 0.5 |
A4. Will not tell you if they cannot read. □ | Devraj et al36 | 3 | 83.3 | 4.0 | 4 | 1.0 | 1.0 |
A5. Are more likely to misinterpret medication instructions provided on prescription labels. □ | Devraj et al36 | 2 | 87.5 | 4.1 | 4 | 0.8 | 0.8 |
A6. Will easily misunderstand prescription instructions. □ | Devraj et al36 | 2 | 83.3 | 4.4 | 5 | 1.0 | 0.5 |
A7. Cannot understand medication indications. □ | Kripalani et al23 | 2 | 83.3 | 4.6 | 5 | 1.0 | 0.3 |
A8. Will often bring family members along when talking to healthcare professionals. □ | Devraj et al36 | 2 | 83.3 | 4.4 | 5 | 1.0 | 0.5 |
A9. Will make excuses to avoid reading health information materials when given material to read. □ | Kripalani et al23 | 2 | 87.5 | 4.4 | 5 | 0.7 | 0.5 |
A10.* Often report about their medicine. □ | Devraj et al36 | 2 | 87.5 | 4.4 | 5 | 0.7 | 0.5 |
A11. Only seek assistance when symptoms worsen. □ | Jukkala et al38 | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
A12. Cannot understand medical forms and are therefore unable to complete them accurately. □ | Institute of Medicine4 | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
A13. Are likely to put a lot of folded paper in their pockets or wallets. □ | Kripalani et al23 | 3 | 83.3 | 4.0 | 4 | 0.8 | 0.8 |
A14. Do not make necessary appointments or attend follow-up. □ | Institute of Medicine4 | 2 | 87.5 | 4.3 | 4 | 0.7 | 0.5 |
A15. May be likely to pose few questions to professionals. □ | Interview | 2 | 83.3 | 4.4 | 5 | 0.9 | 0.8 |
A16. Cannot talk about how to take medicine. □ | Kripalani et al23 | 2 | 87.5 | 4.1 | 4 | 0.8 | 0.8 |
Skill domain | |||||||
Designing a health education plan for patients with low health literacy | |||||||
D1. Handle the psychical barriers to conducting health behaviours for clients | Interview | 2 | 87.5 | 4.6 | 5 | 0.7 | 0.5 |
D2. Cooperate with other professionals to design health education plans | Interview | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
D3. Design audiovisual teaching materials | Interview | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
D4. Have the language ability to handle different patients | Interview | 2 | 87.5 | 4.6 | 5 | 0.7 | 0.5 |
D5. Provide group health education | Interview | Delete | 79.2 | 4.0 | 5 | 1.1 | 0.5 |
D6. Implement behaviour modification counselling | Interview | 2 | 83.3 | 4.4 | 5 | 1.0 | 0.5 |
D7. Design computer-based teaching aids | Interview | 2 | 83.3 | 4.6 | 5 | 1.0 | 0.3 |
D8. Design health education flyers with <20% text | Interview | 2 | 83.3 | 4.4 | 5 | 1.0 | 0.5 |
D9. Apply appropriate education theories in the curriculum | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
D10. Establish a personal profile of teaching materials | Interview | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
D11. Design a teaching plan for multicultural populations | Interview | 2 | 87.5 | 4.6 | 5 | 0.7 | 0.5 |
D12. Design education materials for illiterate individuals | Interview | 2 | 83.3 | 4.4 | 5 | 1.0 | 0.5 |
Assessing health literacy for patients with low health literacy Interview | |||||||
As1. Determine the right teaching time for various clients | Interview | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
As2. Determine potential education barriers based on patient characteristics | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
As3. Apply appropriate tools to assess patient health literacy levels | Institute of Medicine4 | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
As4. Conduct health assessments by collecting personal, organisational, and community data | Institute of Medicine4 | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
As5. Identify the classical attributes of low health literacy prior to teaching | Kripalani et al23 | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
Adopting low-literacy health education strategies | |||||||
S1. Use plain language instead of medical jargon | Kripalani et al23 | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S2. Use storytelling to make clients understand | Kripalani et al23 | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
S3. Use metaphors to explain the disease to clients | Kripalani et al23 | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
S4. Use life-oriented examples to explain the care that patients need | Interview | 2 | 83.3 | 4.4 | 5 | 1.0 | 0.5 |
S5. Teach using language the student understands | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S6. Explain health education using materials available to the patient | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S7. Connect new learning with previous experience | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S8. Limiting curricula to 2 or 3 new topics | Schwartzberg et al11 | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S9. Use the teach-back technique | Kripalani et al23 | 2 | 83.3 | 4.6 | 5 | 1.0 | 0.3 |
S10. Teach repeatedly when clients cannot understand the teaching content | Williams et al39 | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S11. Teach difficult materials repeatedly | Interview | Delete | 50 | 3.4 | 4 | 1.1 | 0.5 |
S12. Use the demonstrate-do technique | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S13. Provide health education materials and encourage clients to discuss them with their families | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S14. Provide health education materials with ‘questions and answers’ | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S15. Use simple words to explain care plans and related treatment | Schwartzberg et al11 | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S16. Base decisions regarding teaching focus on treatment progress | Interview | 2 | 83.3 | 4.6 | 5 | 1.0 | 0.3 |
S17. Summarise the key points of teaching at the end of the interview | Kripalani et al23 | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S18. Instruct others in the creation of a care plan rather than explaining the disease or condition | Interview | 2 | 95.8 | 4.8 | 5 | 0.4 | 0.3 |
S19. Use pictorial methods, rather than words, to emphasise importance of issues for clients | Kripalani et al23 | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S20. Provide self-designed sticks to allow clients to mark their records | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S21. Use the one-by-one method and pictorial image material | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S22. Use media to benefit teaching outcomes | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S23. Design teaching materials as teaching aids in health education | Interview | 2 | 83.3 | 4.4 | 5 | 1.0 | 0.5 |
S24. Use online or internet teaching | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S25. Consider disobedient behaviour to be temperate coping behaviour | Interview | 2 | 83.3 | 4.2 | 5 | 1.0 | 0.8 |
S26. Offer more encouragement to patients and illiterate clients | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
S27. Understand clients’ disobedient behaviours | Interview | 2 | 87.5 | 4.6 | 5 | 0.7 | 0.5 |
S28. Invite caregivers to participate in the teaching plan | Interview | 2 | 83.3 | 4.6 | 5 | 0.9 | 0.5 |
S29. Encourage clients and their families and clarify unclear parts of teaching via telephone | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S30. Present oneself to clients as a resource | Interview | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
S31. Create an environment of mutual trust | Institute of Medicine4 | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S32. Encourage sharing between clients | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S33. Create an embarrassment-free environment | Institute of Medicine4 | 2 | 83.3 | 4.6 | 5 | 0.9 | 0.5 |
S34. Ensure clients’ confidentiality | Interview | Delete | 79.2 | 4.0 | 5 | 1.1 | 0.0 |
S35. Encourage clients to take notes during interviews | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S36. Teach clients to ask, ‘What is my main problem?’ | Institute of Medicine4 | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S37. Teach clients to ask, ‘What do I need to do?’ | Institute of Medicine4 | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S38. Teach clients to ask, ‘What can I do to help my body?’ | Institute of Medicine4 | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
S39. Encourage clients to use the question-posing method | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S40. Encourage clients to talk about what doctors say to them | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S41. Encourage clients to demonstrate learnt skills to determine their understanding | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S42. Ask clients to provide evidence of their health behaviour | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S43. Make eye contact with patients to ensure concentration | Interview | 2 | 83.5 | 4.6 | 5 | 0.9 | 0.5 |
S44. Ask clients to restate the key points that they have learnt | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S45. Pay attention to questions that patients ask repeatedly | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
S46. Pay attention to non-verbal (eg, facial) expressions to determine whether the patient has understood | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
Evaluating an educational plan for patients with low health literacy | |||||||
E1. Build up the right evaluation criteria for health literacy practice | Interview | 2 | 83.3 | 4.7 | 5 | 1.0 | 0.0 |
E2. Conduct appropriate evaluations to demonstrate the effectiveness of health literacy practice | Interview | 2 | 83.3 | 4.1 | 5 | 1.0 | 1.0 |
E3. Modify education plans to fit patients’ problems | Interview | 2 | 87.5 | 4.7 | 5 | 0.7 | 0.3 |
E4. Illustrate the appropriate effectiveness of teaching based on health literacy | Interview | 2 | 87.5 | 4.6 | 5 | 0.7 | 0.5 |
E5. Encourage clients with low health literacy to share the successful action outcome | Interview | Delete | 79.2 | 4.0 | 5 | 0.9 | 0.5 |
E6. Design various evaluation approaches according to clients’ health literacy levels | Interview | 2 | 87.5 | 4.8 | 5 | 0.7 | 0.0 |
*Reverse item.
A: recognition of attributes of patients with low health literacy; As: assessing health literacy for low health literate patients; D: designing a health education plan for patients with low health literacy; E: evaluating an educational plan for patients with low health literacy; K: knowledge of health literacy; S: adopting low-literacy health education strategies.
QD, Quartile Deviation.
Discussion
In Taiwan and the rest of the world, most health literacy studies have focused on the patient's perspective. Only a few have explored health professionals' competencies in promoting patients' health literacy. Understanding health professionals' ability in health literacy practice is a basic step in establishing practice-based competencies. Delphi studies lack a consistent and well-defined standard for the application of group consensus.40 In addition to the predetermined levels of agreement mentioned in previous study,14 we used other consensus standards suggested by de Villers17 including the values of mean, SD and IQR to understand the level of consensus or lack thereof.
Although assessment of health literacy knowledge is an essential component of health literacy practices for health professionals, the result of our study has found that the measurement of health literacy knowledge could be either subjective or objective. The subjective measurement involved the participant's perceived knowledge of health literacy29 or the health literacy knowledge demonstrated by the participants.41 The objectives of assessment of health literacy knowledge performed in the current study was similar to that performed in the study conducted by Devraj et al,36 in which health literacy knowledge was designed in the form of test items that participants were required to answer to determine their health literacy levels. This could help in the evaluation of health literacy levels in untrained health professionals.
The items used in the current study were similar to those used in other studies, in that the assessment included the definition of health literacy,11 reading levels in patients with LHL,10 essential support for patients with LHL23 and the consequences of LHL.38 Kripalani et al,23 Devraj et al36 and Coleman et al14 classified the signs of LHL as knowledge items. For clearly differential conceptual knowledge or practical recognition of LHL, we grouped the signs of LHL confirmed during the interviews in the dimension of recognition of the attributes of patients with LHL. When health professionals adopted appropriate methods embedded health literacy competences to provide care for them, this attributes may not be the problems in healthcare settings.23 Undoubtedly, it is important for health professionals that they need to be aware of and recognise these signs when they conduct the assessment for patients.
The reason for this discrepancy could be that the study participants were physicians in 3 of the 17 studies and believed that health literacy was a communication skill. Coleman et al14 used the same five crucial domains to examine competencies in health literacy practice but divided the competencies into educational and practice domains. However, we incorporated a literature review and interviews into an educational process that aimed to meet the WHO's goals of promoting health literacy to the general public via educational systems.4 Extending the application of written or oral communication skills, as it relates to health literacy competencies in health education programmes, is critical to the improvement of public health literacy.
The competency items used in the current study were similar to those used in previous studies. However, because of differences in the first round of Delphi process and the Chinese descriptions in the practical narratives confirmed during the interviews, the meanings of the items somewhat differed from those provided by Coleman et al.14 The language differences could be considered as a study limitation. In the current study, we integrated the literature and interviews to produce the competencies of health literacy practice, which might be suitable for use with Chinese-speaking professionals.
It is worth noting that five of the seven questions for which a consensus could not be reached were interview items. These items were related to health education and captured via interview but have not been mentioned specifically in the health literacy literature; therefore, the experts could not reach consensus. The remaining two questions for which a consensus could not be reached were literature items. It is possible that, although the concepts originated from the literature, the experts considered the consent and health education materials analysed during the interviews duplicate information. K14 was a detailed description of LHL caused by communication barriers, which resulted from adverse effects on the patient's health, but it was also a repetition of K6.
Potential biases in traditional Delphi studies include the imposition of preconceptions on respondents and the use of poor techniques to summarise and present group responses.42 To avoid the drawbacks involving the imposition of preconceptions on respondents, a thorough review of the literature concerning the modified Delphi method was performed to collect information regarding competencies in health literacy practice, and qualitative interviews were conducted to confirm those generated by healthcare professionals in their own settings. This approach could increase the diversity of the item pool. Irrelevant or duplicate questions could be removed after the experts have reached a consensus.
Conclusions
The health literacy competencies identified in this study constitute an important and necessary step in the systematic design and evaluation of curricula required to produce a healthcare workforce that both accounts for and addresses the issues surrounding LHL. Most studies have suggested that health literacy and health education or communication skills are closely related. The present study applied these education principles in a holistic and continuous process to construct an index for assessing practice competencies.
A modified Delphi technique was used to achieve consensus on health literacy competencies for Chinese-speaking healthcare professionals. Further empirical studies are required to validate whether the 92 items identified can be grouped into the six domains of competencies in health literacy practice. Moreover, further work is required to prioritise these 92 items, and educational research is required to validate the competencies in health literacy practice and determine which should be taught, which healthcare professionals should receive training, which settings should be used and which teaching methods should be adopted to improve patient-centred outcomes.
Acknowledgments
The authors would like to thank the experts and interviewees involved in the study. They also appreciate the helpful comments received from the anonymous reviewers at BMJ Open.
Footnotes
Contributors: Y-CC, FLW and L-CC conducted the qualitative interviews. L-LL and L-CC analysed the interview and Delphi data. L-CC wrote the manuscript. All authors critically revised and approved the final manuscript.
Funding: This project was funded by the Ministry of Science and Technology, Taiwan (NSC 100-2511-S-255-001-MY2), and financial assistance was received from Chang Gung Memorial Hospital (BMRP 978).
Competing interests: None declared.
Patient consent: Obtained.
Ethics approval: Chang Gung Memorial Hospital.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data sharing statement: Additional data can be accessed via the Dryad data repository at http://datadryad.org/ with the doi:10.5061/dryad.86t23.
References
- 1.Nutbeam D. Health promotion glossary. Health Promot 1986;1:113–27. 10.1093/heapro/1.1.113 [DOI] [PubMed] [Google Scholar]
- 2.Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int 2000;15:259–67. 10.1093/heapro/15.3.259 [DOI] [Google Scholar]
- 3.Coleman CA, Fromer A. A health literacy training intervention for physicians and other health professionals. Fam Med 2015;47:388–92. [PubMed] [Google Scholar]
- 4.Institute of Medicine Committee on Health Literacy. In: Nielsen-Bohlman L, Panzer AM, Kindig DA, eds. Health literacy: a prescription to end confusion. What is health literacy Washington DC: National Academies Press (US) Copyright 2004 by the National Academy of Sciences. All rights reserved, 2004:31–57. [PubMed] [Google Scholar]
- 5.Estacio EV, McKinley RK, Saidy-Khan S et al. Health literacy: why it matters to South Asian men with diabetes. Prim Health Care Res Dev 2014:1–5. [DOI] [PubMed] [Google Scholar]
- 6.Atcherson SR, Zraick RI, Hadden K. A need for health literacy curriculum: knowledge of health literacy among U.S. audiologists and speech-language pathologists in Arkansas. Educ Health (Abingdon) 2013;26:85–8. 10.4103/1357-6283.120699 [DOI] [PubMed] [Google Scholar]
- 7.Smith DL, Gutman SA. Health literacy in occupational therapy practice and research. Am J Occup Ther 2011;65:367–9. 10.5014/ajot.2011.002139 [DOI] [PubMed] [Google Scholar]
- 8.Dickens C, Lambert BL, Cromwell T et al. Nurse overestimation of patients’ health literacy. J Health Commun 2013;18(Supp1 1):62–9. 10.1080/10810730.2013.825670 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Ali NK, Ferguson RP, Mitha S et al. Do medical trainees feel confident communicating with low health literacy patients? J Community Hosp Intern Med Perspect 2014;4:22893 10.3402/jchimp.v4.22893 10.3402/jchimp.v4.22893 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Cafiero M. Nurse practitioners’ knowledge, experience, and intention to use health literacy strategies in clinical practice. J Health Commun 2013;18(Supp1 1):70–81. 10.1080/10810730.2013.825665 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Schwartzberg JG, Cowett A, VanGeest J et al. Communication techniques for patients with low health literacy: a survey of physicians, nurses, and pharmacists. Am J Health Behav 2007;31(Suppl 1):S96–104. 10.5555/ajhb.2007.31.supp.S96 [DOI] [PubMed] [Google Scholar]
- 12.Macabasco-O'Connell A, Fry-Bowers EK. Knowledge and perceptions of health literacy among nursing professionals. J Health Commun 2011;16(Suppl 3):295–307. 10.1080/10810730.2011.604389 [DOI] [PubMed] [Google Scholar]
- 13.Seligman HK, Wang FF, Palacios JL et al. Physician notification of their diabetes patients’ limited health literacy. A randomized, controlled trial. J Gen Intern Med 2005;20:1001–7. 10.1111/j.1525-1497.2005.00189.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Coleman CA, Hudson S, Maine LL. Health literacy practices and educational competencies for health professionals: a consensus study. J Health Commun 2013;18(Suppl 1):82–102. 10.1080/10810730.2013.829538 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Linstone H, Turoff M. The Delphi method: techniques and applications. Reading, PA: Addison-Wesley, 1975. [Google Scholar]
- 16.Keeney S, Hasson F, McKenna H (eds). Conducting the research using the Delphi technique. In: The Delphi technique in nursing and health research. Wiley-Blackwell, 2011:69–83. [Google Scholar]
- 17.de Villiers MR, de Villiers PJ, Kent AP. The Delphi technique in health sciences education research. Med Teach 2005;27:639–43. 10.1080/13611260500069947 [DOI] [PubMed] [Google Scholar]
- 18.Bogner A. Interviewing experts. England: Palgrave Macmillan, 2009. [Google Scholar]
- 19.Parente FJ, Anderson-Parente JK. Delphi inquiry systems. In: Wright G, Ayton P, eds. Judgemental forecasting. Chichester: John Wiley, 1987:77–86. [Google Scholar]
- 20.Keeney S, Hasson F, McKenna H (eds). Analysing data from a Delphi and reporting results . In: The Delphi technique in nursing and health research. Wiley-Blackwell, 2011:84–95. [Google Scholar]
- 21.Toronto CE, Weatherford B. Health literacy education in health professions schools: an integrative review. J Nurs Educ 2015;54:669–76. 10.3928/01484834-20151110-02 [DOI] [PubMed] [Google Scholar]
- 22.Lambert M, Luke J, Downey B et al. Health literacy: health professionals? Understandings and their perceptions of barriers that Indigenous patients encounter. BMC Health Serv Res 2014;29:614 10.1186/s12913-014-0614-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kripalani S, Jacobson KL, Brown S et al. Development and implementation of a health literacy training program for medical residents. Med Educ Online 2006;11:1–8. [DOI] [PubMed] [Google Scholar]
- 24.Maniaci MJ, Heckman MG, Dawson NL. Functional health literacy and understanding of medications at discharge. Mayo Clin Proc 2008;83:554–8. 10.4065/83.5.554 [DOI] [PubMed] [Google Scholar]
- 25.Callahan LF, Hawk V, Rudd R et al. Adaptation of the health literacy universal precautions toolkit for rheumatology and cardiology—applications for pharmacy professionals to improve self-management and outcomes in patients with chronic disease. Res Social Adm Pharm 2013;9:597–608. 10.1016/j.sapharm.2013.04.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Broussard B, Radkins JB, Compton MT. Developing visually based, low-literacy health education tools for African Americans with psychotic disorders and their families. Community Ment Health J 2014;50:629–36. 10.1007/s10597-013-9666-7 [DOI] [PubMed] [Google Scholar]
- 27.Coleman CA, Appy S. Health literacy teaching in US medical schools, 2010. Fam Med 2012;44:504–7. [PubMed] [Google Scholar]
- 28.Green JA, Gonzaga AM, Cohen ED et al. Addressing health literacy through clear health communication: a training program for internal medicine residents. Patient Educ Couns 2014;95:76–82. 10.1016/j.pec.2014.01.004 [DOI] [PubMed] [Google Scholar]
- 29.Mackert M, Ball J, Lopez N. Health literacy awareness training for healthcare workers: improving knowledge and intentions to use clear communication techniques. Patient Educ Couns 2011;85:e225–8. 10.1016/j.pec.2011.02.022 [DOI] [PubMed] [Google Scholar]
- 30.Mackert M. Health literacy knowledge among direct-to-consumer pharmaceutical advertising professionals. Health Commun 2011;26:525–33. 10.1080/10410236.2011.556084 [DOI] [PubMed] [Google Scholar]
- 31.Primack BA, Wickett DJ, Kraemer KL et al. Teaching health literacy using popular television programming: a qualitative pilot study. Am J Health Educ 2010;41:147–54. 10.1080/19325037.2010.10598856 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Price-Haywood EG, Harden-Barrios J, Cooper LA. Comparative effectiveness of audit-feedback versus additional physician communication training to improve cancer screening for patients with limited health literacy. J Gen Intern Med 2014;29:1113–21. 10.1007/s11606-014-2782-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Levasseur M, Carrier A. Do rehabilitation professionals need to consider their clients’ health literacy for effective practice? Clin Rehabil 2010;24:756–65. 10.1177/0269215509360752 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Zanchetta MS, Maheu C, Fontaine C et al. Awakening professionals’ critical awareness of health literacy issues within a francophone linguistic-minority population in Ontario. Chronic Dis Inj Can 2014;34:236. [PubMed] [Google Scholar]
- 35.Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs 2008;62:107–15. 10.1111/j.1365-2648.2007.04569.x [DOI] [PubMed] [Google Scholar]
- 36.Devraj R, Butler LM, Gupchup GV et al. Active-learning strategies to develop health literacy knowledge and skills. Am J Pharm Educ 2010;74:137–45. 10.5688/aj7408137 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Weiss BD, Palmer R. Relationship between health care costs and very low literacy skills in a medically needy and indigent Medicaid population. J Am Board Fam Pract 2004;17:44–7. 10.3122/jabfm.17.1.44 [DOI] [PubMed] [Google Scholar]
- 38.Jukkala A, Deupree JP, Graham S. Knowledge of limited health literacy at an academic health center. J Contin Educ Nurs 2009;40:298–302; quiz 03–4, 36 10.3928/00220124-20090623-01 [DOI] [PubMed] [Google Scholar]
- 39.Williams MV, Davis T, Parker RM et al. The role of health literacy in patient-physician communication. Fam Med 2002;34:383–9. [PubMed] [Google Scholar]
- 40.Williams PL, Webb C. The Delphi technique: a methodological discussion. J Adv Nurs 1994;19:180–6. 10.1111/j.1365-2648.1994.tb01066.x [DOI] [PubMed] [Google Scholar]
- 41.Ha H, Lopez T. Developing health literacy knowledge and skills through case-based learning. Am J Pharm Educ 2014;78:17 10.5688/ajpe78117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Keeney S, Hasson F, McKenna H (eds). Ethical considerations. In: The Delphi technique in nursing and health research. Wiley-Blackwell, 2011:105–13. [Google Scholar]