Abstract
Introduction
To address the global diabetes epidemic, lifestyle counseling on diet, physical activity, and weight loss is essential. This study assessed the implementation of a diabetes self-management education and support (DSMES) intervention using a mixed-methods evaluation framework.
Methods
We implemented a culturally adapted, home-based DSMES intervention in rural Indigenous Maya towns in Guatemala from 2018 through 2020. We used a pretest–posttest design and a mixed-methods evaluation approach guided by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. Quantitative data included baseline characteristics, implementation metrics, effectiveness outcomes, and costs. Qualitative data consisted of semistructured interviews with 3 groups of stakeholders.
Results
Of 738 participants screened, 627 participants were enrolled, and 478 participants completed the study. Adjusted mean change in glycated hemoglobin A1c was −0.4% (95% CI, −0.6% to −0.3%; P < .001), change in systolic blood pressure was −5.0 mm Hg (95% CI, −6.4 to −3.7 mm Hg; P < .001), change in diastolic blood pressure was −2.6 mm Hg (95% CI, −3.4 to −1.9 mm Hg; P < .001), and change in body mass index was 0.5 (95% CI, 0.3 to 0.6; P < .001). We observed improvements in diabetes knowledge, distress, and most self-care activities. Key implementation factors included 1) recruitment barriers for men, 2) importance of patient-centered care, 3) role of research staff in catalyzing health worker involvement, 4) tradeoffs between home and telephone visits, and 5) sustainability challenges.
Conclusion
A community health worker–led DSMES intervention was successfully implemented in the public health system in rural Guatemala and resulted in significant improvements in most clinical and psychometric outcomes. Scaling up sustainable DSMES in health systems in rural settings requires careful consideration of local barriers and facilitators.
Summary.
What is already known on this topic?
The burden of diabetes is large and growing in low- and middle-income countries. A significant gap exists in how to optimally incorporate lifestyle counseling interventions into health systems in these countries.
What is added by this report?
We assessed implementation of a large diabetes self-management education and support (DSMES) program in rural Guatemala. This report highlights information on implementation barriers and facilitators that will be useful to implementers and policy makers who work to scale up DSMES in resource-limited health systems.
What are the implications for public health practice?
Rigorous DSMES interventions can be successfully implemented in rural public health systems in low- and middle-income countries, although challenges include enrollment of men, additional work for overburdened health workers, and sustainability.
Introduction
The number of adults with diabetes is estimated to grow worldwide from 463 million in 2019 to 700 million in 2045 (1). More than 80% of the diabetes burden is in low- and middle-income countries (2). This epidemic requires a multifaceted response, including the delivery of medications and effective lifestyle counseling (3). In low- and middle-income countries, only 36% of people with diabetes receive medication to lower glucose and 19% receive lifestyle counseling (4).
This study investigates the implementation of a diabetes self-management education and support (DSMES) intervention in the public health system in rural Guatemala. Guatemala is the most populous country in the Central America region and has an estimated diabetes prevalence of 9% to 10% (5,6). Diabetes has strained the public health system, which serves more than 70% of the population (7), and has particularly affected rural Indigenous communities (8).
We previously conducted a pilot feasibility study of a culturally tailored, home-based DSMES intervention for Indigenous Maya people (9). DSMES interventions are recommended in Guatemalan primary care guidelines (10) and are effective in ethnic minority groups in high-income countries (11). The pilot intervention used tailored communication theory (12). We subsequently received funding to scale up the DSMES pilot into routine primary public health care centers. The objective of this study was to assess the effectiveness of the DSMES intervention and evaluate this implementation through mixed methods and the RE-AIM framework (13).
Methods
We prepared this article according to TREND (Transparent Reporting of Evaluations with Nonrandomized Designs) (14) and STARI (Standards for Reporting Implementation Studies) guidelines (15). Checklists are available elsewhere (Appendixes 1 and 2 [16]). This study was approved by the institutional review boards of Maya Health Alliance and the Institute of Nutrition of Central America and Panama.
Study design and setting
Our DSMES intervention used a pretest–posttest design and was implemented in rural Guatemala from November 2018 through December 2020. The study was conducted by Maya Health Alliance, the Inclusive Health Institute, and the Institute of Nutrition of Central America and Panama. This was a pragmatic study that focused on evaluating DSMES in real-world routine conditions; as a result, we did not perform a sample size calculation.
The study was conducted in 8 rural municipalities in a single province (Chimaltenango) in the Central Highlands region. We chose this province because it is where Maya Health Alliance’s main office is located. The population is predominantly Indigenous Maya (17), and most live below the national poverty line (18). Each municipality has a public health district operated by the Ministry of Health, as well as private and nongovernmental biomedical clinics and nonbiomedical traditional healers. In the public health sector, diabetes care is delivered at a physician-staffed health center. Free services at health centers include blood glucose monitoring and oral glucose-lowering drugs. Patients requiring laboratory assessments, insulin therapy, or specialist management are referred to regional referral hospitals. Delivery of DSMES is limited in this system (8).
Eligibility and recruitment
We used broad participant inclusion criteria: 1) being aged 18 years or older and 2) having a glycated hemoglobin (HbA1c) ≥6.5% or diagnosis of diabetes within the preceding 12 months. We excluded individuals who were pregnant or had type 1 diabetes.
Any health facility in included municipalities was eligible to refer patients. In each of the 8 municipalities, we approached all public health centers and selected public hospitals, private clinics, nongovernmental clinics, and pharmacies. At public health centers, study staff also actively recruited patients from diabetes peer-group meetings. Other recruitment activities included approaching known patients from Maya Health Alliance, word-of-mouth from enrolled participants, door-to-door visits, and public fliers.
Intervention
The intervention was based on our previous pilot and delivered by community health workers at the participants’ homes (9). The intervention was a public–private partnership whereby community health workers paid by Maya Health Alliance worked within the public health system. The curriculum was adapted for low-literacy Mayan-speaking populations and based on a Guatemalan version of the US National Heart, Lung, and Blood Institute’s Salud Para Su Corazón (Health for Your Heart) model for Latinx populations (19,20). Prior adaptions by our group to this curriculum included diabetes-specific content, home visits with family participation, minimal written text, and culturally relevant drawings, props, and games (9). The intervention consists of a screening visit, 6 monthly education visits, and a closing visit (Box). The curriculum focuses on the “4 pillars” of diabetes control: 1) regular medical appointments, 2) adherence to medications prescribed by health care providers, 3) regular physical activity, and 4) a healthy diet that reduces intake of carbohydrates. At each visit, study educators review achievements from prior visits, assess individualized milestones, and use motivational interviewing to guide participants on overcoming barriers to behavior change. We expected that the total intervention time per participant would be 8 months with each monthly visit lasting 1 hour. We did not provide any incentives to increase participation or adherence.
Box. Structure and Content of a Diabetes Self-Management Education and Support Intervention in Rural Guatemala, 2018–2020.
Visit 1
Screening visit
Baseline data collected
Visit 2
“4 Pillars” of type 2 diabetes control: 1) medical visits, 2) medication adherence, 3) diet, and 4) exercise
Normal blood glucose levels
Diabetes symptoms
Diabetes complications
Causes of diabetes
Foot care
Visit 3
Diet
Basic food groups
Carbohydrate portions
Activity (does this increase blood glucose?)
Activity (make a healthy plate)
Visit 4
Sugary drinks
Snacks
Strategies to eat well at parties
Alcohol consumption
Blood pressure and salt consumption
Visit 5
Benefits of exercise
Types of physical activity
Activity (“a day in the life . . .”)
Importance of family support, diet, and exercise
Visit 6
Guatemalan beliefs about diabetes
Importance of medications
Importance of medical check
Visit 7
Activity (I can control my diabetes!)
Participant-led review activity
Individualized challenges and success (4 pillars of control)
Visit 8
Closing visit
End-point data collected
Full intervention materials (facilitator guide and patient visual materials) are available in Spanish at https://doi.org/10.7910/DVN/CUSI4E.
Impact of COVID-19. We halted study enrollment in March 2020 when community-based transmission of COVID-19 was reported. Because of safety concerns and mandated travel restrictions, the study transitioned to telephone visits. Participants who had not finished before March 15, 2020, had end-point psychometric data but no end-point clinical data collected.
Data sources and data collection
We conducted an explanatory sequential mixed-methods evaluation (21) guided by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) Qualitative Evaluation for Systematic Translation (RE-AIM QuEST) mixed-methods framework (13). The project evaluation plan and data sources are available elsewhere (Appendixes 3–4 [16]).
Quantitative data were entered in real time using smartphones and data capture software (REDCap). Quantitative data included participant sociodemographic characteristics, clinical and psychometric outcomes, implementation metrics, and costs. All quantitative data were collected in participants’ homes by 1 trained research assistant. Qualitative data consisted of semistructured interviews with study participants (n = 12), intervention staff (n = 5), and staff members at health centers (n = 6). All intervention staff members and staff members from 6 of 8 health centers were interviewed; 2 health center staff members did not respond. We purposefully sampled interview participants with low and high effect size (change in HbA1c) and engagement (average visit time), including at least 1 participant of each sex in each group. The interview guides were designed to explore elements of the quantitative analysis, following dimensions of the RE-AIM framework tailored to each group (13). Example probes included perceptions of project utility, determinants of clinical benefit, impact of COVID-19 and transition to telephone visits, role of sex and other determinants of participation, and family involvement. The full interview guide is available elsewhere (Appendix 5 [16]). Interviews in Spanish lasted approximately 30 minutes. Interviews in Maya Kaqchikel used an interpreter and lasted approximately 1 hour. Interviews were recorded and then translated and transcribed in Spanish. All qualitative data were collected by 1 study author (A.A.), a trained anthropologist, and were conducted via telephone because of COVID-19.
Outcomes
Reach. Reach references the absolute number, proportion, and representativeness of study participants. Quantitatively, we examined lost-to-follow-up and compared the characteristics of study participants with the characteristics of participants with diabetes in a contemporaneous population-representative chronic disease survey conducted by the authors in 2018 and 2019 in one of the study’s municipalities (22). Qualitatively, we focused on barriers to enrollment, especially for men.
Effectiveness. Effectiveness references the effect of the intervention on study outcomes. Primary clinical outcomes were HbA1c, systolic blood pressure, diastolic blood pressure, and body mass index (BMI). HbA1c was assessed with a point-of-care device (A1CNow, PTS Diagnostics). Seated arterial blood pressure was assessed in triplicate after 15 minutes with an Omron 7 digital cuff and estimated as the mean of 3 measurements. Secondary psychometric outcomes were diabetes knowledge, diabetes distress, and self-management. Diabetes knowledge was measured by the Diabetes Knowledge Questionnaire (DKQ-24); scores range from 0 to 24, with higher scores indicating more knowledge (23). Diabetes distress was measured by the Diabetes Distress Scale (DDS); scores range from 1 to 6, with higher scores indicating more distress (24). Self-management was measured by selected questions from the Summary of Diabetes Self-Care Activities instrument (SDSCA) (25). We previously validated the DKQ-24 and SDSCA during our pilot (9). Qualitatively, we investigated the mechanisms influencing effectiveness and potential explanations of differences between participants.
Adoption. Adoption references the absolute number, proportion, and representativeness of staff, providers, and organizations. We calculated the proportion of participants who were enrolled by type of health facility (public facilities, private clinics, nongovernmental clinics, pharmacies). We also examined the proportion of participating versus invited facilities. Qualitatively, our interviews explored factors that affected facility participation.
Implementation. Implementation references how accurately and consistently the intervention was carried out, including adaptations and cost. We examined total time between screening and closing visits, between first and last education visits, average visit duration, and costs. We also calculated the proportion of the suggested curriculum that was completed during each visit. Qualitatively, we explored barriers to fidelity, strategies to overcome barriers, and intervention modifications.
Maintenance. Maintenance references the extent that the intervention and intervention outcomes are sustained after the study. In interviews we explored factors leading to high or low levels of engagement and intent to continue.
Data analysis
Quantitative. We used Stata version 16 (StataCorp LLC) for analyses. We compared participant baseline characteristics with the population-representative sample using the Student t test for continuous data and the proportion test for categorical data. Baseline participant characteristics of retained study participants and participants lost to follow-up were also compared using the Student t test and proportion test. For clinical outcomes, we constructed multilevel mixed-effects models for HbA1c, blood pressure, BMI, the DKQ-24, the DDS, and the SDSCA. Models were prespecified to include random effects for study participant and fixed effects for age, sex, ethnicity, education level, time since diagnosis, difficulty paying for medications, and baseline value.
To investigate the impact of missing data due to COVID-19 and other causes, we conducted a sensitivity analysis using multiple imputation with chained equations and 100 imputations (26). We conducted a second sensitivity analysis of the impact of conducting the intervention virtually during the COVID-19 pandemic on psychometric outcomes.
Qualitative. We analyzed interviews using Dedoose (Sociocultural Research Consultants). We conducted a thematic framework analysis using an inductive approach. We first developed a codebook by analyzing 2 interviews from each group. Responses were then coded by 2 authors (S.T. and D.F.), and grouped by RE-AIM dimensions. Differences were resolved through consensus. The final coded interviews added less than 5% new information, indicating thematic saturation (27).
Mixed methods. We integrated our findings using a joint display of quantitative and qualitative findings and meta-inferences (21). Meta-inferences are interpretations that emerge from the integrated analysis of the quantitative and qualitative data. They were generated iteratively by discussion among the team (27).
Results
Of 738 participants screened, 111 did not meet inclusion criteria. In total, 627 participants were enrolled (Figure). Of all enrolled participants, end-point data were not collected for 23.8% (149 of 627), most of whom had no working telephone number during the COVID-19 lockdown. Psychometric end-point data were collected for 74.6% (468 of 627). Clinical end-point data were collected for 40.0% (251 of 627).
Figure.
Enrollment flowchart for a diabetes self-management education and support intervention in rural Guatemala, 2018–2020.
Reach
Quantitative. In the comparison of baseline characteristics of participants and the total diabetes population, important differences included the overrepresentation of women, greater preference for a Mayan language, lower levels of education, and higher baseline values for HbA1c and blood pressure (Table 1). Compared with participants who completed the study, participants lost to follow-up were more likely to speak a Mayan language, but otherwise we found no significant baseline sociodemographic or clinical differences, including for self-identified Maya ethnicity. A full comparison of baseline characteristics between participants lost to follow-up and those retained and additional health service data characteristics are available elsewhere (Appendixes 6–7 [16]).
Table 1. Baseline Characteristics of Participants Enrolled in a Diabetes Self-Management Education and Support Intervention in Rural Guatemala and Population Comparison, 2018–2020.
| Variable | Enrolled Participants | Populationa | P Valueb |
|---|---|---|---|
| Female, % | 83.7 | 47.6 | <.001 |
| Age, mean (SD), y | 57.3 (12.3) | 53.5 (12.4) | .04 |
| Indigenous Maya, % | 88.5 | 71.8 | <.001 |
| Preferred language is Mayan, % | 56.3 | 23.1 | <.001 |
| Educationc is primary or less, % | 87.2 | 50.0 | <.001 |
| Years since diagnosis, median (IQR) | 7 (3-13) | NA | |
| Glycated hemoglobin A1c, % | |||
| Mean (SD) | 9.5 (2.1) | 8.9 (3.1) | .03 |
| <8.0% | 29.7 | 52.1 | <.001 |
| Blood pressure | |||
| Systolic, mean (SD), mm Hg | 127.8 (21.3) | 116.3 (15.9) | <.001 |
| Diastolic, mean (SD), mm Hg | 79.9 (10.4) | 75.3 (10.7) | .004 |
| Hypertensive, % | 28.8 | 15.5 | .052 |
| Body mass index, kg/m2 | |||
| Mean (SD) | 28.6 (5.1) | 29.3 (5.6) | .37 |
| ≥25.0, % | 78.0 | 77.8 | .98 |
| ≥30.0, % | 37.5 | 35.9 | .83 |
Abbreviations: IQR, interquartile range; NA, not available.
Individuals with diabetes from a unique population-based survey conducted in the study area during 2018 and 2019 (22).
Student t test for continuous data and proportion test for categorical data.
Education was treated as a continuous variable in our regression models but is presented in categories here, because only categorical data on education were available in the population survey.
Qualitative. In the investigation into reasons for the low levels of enrollment among men, a common theme was that men often leave for work early in the morning and return late, after clinics close. In addition, “machismo” (an exaggerated sense of masculinity) negatively affected men’s self-care and their willingness to participate. As one educator reported,
I think it is because of the lack of time men have. The men are the ones who go out to work; they have to go out to the fields to work which doesn’t give them time . . . and I think they are closed in, they don’t like to get checkups often . . . they are embarrassed to say that they have some illness.
Interviewees also reported that many men did not view health education to be of material benefit. One participant shared criticisms of the intervention that he had heard from another person with diabetes:
There is a man who also has diabetes that doesn’t agree with just talks. He said they are only bringing knowledge and lectures. They are not giving medicine or economic support. He said it’s better to invest his time working than talking, then he can buy his own medicine.
Effectiveness
Quantitative. In adjusted multilevel models, mean change in HbA1c was −0.4% (95% CI, −0.6% to −0.3%; P < .001), mean change in systolic blood pressure was −5.0 mm Hg (95% CI, −6.4 to −3.7 mm Hg; P < .001), mean change in diastolic blood pressure was −2.6 mm Hg (95% CI, −3.4 to −1.9 mm Hg; P < .001), and mean change in BMI was 0.5 (95% CI, 0.3 to 0.6; P < .001) (Table 2). Mean change in diabetes knowledge assessed using the DKQ-24 was 3.9 (95% CI, 3.6 to 4.1; P < .001) and mean change in diabetes distress using the DDS was −0.4 (95% CI, −0.4 to −0.3; P < .001). We also found significant improvements in most self-care activities.
Table 2. Primary and Secondary Outcomes of Participants in a Diabetes Self-Management Education and Support Intervention in Rural Guatemala, 2018–2020a .
| Outcome | Baseline | End Point | Adjusted Pre-Post Difference, Mean Change (95% CI) | P Valueb |
|---|---|---|---|---|
| Primary outcomes, mean (SD) | ||||
| Glycated hemoglobin A1c, % | 9.5 (2.1) | 8.9 (2.0) | −0.4 (−0.6 to −0.3) | <.001 |
| Systolic blood pressure, mm Hg | 127.8 (21.3) | 123.2 (19.5) | −5.0 (−6.4 to −3.7) | <.001 |
| Diastolic blood pressure, mm Hg | 79.9 (10.4) | 76.9 (10.1) | −2.6 (−3.4 to −1.9) | <.001 |
| Body mass index, kg/m2 | 28.6 (5.1) | 28.6 (4.7) | 0.5 (0.3 to 0.6) | <.001 |
| Secondary outcomes, mean (SD) | ||||
| Diabetes Knowledge Questionnaire-24c | 12.0 (3.9) | 16.2 (2.9) | 3.9 (3.6 to 4.1) | <.001 |
| Diabetes Distress Scaled | 2.5 (0.8) | 2.1 (0.7) | −0.4 (−0.4 to −0.3) | <.001 |
|
| ||||
| Summary of Diabetes Self-Care Activitiese | ||||
| Median (IQR) number of days in the last week you have . . . | ||||
| Followed a healthy diet | 3 (1-4) | 4 (3-5) | 2.1 (1.8 to 2.3) | <.001 |
| Exercised ≥30 min | 1 (0-3) | 2 (1-3) | 1.2 (1.0 to 1.5) | <.001 |
| Checked feet | 2 (0-4) | 3 (2-7) | 1.5 (1.3 to 1.8) | <.001 |
| Taken medications | 6 (4-7) | 6 (5-7) | 0.2 (0 to 0.5) | .10 |
| Answered yes to yes/no question | ||||
| Know what a carbohydrate is | 0.06 (0.05 to 0.08) | 0.39 (0.35 to 0.44) | 0.32 (0.28 to 0.36)f | <.001 |
| Smoked in the last week | 0.03 (0.02 to 0.04) | 0.01 (0.00 to 0.03) | −0.02 (−0.02 to −0.01)f | .001 |
Abbreviation: IQR, interquartile range.
All models were hierarchical mixed-effect models that included a random-intercepts effect for study participant. Adjusted models included fixed effects for the intervention time, age, sex, ethnicity, education level, time since diagnosis, difficulty paying for medications, and baseline value. Primary and secondary outcomes were linear regression models. Days per week in self-care activities were assessed in ordinal regression models, and yes/no questions in logistic regression models, where 0 = no and 1 = yes.
Determined by linear mixed-effects model.
Scores range from 0 to 24, with higher scores indicating more knowledge (23).
Scores range from 1 to 6, with higher scores indicating more distress (24).
Self-management was measured by selected questions from the Summary of Diabetes Self-Care Activities instrument (25).
Values are marginal effect (95% CI).
The results from the sensitivity analysis investigating the impact of missing data through multiple imputation were similar to the results of the primary analysis; details are available elsewhere (Appendix 8 [16]). All missing data for this exercise were imputed, except for binary SDSCA outcomes because of multicollinearity. In the second sensitivity analysis, which assessed the impact of conducting the intervention virtually during the COVID-19 pandemic, improvements in knowledge, distress, and diet outcomes were similar before and during the pandemic; details are available elsewhere (Appendix 9 [16]). However, we did not observe improvements in physical activity outcomes during the pandemic.
Qualitative. The primary mechanism affecting effectiveness was the personalized nature of visits, which addressed participants’ specific needs while building trust. Themes mentioned included 1) the tailoring of educational content to each participant, 2) the supportiveness of educators, 3) the favorability of home-based visits, and 4) the patients’ ability to choose a preferred language. As 1 study educator explained,
If the patient preferred to speak in Kaqchikel, I would speak to them in Kaqchikel; if they wanted to speak in Spanish, then I would speak Spanish. I think it is very important that participants receive the education in their preferred language. This gives them more confidence . . . it is much better to have personalized education because the participant can express their doubts and not be embarrassed or worried about what their peers hear . . . in our program we go step by step, theme by theme, personalized to the participant.
Another educator commented on the role of family and community support:
When the family participated it had a great influence on the participant. When the family attended the education visits and understood it, they could support each other at home and throughout the following days. When there was family support, there was more positive changes in the participants.
Adoption
Quantitative. Of the 612 participants, 386 (63.1%) were referred from health centers; 31.4% (192 of 612) from Maya Health Alliance programs; 4.2% (26 of 612) from private clinics; 1.0% (6 of 612) from the regional public hospital; and 0.3% (2 of 612) through door-to-door promotion.
All 44 health facilities approached agreed to participate. Of 10 public health facilities, 8 were health centers and 2 were hospitals. Seven of 8 health centers and 1 of 2 public hospitals referred patients. Of 24 private clinics, only 3 referred patients. None of the 8 pharmacies who agreed to participate referred participants.
Qualitative. Interviews highlighted partial adoption by participating health centers. Health center staff allowed recruitment of participants attending diabetes peer groups but were otherwise not active. One study educator acknowledged this lack of integration: “All we did was present the project to the directors to get approval. They gave us 10 to 15 minutes to present our project at the diabetes club meetings and that was it.”
One identified barrier that prevented adoption was the lack of a training program for health center staff. One study educator noted this could be improved: “In the future we could coordinate with the health centers to do trainings with the staff working in diabetes. We could train the staff and also the health center directors before the intervention so that they are more involved.”
Implementation
Quantitative. The median time between baseline and end-point data collection was 268 (interquartile range, 225–343) days. The median time between first and last education visits was 155 (interquartile range, 144–182) days. During the intervention (pre– and post–COVID-19), 83.7% (525 of 627) of participants completed all 6 education visits. The mean (SD) duration of home visits was 70.9 (15.4) minutes. The mean (SD) duration of telephone visits was 41.4 (13.2) minutes.
Direct intervention costs were US$90.19 per participant (Appendix 10 [16]). In comparison, government health expenditure per capita is US$94.49, and total current health expenditure per capita is US$259.62, with 57.5% of costs being out of pocket (28).
The median of suggested curriculum elements that were completed for all visits was 94.3% (interquartile range, 91.8%–96.5%).
Qualitative. The main intervention modifications were caused by the COVID-19 pandemic. Implementing the intervention was more difficult after the transition to virtual visits. One positive aspect was the ability to schedule visits during nonworking hours. One study educator summarized:
One challenge was that cellular reception was very bad . . . I had to call 3 to 4 times to finish a study visit. Also, the phone numbers we had were often not the participants’. . . . When we called, the participant would not be home, and it was uncomfortable for the family member or neighbor. This gave us less time for the visit. Phone visits had fewer questions than home visits because we could not show them pictures, which helped generate a lot of questions. . . . We did cover all the topics, but the patients were a little more closed.
Although home visits were preferred, participants were generally satisfied with the quality of telephone visits: “Phone visits are fine. It is not that I don’t like them, they were fine and logical, but if it is possible home visits are better.”
Maintenance
Qualitative. All interview participants desired to continue practicing what they had learned during the intervention. A common theme was that changes were difficult but became easier over time: “[T]he beginning was the most difficult because humans are used to eating what they want to. You have no diet, you eat everything. But later you start adapting to the diet and eventually you are used to it and it is easier.”
At the organizational level, all health center staff expressed support. The main barrier to continuing the intervention was lack of time: “I think that our availability, our time would be the biggest challenge. I don’t think that the intervention would be difficult for us to do, but the time we have is what would be difficult.”
Mixed methods
We summarized the quantitative and qualitative findings and meta-inferences globally because we found no significant differences between the purposefully sampled groups (Table 3). First, DSMES interventions struggle to enroll men when they lack strategies that accommodate work schedules and address cultural barriers to self-care and education. Second, although all types of health facilities were eager to participate in identifying and referring participants, their day-to-day participation was limited. Better integration is critical in scaling up DSMES interventions in the public health system. Third, although the public health center system has interest in “personalized” DSMES, achieving sustainability requires addressing budgetary and time constraints. A key sustainability limitation of the public–private approach used here was that the public sector’s capacity to adequately support the cost of DSMES staff was unclear.
Table 3. Explanatory Sequential Joint Display: A Summary of Quantitative and Qualitative Findings and Mixed Methods Meta-Inferences in an Evaluation of a Diabetes Self-Management Education and Support Intervention in Rural Guatemala, 2018–2020.
| RE-AIM Dimension | Quantitative Findings | Qualitative Findings | Meta-Inferences |
|---|---|---|---|
| Reach | • 16% of participants were men, while approximately 50% of people with diabetes in the population were men • Participants had worse HbA1c and blood pressure compared with overall diabetes population |
Barriers to enrollment of men: • Prioritization of work • Culture of machismo • DSMES not perceived as beneficial • Desire to received something of material value for time (also found for women) |
Future DSMES interventions may have trouble reaching total diabetes population without • Prioritizing at-work men • Addressing the culture of machismo • Integrating education more clearly within the broader structures of clinical diabetes care |
| Effectiveness | Improvements in clinical and psychometric outcomes: • HbA1c, blood pressure • Diabetes knowledge, diabetes distress, self-care activities |
Principal mechanisms that led to effectiveness: • Personalized nature of study visits • Cultural and linguistic acceptability • Family and community support |
DSMES programs benefit from: • Patient-centered care • Family and community inclusion |
| Adoption | • Most (95%) participants were recruited from health centers or by Wuqu’ Kawoq staff and programs • All health facilities that were approached agreed to participate, although few patients were referred |
• Intervention was only partially adopted by health centers • Pre-intervention trainings may help increase health facility involvement |
• Public and private health facilities were willing to participate in the DSMES program • Minimal participation in settings without direct involvement of study staff • Special attention to integrating health facilities may be necessary |
| Implementation | Mean visit duration: • Home visits (71 min) • Telephone visits (41 min) |
• More difficult to implement telephone visits than home visits • Overall high levels of patient satisfaction with telephone visits |
Future interventions should carefully consider tradeoffs between at-home and telephone visits |
| Maintenance | Direct intervention costs were US$90.19 per participant | Both participants and health center staff expressed desire to continue the intervention | There is interest in sustaining DSMES from: • Patients • Health workers • Health facility leadership However, important financial and time constraints exist |
Abbreviations: DSMES, diabetes self-management education and support; HbA1c, glycated hemoglobin A1c; RE-AIM, reach, effectiveness, adoption, implementation, and maintenance.
Discussion
This study reports outcomes of a culturally tailored DSMES intervention scaled up within the public health system in rural Guatemala. The intervention led to substantial improvements in clinical and psychometric outcomes despite challenges posed by the COVID-19 pandemic.
A recent systematic review of DSMES interventions in low- and middle-income countries concluded that evidence is limited by study heterogeneity and that randomized controlled trials are needed (29). However, it is unlikely that randomized controlled trials will be completed in most settings where diabetes is a pressing concern, not just because of cost but also because of 1) the face validity of DSMES principles, and 2) their recognition as standard of care in high-income settings (9,30). Therefore, analyses of nonexperimental interventions using detailed implementation assessment frameworks can provide data to assist policy makers.
Our study is the largest observational study on type 2 diabetes in Guatemala, and several findings are worth highlighting. First, access to medical care and medications at baseline was higher than previously reported during the last decade (Table 2, Appendix 7 [16]), likely a result of efforts by the Ministry of Health’s Chronic Disease Commission to strengthen chronic disease care in rural centers (9). On the other hand, baseline self-care indicators for diet and exercise were low, suggesting that education has not kept pace. A recent pooled analysis emphasizes that lifestyle education for diabetes is a major unmet need globally (30).
Our analysis of barriers and facilitators to implementation highlights several important challenges to scaling DSMES in low-resource settings. First, although men commonly are underreached by these initiatives (30), limited data on disease prevalence has made precise assessments difficult. We found that women were overrepresented by nearly 40 percentage points. Second, participant interviews highlighted that the high degree of personalization of the intervention was essential for their engagement. This personalization likely fosters effectiveness by building a trusted supportive relationship. This is an important point for future scalability, as health center staff members felt that time and budgetary constraints would make precisely this degree of personalization infeasible. Solving these staffing constraints on tailored interactions with patients is critical to scaling lifestyle interventions in low-resource settings (12). In particular, it is likely that dedicated DSMES providers — analogous to certified diabetes educators — are essential to effective relationship building, and future work will need to explore this as an alternative to the more typical “generalist” frontline worker model common in Guatemala and the region.
Our study has several limitations and strengths. First, our study focuses on DSMES in one geographic area of Guatemala, although this is balanced by strengths such as the pragmatic design, the large sample size, and the comparison to a representative population sample permitting assessment of reach. Second, we used a pretest–posttest study design, which limits our ability to report causality, although we did adjust the analysis for important prespecified covariates. Third, the intervention was limited to a duration of 6 months. Planned 12-month assessments were abandoned because of the COVID-19 pandemic. Fourth, because of COVID-19, we modified our intervention and evaluation plan, resulting in missing outcome data. We addressed these issues through sensitivity analyses, including multiple imputation (Appendixes 8–9 [16]). The findings from these sensitivity analyses support our primary conclusions.
We found that in a rural population of individuals with type 2 diabetes in Guatemala, a community health worker–led DSMES intervention within the public health system led to improvements in HbA1c, blood pressure, diabetes knowledge, disease-related stress, and diet and physical activity. Our mixed-methods implementation research shows that scaling up DSMES in low-resource health systems requires careful consideration of implementation barriers and facilitators. Long-term staffing and cost of the intervention are also important concerns.
Acknowledgments
Scott Tschida and David Flood contributed equally to this publication. Funding for this study was provided by the World Diabetes Foundation (WDF 14-909). This study was approved by the institutional review boards of Maya Health Alliance and the Institute of Nutrition of Central America and Panama. No copyrighted materials were used in this article.
Footnotes
The opinions expressed by authors contributing to this journal do not necessarily reflect the opinions of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions.
Suggested citation for this article: Tschida S, Flood D, Guarchaj M, Milian J, Aguilar A, Fort MP, et al. Implementation of a Diabetes Self-Management Education and Support Intervention in Rural Guatemala: A Mixed-Methods Evaluation Using the RE-AIM Framework. Prev Chronic Dis 2021;18:210259. DOI: https://doi.org/10.5888/pcd18.210259.
References
- 1. International Diabetes Federation. IDF diabetes atlas, 9th edition. 2019. https://www.diabetesatlas.org. Accessed September 29, 2021.
- 2. Stanaway JD, Afshin A, Gakidou E, Lim SS, Abate D, Abate KH, et al. ; GBD 2017 Risk Factor Collaborators. Global, regional, and national comparative risk assessment of 84 behavioural, environmental and occupational, and metabolic risks or clusters of risks for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018;392(10159):1923–94. 10.1016/S0140-6736(18)32225-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. World Health Organization. WHO package of essential noncommunicable (PEN) disease interventions for primary health care. 2020. https://www.who.int/publications/i/item/who-package-of-essential-noncommunicable-(pen)-disease-interventions-for-primary-health-care. Accessed September 29, 2021.
- 4. Manne-Goehler J, Geldsetzer P, Agoudavi K, Andall-Brereton G, Aryal KK, Bicaba BW, et al. Health system performance for people with diabetes in 28 low- and middle-income countries: a cross-sectional study of nationally representative surveys. PLoS Med 2019;16(3):e1002751. 10.1371/journal.pmed.1002751 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Ministerio de Salud Pública y Asistencia Social. Encuesta nacional de prevalencia de enfermedades no transmisibles y sus factores de riesgo en población de 18 años o más. Dominio I: Urbano Metropolitana, Departamento de Guatemala, diciembre 2015. October 2018. http://epidemiologia.mspas.gob.gt/files/Publicaciones%202019/ENT/STEPS%20ENT%20MSPAS%202018.pdf. Accessed September 29, 2021.
- 6. Miranda JJ, Carrillo-Larco RM, Ferreccio C, Hambleton IR, Lotufo PA, Nieto-MartSínez R, et al. ; NCD Risk Factor Collaboration (NCD-RisC)—Americas Working Group. Trends in cardiometabolic risk factors in the Americas between 1980 and 2014: a pooled analysis of population-based surveys. Lancet Glob Health 2020;8(1):e123–33. 10.1016/S2214-109X(19)30484-X [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Avila C, Bright R, Gutierrez JC, Hoadley K, Manuel C, Romero N, et al. Guatemala health system assessment 2015. August 2015. United States Agency for International Development. https://www.usaid.gov/sites/default/files/documents/1862/Guatemala-HSA _ENG-FULL-REPORT-FINAL-APRIL-2016.pdf. Accessed September 29, 2021.
- 8. Flood D, Rohloff P. “This disease is for those who can afford it”: diabetes in indigenous Maya communities. In: Chary A, Rohloff P, editor. Privatization and the new medical pluralism: shifting healthcare landscapes in Maya Guatemala. Lanham (MD): Lexington Books; 2015:53–70. [Google Scholar]
- 9. Flood D, Hawkins J, Rohloff P. A home-based type 2 diabetes self-management intervention in rural Guatemala. Prev Chronic Dis 2017;14:E65. 10.5888/pcd14.170052 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Ministerio de Salud Pública y Asistencia Social. Normas de atención salud integral para primero y segundo nivel 2018. November 2018. https://mspas.gob.gt/component/jdownloads/send/251-normas-de-atencion/2060-normas-de-atencion-en-salud-integral-2018.html. Accessed September 29, 2021.
- 11. Attridge M, Creamer J, Ramsden M, Cannings-John R, Hawthorne K. Culturally appropriate health education for people in ethnic minority groups with type 2 diabetes mellitus. Cochrane Database Syst Rev 2014;9(9):CD006424. 10.1002/14651858.CD006424.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Kreuter MW, Wray RJ. Tailored and targeted health communication: strategies for enhancing information relevance. Am J Health Behav 2003;27(1 Suppl 3):S227–32. 10.5993/AJHB.27.1.s3.6 [DOI] [PubMed] [Google Scholar]
- 13. Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health 2019;7:64. 10.3389/fpubh.2019.00064 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Des Jarlais DC, Lyles C, Crepaz N; TREND Group. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health 2004;94(3):361–6. 10.2105/AJPH.94.3.361 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. ; StaRI Group. Standards for reporting implementation studies (StaRI) statement. BMJ 2017;356:i6795. 10.1136/bmj.i6795 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Tschida S, Flood D, Guarchaj M, Milian J, Aguilar A, Fort M, et al. Scaling-up a diabetes self-management education and support intervention in rural Guatemala: mixed methods evaluation using the RE-AIM-QuEST framework. 2021. Accessed September 14, 2021. 10.7910/DVN/CUSI4E [DOI] [PMC free article] [PubMed]
- 17.Guatemalan Government. Mapas de pobreza rural en Guatemala 2012: resumen ejecutivo. April 2013. http://www.ine.gob.gt/sistema/uploads/2014/01/10/ifRRpEnf0cjUfRZGhyXD7RQjf7EQH2Er.pdf. Accessed September 29, 2021.
- 18. Greiner M, Melvin C, Ajsivinac J, Hernandez R, Otzoy R, Hehn E, et al. Salud del corazón: raxnaqil ri k’uxaj. https://www.scribd.com/doc/103637691/Manual-para-Diabeticos. Accessed September 29, 2021.
- 19. Mendoza Montano C, Fort M, deRamirez M, Cruz J, Ramirez-Zea M. Evaluation of a pilot hypertension management programme for Guatemalan adults. Health Promot Int 2016;31(2):363–74. 10.1093/heapro/dau117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs — principles and practices. Health Serv Res 2013;48(6 Pt 2):2134–56. 10.1111/1475-6773.12117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Miller AC, Tuiz E, Shaw L, Flood D, Garcia P, Dhaenens E, et al. Population estimates of GFR and risk factors for CKD in Guatemala. Kidney Int Rep 2021;6(3):796–805. 10.1016/j.ekir.2020.12.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Garcia AA, Villagomez ET, Brown SA, Kouzekanani K, Hanis CL. The Starr County Diabetes Education Study: development of the Spanish-language diabetes knowledge questionnaire. Diabetes Care 2001;24(1):16–21. 10.2337/diacare.24.1.16 [DOI] [PubMed] [Google Scholar]
- 23. Polonsky WH, Fisher L, Earles J, Dudl RJ, Lees J, Mullan J, et al. Assessing psychosocial distress in diabetes: development of the Diabetes Distress Scale. Diabetes Care 2005;28(3):626–31. 10.2337/diacare.28.3.626 [DOI] [PubMed] [Google Scholar]
- 24. Toobert DJ, Hampson SE, Glasgow RE. The summary of diabetes self-care activities measure: results from 7 studies and a revised scale. Diabetes Care 2000;23(7):943–50. 10.2337/diacare.23.7.943 [DOI] [PubMed] [Google Scholar]
- 25. Azur MJ, Stuart EA, Frangakis C, Leaf PJ. Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res 2011;20(1):40–9. 10.1002/mpr.329 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Guest G, Namey E, Chen M. A simple method to assess and report thematic saturation in qualitative research. PLoS One 2020;15(5):e0232076. 10.1371/journal.pone.0232076 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. The World Bank. Guatemala data. https://data.worldbank.org/country/guatemala. Accessed June 21, 2021.
- 28. Werfalli M, Raubenheimer PJ, Engel M, Musekiwa A, Bobrow K, Peer N, et al. The effectiveness of peer and community health worker-led self-management support programs for improving diabetes health-related outcomes in adults in low- and-middle-income countries: a systematic review. Syst Rev 2020;9(1):133. 10.1186/s13643-020-01377-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Flood D, Seiglie JA, Dunn M, Tschida S, Theilmann M, Marcus ME, et al. The state of diabetes treatment coverage in 55 low- and middle-income countries: a cross-sectional study of nationally representative, individual-level data in 680,102 adults. Lancet Healthy Longev 2021;2(6):e340–e51. 10.1016/S2666-7568(21)00089-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Fort MP, Castro M, Peña L, López Hernández SH, Arreola Camacho G, Ramírez-Zea M, et al. Opportunities for involving men and families in chronic disease management: a qualitative study from Chiapas, Mexico. BMC Public Health 2015;15(1):1019. 10.1186/s12889-015-2361-6 [DOI] [PMC free article] [PubMed] [Google Scholar]