Abstract
Background
Despite the increasing number of primary studies on the quality of health care for sick children in Ethiopia, the findings have not been systematically synthesised to inform quality improvement in policies or strategies. This systematic review provides a narrative synthesis of published evidence on the quality of care provided to sick children in Ethiopia's health facilities and on related barriers and enablers.
Methods
We searched studies that measured the structure, process, and outcome measures of quality of care as proposed by Donabedian’s framework. We searched in PubMed/Medline, EMBASE, and Web of Science using the Population, Concept, and Context (PCC) framework. Grey literature was searched in Google Scholar and institutional websites. We appraised the studies’ quality using the Mixed Method Quality Appraisal Tool version 2018. Data were analysed using content thematic analysis and presented using a narrative approach.
Results
We included 36 of 701 studies. Thirty (83.3%) were nonexperimental including 21 (70%) cross-sectional studies and five (16.7%) qualitative studies. Of the 31 facility-based studies, 29 (93.5%) were conducted in public facilities. The structural, technical, and interpersonal processes of care were low quality. While some studies reported the effectiveness of interventions in reducing child mortality, the uptake of services and providers’ and caretakers’ experiences were suboptimal. The major structural barriers to providing quality care included inadequacy of essential drugs, supplies and equipment, training, clinical guidelines, and ambulance services. Caretakers’ non-compliance to referral advice was a common demand-side barrier. The enabling factors were implementing various health system strengthening interventions including quality improvement strategies such as user-centred service delivery and optimising engagement of community-level structures such as health promotors and religious leaders to create demand.
Conclusions
The quality of care provided to sick children in health facilities is generally low in Ethiopia. Shortages of essential drugs, supplies and equipment, physical space, water, and electricity; and human resource-related challenges such as shortage, training, supervision, and retention were common structural barriers. Various health systems strengthening and quality improvement interventions, ranging from enhanced demand creation to realising a reliable and consumer-centred service delivery were key enablers. More research is needed on the quality of care provided in private facilities.
Registration
PROSPERO: CRD42021285064.
Ethiopia has reduced the child mortality rate from 87 to 55 deaths per 1000 live births between 2009–2019. However, the reduction in neonatal mortality rate is not significant compared to infant and child mortality rates; 44% of under-5 deaths were neonatal deaths [1]. Poor-quality services have been shown to be risk factors for child mortality in high burden countries despite substantial increases in access to essential health services during the past two decades [2].
The quality of child health care remains a concern in Ethiopia despite the relatively increasing coverage of effective interventions and increasing interest in understanding the quality of care provided to sick children [3]. Improving both the uptake and quality of primary childcare services is imperative for further reduction of under-5 mortality rates [4].
Donabedian’s structure-processes-outcomes framework is the most commonly used tool for health care quality assessment [5] with the assumption that better health care produces better health outcomes [6]. Several studies ranging from small scale to nationwide and from community based to facility-based, have measured one or more of the components of quality of childcare services in Ethiopia [7-9].
Despite the growing number of primary studies on the quality of care for sick children, individual studies cannot inform whether the results apply across specific settings. To the best of our knowledge, no previous work has attempted to systematically identify and synthesise such evidence in Ethiopia. The evidence would help policymakers, practitioners, and researchers to address the identified gaps in the quality of care. Therefore, this systematic review (SR) aimed to determine the quality of care provided to sick children in Ethiopia's health facilities, and the barriers and enabling factors related to quality care provision.
METHODS
The Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement was used to write the protocol [10]. This SR protocol was registered on the International Prospective Register of Systematic Reviews (PROSPERO) # CRD42021285064.
Population and outcomes of interest
We determined the eligibility of the review question using the Population, Concept and Context (PCC) framework suggested by the Joanna Briggs Institute [11]. The primary population of interest included sick under-5 children, their caretakers, service providers and managers. The concept referred to the quality of care provided to sick under-5 children as defined by Donabedian’s structure-process-outcome framework.
Structure was assessed in the context of service delivery, including drugs, supplies, equipment, human resources, and organisational characteristics. Process was assessed as a set of actions and services which made up the actual care provided to the sick child, including interpersonal and clinical actions. Outcome or clinical outcomes included death or cure and complication, and quality of care as perceived by caretakers, providers, and managers. Service uptake or coverage was also considered as an intermediate outcome. Together with the other outcomes, measures of key actors’ experiences would serve as proxies for a comprehensive understanding of health system quality, not just clinical or service quality. Thus, responsiveness measures, e.g. trust and confidence in health system, were captured whenever reported. Finally, as applied to this review, the context domain of the PCC framework pertains to those studies conducted in Ethiopia.
Eligibility criteria
Studies that satisfied the following inclusion criteria were: qualitative, quantitative (i.e. randomised, non-randomised and descriptive studies), or mixed methods; conducted in Ethiopia; reported evidence of quality focused on at least one component of Donabedian’s structure-process-outcome framework; included sick under-5 children or their primary caretakers, service providers and managers as the populations of interest; published in peer-reviewed and grey literature (i.e. theses and dissertations); reported in English; and published until 23 February 2022. We excluded reports on the quality of preventive and promotive services provided, e.g. vaccination, growth monitoring, and vitamin A supplementation, reports on the quality of home-based care, e.g. breastfeeding, more fluids, and feeding, and review articles.
Search strategy
We thoroughly searched for relevant studies in PubMed/Medline, EMBASE and Web of Science databases. Grey literature was also searched from Google Scholar, university repositories and government websites. Reference lists of eligible studies were also explored. Keywords were combined using Boolean terms ‘AND’ and ‘OR’ to search for eligible studies: ‘child’ OR ‘children’ OR ‘under 5’ OR ‘under-5’ OR ‘under five’ OR ‘under-five’ OR ‘infant’ OR ‘infants’ OR ‘neonate’ OR ‘neonates’ OR ‘newborn’ or ‘newborns’ OR ‘baby’ OR ‘babies’ AND ‘sick’ OR ‘illness’ OR ‘disease’ OR ‘diseases’ AND ‘mother’ OR ‘mothers’ OR ‘caregiver’ OR ‘caregivers’ OR ‘caretaker’ OR ‘caretakers’ OR ‘care takers’ AND ‘quality’ AND ‘child health care’ OR child health care OR ‘newborn care’ OR ‘pediatric care’ OR ‘paediatric care’ OR ‘management of childhood illness’ OR ‘integrated management of childhood illness’ OR IMCI OR ‘community case management’ OR CCM OR ‘integrated community case management’ OR iCCM OR ‘community-based newborn care’ OR CBNC AND Ethiopia. A detailed search strategy is provided in Table S1 in the Online Supplementary Document.
Study selection
A three-step process, adapted from the 2020 PRISMA approach [12], was followed to select studies including identification, initial screening of abstracts, and final eligibility assessment after full-text screening. Two review authors (NBB and BHT) removed duplicate records and screened the title of the studies from the electronic databases. We created an EndNote X9 library to import the identified studies, remove the duplicates, and archive the eligible articles. The abstracts of these identified studies were independently scanned to exclude ineligible studies. Finally, full-length articles were reviewed using the inclusion criteria. The 2020 PRISMA framework was adapted to present the screening results of the review to include search date, type of database, keywords, and numbers of retrieved and eligible studies. Discrepancies between the two review authors (NBB, and BHT) were resolved in discussion with other co-authors.
Data abstraction and management
We extracted data using a data charting form. Two review authors (NBB and BHT) independently extracted author and year of publication, study title, objective/aim, design, population(s), setting (i.e. health facility (type and level) vs community-based), sample size and sampling technique, data collection method(s), type(s) of disease-focused, types of intervention or measure of quality measured (structure, process and/or outcome) and key findings on quality-of-care measures and conclusions. Discrepancies between the reviewers were resolved using a consensus method.
Collating, summarising, and reporting the results
We conducted a mixed studies review with a qualitative evidence synthesis approach using a databased convergent thematic synthesis [13–15]. We identified themes from qualitative studies or qualitative aspects of mixed methods studies, while variables used in quantitative studies or quantitative aspects of mixed methods studies were transformed into qualitative codes. A databased convergent synthesis design, rather than a mixed synthesis process, was chosen aimed at corroborating results from qualitative and quantitative methods. All the extracted data (i.e. both qualitative and quantitative) were analysed using the same thematic synthesis method. Categories or themes were then developed using the predefined Donabedian’s structure-process-outcome components of quality measurement. Results of the synthesis were presented using tables and narrative and descriptive summaries. The results were reported using PRISMA 2020 statement guideline [12].
Risk of bias and quality assessment
Two independent reviewers (NBB and BHT) evaluated the quality of the screened studies reviewed using the Mixed Method Quality Appraisal Tool (MMAT) version 2018 (http://mixedmethodsappraisaltoolpublic.pbworks.com). The tool provides a more efficient appraisal by limiting to core criteria. It focuses on five core methodological quality criteria for five study designs: qualitative, randomised controlled trial, non-randomised, quantitative descriptive and mixed methods. Overall, the tool includes 25 criteria and two screening questions to assess relevance, design, adequacy and methodology, data collection and analysis, and results. The review authors (NBB and BHT) graded the quality of each study by calculating the total percentage quality score. A paper was classified as high quality if it scored 76% and above; of average quality, if it scored between 51 and 75%; and of low quality if it scored ≤50%. Accordingly, 35 studies scored ≥80% and were judged to be of high quality, one study scored 60% and was judged to be of average quality, and no study was judged to be of low quality. Inconsistencies between the reviewers were resolved by discussion with other review co-authors.
RESULTS
We identified a total of 701 studies, of which 53 were duplicates. After removing the duplicates, we conducted initial title and abstract screening for 648 studies. We retrieved a total of 177 studies and excluded 471 using the eligibility criteria for full-text screening. With further screening, we retained 69 studies for full-text review, of which a total of 36 were included in the final review. Reasons for exclusion after full article screening included reporting non-sickness or routine care practices, misalignment of study populations, different methodologies, inadequate content relevant to the review (e.g. reporting user-related factors for service utilisation), reporting on a specific device or drug evaluations, and full-text inaccessibility (Figure 1).
Characteristics of the included studies
Four (11.1%) of the 36 included studies were randomised controlled trials and two (5.6%) were non-randomised pre-post interventional studies. The remaining 30 studies (83.3%) employed a nonexperimental design. The majority of these, 21 (70%), were cross-sectional surveys and five (16.7%) were qualitative studies, while one (3.3%) was a time series. The study population varied from health facilities in nine (25%) studies which involved only resource inventory and review of clinical records in two studies (5%), to individuals (i.e. children, caretakers, health workers and facility managers) in 25 studies (70%). Six studies (17%) used caretakers as their principal study population, followed by health workers and facility managers used in four studies (11%). Sixteen studies (44%) exclusively focused on various newborn illnesses, while the remainder (56%) focused on one or more common childhood illnesses, including diarrhoea, malaria/fever, pneumonia, and severe acute malnutrition (SAM) (Table S2 in the Online Supplementary Document).
Of the studies, 26 (72.2%), were health facility-based [7,9,16–38], five (18.9%) were community-based [39–43], and five (18.9%) were conducted in both settings [44-48]. Of the facility-based studies, including those conducted in both settings (n = 31), the majority, 29 (93.5%), involved public health facilities [7,9,16–23,25–38,44–48]. The remaining two studies (6.5%) were conducted in both public and private facilities [8,24] (Table S3 in the Online Supplementary Document).
Structure
Out of the 36 studies reviewed, 19 (52.8%) reported structural measures of quality of care provided to sick children either in a stand-alone study or in combination with process and/or outcome measures [7,8,16,18,22,24–27,29–32,34,37–39,46–48]. Only two of these studies that applied the pathway to child survival analysis [46], and that identified gaps in the provision of quality integrated community case management (iCCM) services provided by health extension workers (HEWs) and caregivers’ adherence to prescribed medicines [32], reported mixed findings, i.e. both adequacy and inadequacy of the quality of the structural measures. For instance, according to a cross-sectional study that assessed the strength of iCCM implementation and quality of care provided by HEWs [31], Most HEWs (78.8%) were trained in iCCM, and 87% received supervision three months prior to the study. They also showed that 70% of health posts had all essential commodities for iCCM. Similarly, Sintayehu, et al. [41], revealed the availability of neonatal resuscitation corners (97.4%) and essential equipment for newborn resuscitation (85%) in the health facilities. However, the availability of newborn resuscitation guidelines was 63%, and only 25.1% of health professionals had ever received refresher training on neonatal resuscitation [41].
In the remainder of the studies [7,8,16,18,23–27,29,30,32,37–39,45–48], the structural quality was reported to be substandard, regardless of how the specific measures were measured through resource inventory, or from providers’ or users’ perspectives. Likewise, the level of care at the health post (HP), health centre (HC) or hospital level was substandard. The overall structural standards for a neonatal intensive care unit (NICU) were met by 63% of the studied primary hospitals [16], and 65.2% of the required equipment, and 72.2% of medicines, were met in the NICU ward of a referral hospital [30]. Similarly, Biadgo, et al. [7] reported that only 15.6% of the studied health facilities fulfilled the standards for quality childcare provision. The stockout of essential drugs, supplies and equipment at HP level has also been cited in other studies [29,32,41,48].
Three studies [8,27,29] have identified gaps in the availability of skilled staff. Getachew, et al. [8] and Jebessa, et al. [27] reported that about half of service providers received sick childcare training in the two years preceding the study, while Ketaro, et al. [29] showed that almost all the providers did not receive any similar training during the same reference period. The latter study also reported a lack of a written job description as a work aid for service providers.
Process
Twenty-three studies (63.9%) have assessed the process measures of quality of care provided to sick children [7,8,11,17,18,21–35,39–41,45,46]. A relatively higher level of adherence of providers to the recommended standards of care was reported by three (13%) of these studies [32,39,40]. For example, an evaluative study that examined the effectiveness of conducting community case management of malaria among children in urban settings [39] showed that almost all (99%) of children with fever were prescribed the correct dose of Artemisinin-based combination therapy (ACT) for their age by community medicine distributors. Health extension workers’ knowledge of assessment, classification, and referral of children with severe illness was also reported to be above 80% by Najjemba, et al. [32].
Approximately two-thirds (60.9%) of the studies reported that both the clinical and interpersonal aspects of care provided to sick children were generally of low quality [7–9,18,24,25,27,29,31,32,34,35,39,46]. The gap ranged from no child being correctly assessed [18] to an overall compliance of 68% [25]. A study that examined the know-do gap of providers revealed low performance with an average score of 34%. The gap between knowledge and performance was large for treatment and counselling items (39%), and among doctors [24]. Sintayehu et al. [34] also demonstrated poor retention of basic neonatal resuscitation skills by midwives and nurses (11.2%). Gebremedhin et al. [25] similarly revealed that very severe diseases were not treated according to the national CBNC programme implementation guideline, and identification of neonatal sepsis cases was poor. Getachew et al. [8] also identified that respiratory rate was counted in 56% of children, their temperature was checked in 77% of cases of suspected pneumonia, and dehydration was assessed in 54% of children who had diarrhoea with dehydration. Degefie et al. [22] cited that HEWs could identify only 57% of sick newborns with at least one sign of possible severe bacterial infections (PSBI) to provide antibiotic treatment when referral to higher levels was not possible. Daka et al. [9], Mash et al. [46], Miller et al. [31], and Tamiru et al. [35] have also found gaps in HEWs’ performance on iCCM implementation.
Out of 20 studies that reported on interpersonal communication between providers and caretakers, five (21.7%) identified gaps [8,27,29,31,46]. In a cross-sectional study that assessed the quality of integrated management of childhood illness (IMNCI) services in health centres of Jimma zone, Southwest Ethiopia [29], most providers reported little or no communication with caretakers at discharge. Other studies found that none [29] and only 2% [8] of the providers used a visual aid during consultations. From a caretakers’ perspective, providers advised nearly half (48.4%) on follow-up care according to Ketaro et al. [29]. However, this was only 13% in another study [46], which also reported that a quarter of the caretakers understood treatment advice provided.
Outcome
The majority, 26 (72.2%), of the reviewed studies measured one or more of the outcome measures of quality [8,16,17,19,20,22,23,25–33,38–44,46–48]. Ten (38.5%) of these studies investigated coverage or utilisation of child health interventions [19,20,22,31,40,41,43,46–48], followed by nine (34.6%) on the perceived quality of care both from caretakers’ and providers’ sides. Eight of the latter group of studies (88.9%) explored caretakers’ views [8,23–25,29,30,33,39], while two (22.2%) explored providers’ views [27,44]. In addition, seven (26.9%) studies assessed health outcomes at both individual and population levels. Five of the studies (71.4%) looked at the effectiveness of interventions in reducing childhood mortality at a population level [16,22,26,31,42], while four (57.1%) examined clinical or treatment outcomes, including recovery and complication rates and adverse effects of clinical treatment [16,19,26,28].
Studies generally found that the coverage or utilisation of community-based child survival interventions was suboptimal in Ethiopia [19,20,22,31,40,41,43,48]. For example, the uptake of life-saving interventions ranged from 9.3% for iCCM services [41] to 77.7% for the treatment of PSBI [20]. The perceived quality of care was similarly reported to be low, mainly towards services provided at a community level. For example, mothers believed that distance from home to the nearest HP was not a barrier for them if the quality of services provided by HEWs was perceived as good. They lacked trust in the HEWs’ ability to treat children at home [44]. Getachew et al. [8] also reported that caretakers preferred private providers over HP-level care. Jebessa et al. [27] similarly revealed a compromised quality of care provided to sick newborns from mothers’, health care providers’ and facility administrators’ views. According to Ketaro et al. [29], 23.4% of caretakers were dissatisfied with waiting times and 33.6% were dissatisfied with consultations or treatment given by providers.
With regards to the individual and population level health outcomes, four studies [20,22,26,42] reported the effectiveness of the investigated services in reducing, or in their potential to reduce, child mortality. For example, studies by Berhane et al. [20] and Degefie et al. [22] have shown that infants with possibly severe bacterial infection (PSBI) can effectively be managed as outpatients at HP or HC level when referral to a hospital is not feasible. A slight decrease in perinatal mortality was also observed in a time series analysis of the impacts of quality improvement intervention on maternal and newborn health in four Ethiopian regions [26]. Tadesse et al. [42] also revealed a 17.7% reduction in childhood diarrhea with the model household creation strategy of health extension programme (HEP). In contrast, few studies reported unfavorable health outcomes [28,40]. A study [40] found an insignificant contribution of the iCCM programme to child mortality reduction. Kabalo and Seifu [28] similarly reported a lower recovery rate (64.9%) of children with severe acute malnutrition (SAM) treated using the outpatient therapeutic feeding programme.
Barriers
Nine studies [25%] identified supply-side barriers to quality care provision [18,21,24,27,36–38,41,47], while three studies [8.3%] reported demand-side barriers [21,22,27]. Barriers related to adequacy of infrastructure, human resources and perceived poor quality of care were included in the frequently cited supply-side barriers. Shortages of essential drugs, supplies and equipment, physical space, water, and electricity were noted as infrastructural bottlenecks for quality care provision [18,24,27,36–38,41,47]. Human resource-related challenges such as shortage, training, supervision, and retention were reported in five studies [18,21,27,37,47]. The lack of clinical guidelines in health facilities was a related gap emphasised in two studies [21,27]. Three studies [21,27,36] identified the lack of ambulance service as a barrier to the functionality of the referral system, and a lack of funds was reported by another study [37].
Perceived poor quality of care provided by health facilities has been cited in four studies as a barrier to service uptake [18,21,41,47]. The specific gaps included facility closure and inconvenient opening hours [36,42], long consultation time [18], under-resourced physical facilities and lack of confidence in HEWs’ skills [47], and services provided by referral facilities [21].
From the demand side, caretakers’ non-compliance to referral advice and economic insecurity were reported as barriers [21,22,27]. For example, Degefie et al. [22] reported that 90% of caretakers of infants with PSBI refused referral. According to Jebessa et al. [27], users are less likely to accept interventions if they perceive that there would be unaffordable financial costs.
Enablers
The reviewed studies suggested solutions pertinent to the barriers discussed above. Various health systems strengthening, and quality improvement interventions, have been recommended by many studies, ranging from enhanced demand creation to realising a reliable and consumer-centered service delivery [8,21,23,26,29,33,37,39,40,43,44,48].
A significant effect of infrastructural capacity improvement on health workers’ adherence to recommended care practices has been established by Hagaman et al. [27]. Abayneh et al. [17] also found that implementing quality improvement interventions significantly improved health workers’ performance of IMCI. Maintaining a consistent supply of essential drugs, supplies and equipment [29,47], and ensuring a functional referral system [21] were among the specific solutions suggested to realise quality service delivery to improving health outcomes.
Some studies [8,23,40,44] also emphasised the critical role of building the capacity of the health workforce through training, supervision, and availing clinical guidelines and protocols. For instance, iCCM-trained workers provided good quality care [40], and the training of providers also resulted in higher client satisfaction [8].
Finally, four studies pointed out enabling factors for demand creation [19,21,43,47]. Usman et al. [37] recommended engaging community leaders such as HDA and religious leaders, as well as model families to maximise their role as information disseminators and influencers to resonate their best practices. Mengistu et al. [47] cited establishing and making use of community feedback mechanisms to enhance community engagement and respond to their health needs in a timely manner. In another study, families believed that receiving training on model family packages of HEP was significantly associated with the uptake of iCCM services [43]. Improving caretakers’ awareness of signs of illness was also recommended to improve their compliance to referral advice [21].
DISCUSSION
The results showed that the quality of care provided to sick children primarily in public health facilities was generally low in Ethiopia in terms of all the quality components. Shortage of essential drugs, supplies, equipment training, clinical guidelines and ambulance services were the common supply-side barriers, while low service uptake and caretakers’ non-compliance to referral advice were the demand-side barriers. For those studies conducted during and after 2019, COVID-19 pandemic might have contributed to the observed under achievements due to shifting health care resource towards the pandemic response, and limited access to services due to lockdown measures.
Overall, our findings are consistent with the existing literature. For example, an analysis of facility surveys in nine countries revealed the failure of primary care facilities to carry out their function with a mean quality score of 0.41 (out of 1), an index for evidence-based care, competent systems, and user experience domains. Ethiopia scored the lowest (0.32) in this study, while Namibia scored the highest (0.46) [49]. As noted in Rockers et al. [50], ensuring high clinical quality, along with client-centred service organisation and delivery, increased uptake and ensuring better health outcomes increases users’ trust in the health system. This would, in turn, lead to increased service uptake and better health outcomes. It is also evident that poor-quality care is responsible for 60% of deaths due to treatable conditions, while the remainder are due to the non-use of health services [49]. Thus, ensuring high-quality care would prevent one million newborn deaths annually [49].
In terms of structural measures of care quality, this review showed low readiness of health facilities to provide sick childcare services at all health facility levels. A similar finding has been reported in low-and-middle income countries (LMICs) where health facilities were often underequipped and understaffed [49]. The authors attributed poor-quality care to gaps in the knowledge, skills, and motivation of health workers. Although structural measures of care quality are weakly related to the content of care delivered [51], high-quality care cannot be expected in such constrained settings [6]. To benefit from the implementation of effective interventions, the health system should ensure that health facilities, health professionals, essential medicines and equipment are always available to meet the required standards of care [52]. The observed widespread nature of the gaps across settings and disease types may suggest that structural barriers are system-wide issues.
Consistent with several previous studies, our review also revealed that both the clinical and interpersonal processes of care provided to sick children were generally of low quality. Leslie et al. [51] analysed nationally representative health systems surveys to see the association between in-service training and supervision, and the quality of sick childcare in seven sub-Saharan Africa (SSA) countries. Results demonstrated a poor quality of care with health workers complying with less than half of the recommended practices. Other studies also reported non-compliance of providers to the recommended clinical practices with frequent misdiagnoses of deadly conditions such as pneumonia [49,53–56], diarrhoea [53,56] and newborn asphyxia [49].
The suboptimal process quality may be partly explained by the shortage of required inputs such as drugs, supplies, equipment, and laboratory facilities, even when health workers know the importance of these critical resources in creating an enabling care setting [57]. Quality of care processes determines both service uptake and health outcomes. Implementation of interventions, such as IMCI or community case management (CMM) is not a guarantee for improved health outcomes, as the quality of care is key to ensuring adequate case management, encouraging the use of the services and attaining health outcomes [58]. The observed gaps in performance across studies suggest the quality improvement potential in the country. Non-compliance to evidence-based care practices would lead to adverse conditions such as treatment delays, disease progression, waste of resources, catastrophic out-of-pocket expenditures, and eventually death [49,59].
Poor-quality care also includes the underuse of available effective services [53]. The suboptimal coverage or utilisation and providers’ and caretakers’ experiences with the child survival interventions have also been cited previously. For example, Kruk et al. [49] noted that an average of 34% of people in LMICs had poor user experience due to lack of attention or respect (41%), long waiting times (37%), poor communication (21%), or short service time (37%). The study also cited that only 43% of providers informed caregivers about their child’s diagnosis. The finding can partly be explained by the inadequate quality of structural and process components observed in the review [6,51].
Perceived poor quality of care can affect health care utilisation patterns and bypass of facilities [60–62]. Although satisfaction can be affected by user-related factors such as sociodemographic, health conditions, care experiences, expectations, and courtesy bias [63], it is related to objective measures of process quality and health outcomes [64]. As a result, the validity of this measure of quality may be challenged. For instance, illiterate or less experienced users mostly show high satisfaction for apparently poor-quality services. In contrast, expecting but not receiving services that are not designated, e.g. antibiotics for common cold, may dissatisfy users [49].
The interventions investigated by some of the reviewed studies were reported to be effective in reducing child mortality. However, good health outcomes are not always attributable to good procedures due to multiple factors which, in addition to the treatment protocol, determine health outcomes [49,65]. Since quality of care is a sensitive indicator of a well-functioning health system [49], the findings on all the three quality domains highlight that the health system would effectively improve child survival by improving both quality and coverage of health care in the country.
We also identified the inadequacy of essential drug supplies and equipment, staff training, clinical guidelines, physical space, water, electricity, and ambulance services as supply side barriers. Such structural barriers impact not only service utilisation, but also on the effectiveness of interventions and client perceptions [58]. Perceived poor quality of care was also a blockade for service uptake. Caretakers’ non-compliance to referral advice, due to the associated costs and unfavourable illness perceptions of caretakers, were the demand side barriers. These findings endorse the low quality of care both for technical and interpersonal attributes of process quality. Enhancing health care system capacity through ensuring an enabling service delivery setting and developing providers’ capacity is essential.
Communities with high levels of social capital, where material and psychosocial resources are shared by members who work together to address their problems collectively, are more likely to address their problems [66]. Implementing various health systems strengthening and quality improvement interventions, such as enhanced demand creation and consumer centred service delivery were the enablers identified in this review. Engaging community leaders such as the health development army (HDA), model families and religious leaders, and using community feedback mechanisms, enabled demand creation. The findings highlight the need to tap the existing community-level structures as a vehicle for demand creation. For instance, enhancing community conversations and social support systems, can then help improve caretakers’ compliance with referral advice.
This SR had strengths and weaknesses. Being the first synthesis report of the available evidence on the quality of care provided to sick children in the country, the work has generated wide-ranging evidence to inform policy and practice decisions and areas for future research. The scope of the review was broad, which we believe provided a comprehensive review of care quality, all derived from studies of good quality. However, the linearity assumption of the Donabedian’s quality assessment framework [6] may mask the complex interactions that exist among quality components, and between components and the broader environment. Efforts were made to understand the quality of care for sick children from a systems perspective by extending Donabedian’s framework, which primarily intends to measure clinical care quality [6], to include population-level metrics such as service coverage. However, the review did not synthesise evidence on the non-health effects of various child survival interventions such as economic values (e.g. cost-effectiveness, cost-benefit, and catastrophic expenditures due to poor quality care) and financial risk protection mechanisms. Such information would enable a better understanding of how the health system operates toward reducing child mortality.
CONCLUSIONS
The quality of care provided to sick children in health facilities was generally low in Ethiopia. The readiness of health facilities to provide childcare services to sick children was low at all levels. Both technical and interpersonal processes of care were also of low quality. Mixed findings were observed on outcome quality. Some studies reported the effectiveness of interventions in reducing child mortality, while uptake of child survival interventions and providers’ and caretakers’ experiences are suboptimal outcomes. The major structural barriers to providing quality care included inadequacy of essential drugs, supplies and equipment, training, clinical guidelines, and ambulance services. Caretakers’ non-compliance to referral advice was a demand-side barrier. Implementing various health systems strengthening and quality improvement interventions, such as consumer-centred service delivery and enhanced demand creation were the enabling factors identified.
Additional material
Acknowledgements
We are grateful to Sebastien Haneuse and Clara Pons Duran for their support and dedication to this review. We also thank Dorothy L. Southern for providing scientific writing advice and critically reviewing the manuscript.
Ethics statement: This review included no patient identifiers and therefore did not require institutional review approval. The extracted data were kept confidential during the review process.
Footnotes
Funding: This review was funded by Bill & Melinda Gates Foundation, grant # OPP1201842 and the HaSET Maternal and Child Health Research Program.
Authorship contributions: All authors contributed to the review. The specific contributions include NBB, TN and BHT conceptualised the study; NBB drafted the manuscript; TN, BHT, DB, LT and GC reviewed and revised it. The final manuscript was reviewed and approved by all authors.
Disclosure of interest: The authors completed the ICMJE Disclosure of Interest Form (available upon request from the corresponding author) and disclose no relevant interests.
REFERENCES
- 1.UNICEF. Levels and Trends in Child Mortality: The 2013 Report. United Nations Childrens' Fund; 2013. [Google Scholar]
- 2.World Health Organization. World Bank. Delivering quality health services: a global imperative for universal health coverage. Geneva: World Health Organization; 2018. [Google Scholar]
- 3.Ministry of Health of Ethiopia. Health Sector Transformation Plan II HSTP II 2020/21-2024/25. In: Directotrate HSP, editor.: Ministry of Helath, Ethiopia; 2020. [Google Scholar]
- 4.Ruducha J, Mann C, Singh NS, Gemebo TD, Tessema NS, Baschieri A, et al. How Ethiopia achieved millennium development goal 4 through multisectoral interventions: a countdown to 2015 case study. Lancet Glob Health. 2017;5:e1142–51. 10.1016/S2214-109X(17)30331-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Donabedian A.Evaluating the quality of medical care. Milbank Mem Fund Q. 1966;44:166–206. 10.2307/3348969 [DOI] [PubMed] [Google Scholar]
- 6.Donabedian A.Evaluating the quality of medical care. Milbank Q. 2005;83:691. 10.1111/j.1468-0009.2005.00397.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Biadgo A, Legesse A, Estifanos AS, Singh K, Mulissa Z, Kiflie A, et al. Quality of maternal and newborn health care in Ethiopia: a cross-sectional study. BMC Health Serv Res. 2021;21:679. 10.1186/s12913-021-06680-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Getachew T, Abebe SM, Yitayal M, Persson LÅ, Berhanu D.Assessing the quality of care in sick child services at health facilities in Ethiopia. BMC Health Serv Res. 2020;20:574. 10.1186/s12913-020-05444-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Daka DW, Wordofa MA, Woldie M, Persson LÅ, Berhanu D.Quality of clinical assessment and management of sick children by health extension workers in four regions of Ethiopia: a cross-sectional survey. PLoS One. 2020;15:e0239361. 10.1371/journal.pone.0239361 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1–9. 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Joanna Briggs Institute Reviewers’ Manual. 2015 Edition/Supplement. Methodology for JBI Scoping Reviews. Adelaide: The Joanna Briggs Institute; 2015. [Google Scholar]
- 12.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Syst Rev. 2021;10:89. 10.1186/s13643-021-01626-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Liamputtong P, editor. Handbook of research methods in health social sciences. Singapore: Springer; 2019. [Google Scholar]
- 14.Grant MJ, Booth A.A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26:91–108. 10.1111/j.1471-1842.2009.00848.x [DOI] [PubMed] [Google Scholar]
- 15.Lachal J, Revah-Levy A, Orri M, Moro MR.Metasynthesis: an original method to synthesize qualitative literature in psychiatry. Front Psychiatry. 2017;8:269. 10.3389/fpsyt.2017.00269 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Abawollo HS, Tsegaye ZT, Desta BF, Beshir IA.Readiness of Primary Hospitals in Providing Neonatal Intensive Care Services in Ethiopia. Ethiop J Health Sci. 2021;31:321. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Abayneh M, Gebremedhin T, Dellie E, Tsehay TC, Atnafu A.Improving the Assessment and Classification of Sick Children according to the Integrated Management of Childhood Illness (IMCI) Protocol at Sanja Primary Hospital, Northwest Ethiopia: A Pre-Post Interventional Study. Int J Pediatr. 2020;2020:2501932. 10.1155/2020/2501932 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Alemnew M. Assessment of the implementation of the integrated management of childhood illness Strategy and influencing factors in Governmental health institutions of Gondar Town Northwest, Ethiopia [dissertation]. Gondar, Ethiopia: School of public health, College of medicine and health sciences, University of Gondar; 2011.
- 19.Awasthi S, INCLEN Childnet Zinc Effectiveness for Diarrhea (IC-ZED) Group Zinc Supplementation in Acute Diarrhea is Acceptable, Does Not Interfere with Oral Rehydration, and Reduces the Use of Other Medications: A Randomized Trial in Five Countries. J Pediatr Gastroenterol Nutr. 2006;42:300–5. 10.1097/01.mpg.0000189340.00516.30 [DOI] [PubMed] [Google Scholar]
- 20.Berhane M, Girma T, Tesfaye W, Jibat N, Abera M, Abrahim S, et al. Implementation research on management of sick young infants with possible serious bacterial infection when referral is not possible in Jimma Zone, Ethiopia: Challenges and solutions. PLoS One. 2021;16:e0255210. 10.1371/journal.pone.0255210 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Beyene H, Hailu D, Tadele H, Persson LA, Berhanu D.A mixed-methods study exploring adherence to the referral of severely sick children in primary health care in Southern Ethiopia. Arch Public Health. 2021;79:159. 10.1186/s13690-021-00681-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Degefie Hailegebriel T, Mulligan B, Cousens S, Mathewos B, Wall S, Bekele A, et al. Effect on neonatal mortality of newborn infection management at health posts when referral is not possible: a cluster-randomized trial in rural Ethiopia. Glob Health Sci Pract. 2017;5:202–16. 10.9745/GHSP-D-16-00312 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Funk T, Källander K, Abebe A, Hailemariam A, Alvesson HM, Alfvén T.Management and Follow-up Practices of Children with Unclassified Fever in Rural Ethiopia: Experiences of Health Extension Workers and Caregivers. Am J Trop Med Hyg. 2018;99:1255–61. 10.4269/ajtmh.17-0777 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Gage AD, Kruk ME, Girma T, Lemango ET.The know-do gap in sick child care in Ethiopia. PLoS One. 2018;13:e0208898. 10.1371/journal.pone.0208898 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Gebremedhin T, Daka DW, Alemayehu YK, Yitbarek K, Debie A.Process evaluation of the community-based newborn care program implementation in Geze Gofa district, south Ethiopia: a case study evaluation design. BMC Pregnancy Childbirth. 2019;19:492. 10.1186/s12884-019-2616-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Hagaman AK, Singh K, Abate M, Alemu H, Kefale AB, Bitewulign B, et al. The impacts of quality improvement on maternal and newborn health: preliminary findings from a health system integrated intervention in four Ethiopian regions. BMC Health Serv Res. 2020;20:522. 10.1186/s12913-020-05391-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Jebessa S, Litch JA, Senturia K, Hailu T, Kahsay A, Kuti KA, et al. Qualitative Assessment of the Quality of Care for Preterm, Low Birth Weight, and Sick Newborns in Ethiopia. Health Serv Insights. 2021;14:11786329211025150. 10.1177/11786329211025150 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Kabalo MY, Seifu CN.Treatment outcomes of severe acute malnutrition in children treated within Outpatient Therapeutic Program (OTP) at Wolaita Zone, Southern Ethiopia: retrospective cross-sectional study. J Health Popul Nutr. 2017;36:7. 10.1186/s41043-017-0083-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Ketero MK, Muhammed AH, Abdi AA.Quality of Integrated Management of Newborn and Childhood Illness Services at Health Centers in Jimma, Southwest Ethiopia. Patient Prefer Adherence. 2021;15:793–805. 10.2147/PPA.S280004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Mekonnen WN, Desalegn AM.Quality of service and associated factors in neonatal intensive care unit at Debre Berhan Referral Hospital, Debre Berhan Ethiopia: A cross sectional study. Medical Journal of Dr D Y Patil Vidyapeeth. 2018;11:412–9. 10.4103/mjdrdypu.MJDRDYPU_3_18 [DOI] [Google Scholar]
- 31.Miller NP. Integrated community case management of childhood illness in Ethiopia: Implementation strength and quality of care [dissertation]. Baltimore, Maryland: Johns Hopkins University; 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Najjemba R, Kiapi L, Demissie SD, Gossaye T, Engida M, Ratnayake R, et al. Integrated community case management: Quality of care and adherence to medication in Beneshangul-Gumuz Region, Ethiopia. Ethiop Med J. 2014;52 Suppl 3:83–90. [PubMed] [Google Scholar]
- 33.Ali MS, Mekonen E, Workneh BS.Parental satisfaction and associated factors towards neonatal intensive care unit services at the University of Gondar Comprehensive Specialized Hospital, Northwest Ethiopia. Int J Afr Nurs Sci. 2021;15:100364. 10.1016/j.ijans.2021.100364 [DOI] [Google Scholar]
- 34.Sintayehu Y, Desalew A, Geda B, Tiruye G, Mezmur H, Shiferaw K, et al. Basic neonatal resuscitation skills of midwives and nurses in Eastern Ethiopia are not well retained: An observational study. PLoS One. 2020;15:e0236194. 10.1371/journal.pone.0236194 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Tamiru D, Berhanu M, Dagne T, Kebede A, Getachew M, Tafese F, et al. Quality of iCCM services at public health posts, Southwest Ethiopia. J Pediatr Nurs. 2021;57:32–7. 10.1016/j.pedn.2020.11.003 [DOI] [PubMed] [Google Scholar]
- 36.Teklu AM, Litch JA, Tesfahun A, Wolka E, Tuamay BD, Gidey H, et al. Referral systems for preterm, low birth weight, and sick newborns in Ethiopia: a qualitative assessment. BMC Pediatr. 2020;20:409. 10.1186/s12887-020-02311-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Usman AK, Wolka E, Tadesse Y, Tariku A, Yeshidinber A, Teklu AM, et al. Health system readiness to support facilities for care of preterm, low birth weight, and sick newborns in Ethiopia: a qualitative assessment. BMC Health Serv Res. 2019;19:860. 10.1186/s12913-019-4672-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Birhanu BG, Mathibe-Neke JM.The quality of service provision to newborns in the primary healthcare, West Gojjam zone, North West of Ethiopia: a cross sectional survey. BMC Pediatr. 2022;22:203. 10.1186/s12887-022-03272-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Akweongo P, Agyei-Baffour P, Sudhakar M, Simwaka BN, Konaté AT, Adongo PB, et al. Feasibility and acceptability of ACT for the community case management of malaria (CCMm) in urban settings in five African sites. Malar J. 2011;10:240. 10.1186/1475-2875-10-240 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Amouzou A, Hazel E, Shaw B, Miller NP, Tafesse M, Mekonnen Y, et al. Effects of the integrated Community Case Management of Childhood Illness Strategy on Child Mortality in Ethiopia: A Cluster Randomized Trial. Am J Trop Med Hyg. 2016;94:596–604. 10.4269/ajtmh.15-0586 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Shaw B, Amouzou A, Miller NP, Tsui AO, Bryce J, Tafesse M, et al. Determinants of utilization of health extension workers in the context of scale-up of integrated community case management of childhood illnesses in Ethiopia. Am J Trop Med Hyg. 2015;93:636–47. 10.4269/ajtmh.14-0660 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Tadesse A, Fentaye FW, Mekonen AM, Yasine T.The impact of Ethiopian community based HEP on diarrheal diseases among under five children and factors associated with diarrheal diseases in the rural community of Kalu district, Northeast Ethiopia: a cross sectional study. BMC Health Serv Res. 2022;22:168. 10.1186/s12913-022-07565-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Kassa EA, Handiso TB, Admassu B, Nigussie A.Utilization of integrated community case management service of childhood illness (ICCM) and associated factors among under-five children in Shashogo district, Hadiya zone, South Ethiopia. SAGE Open Med. 2022;10:20503121221097643. 10.1177/20503121221097643 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Defar A, Alemu K, Tigabu Z, Persson LÅ, Okwaraji YB.Caregivers’ and Health Extension Workers’ Perceptions and Experiences of Outreach Management of Childhood Illnesses in Ethiopia: A Qualitative Study. Int J Environ Res Public Health. 2021;18:3816. 10.3390/ijerph18073816 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Kahsay AB, Luel A, Hailu T, Mulugeta A.Referral practices on community based management of sick young infants with Possible Serious Bacterial Infection in Tigrai, Ethiopia: the caregivers’ perspectives. East Afr J Health Sci. 2019;1:2019. [Google Scholar]
- 46.Mash D, Aschenaki K, Kedamo T, Walternsperger K, Gebreyes K, Pasha O, et al. Community and Facility Surveys Illuminate the Pathway to Child Survival in Liben Woreda, Ethiopia. East Afr Med J. 2003;80:463–9. [DOI] [PubMed] [Google Scholar]
- 47.Mengistu B, Paulos M, Agonafir N, Ameha A, Legesse H, Dankenbring E, et al. Barriers to the uptake of community-based curative child health services in Ethiopia. BMC Public Health. 2021;21:1551. 10.1186/s12889-021-11558-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Tariku A, Berhane Y, Worku A, Biks GA, Persson LA, Okwaraji YB.Health post service readiness and use of preventive and curative services for suspected childhood pneumonia in Ethiopia: a cross-sectional study. BMJ Open. 2022;12:e058055. 10.1136/bmjopen-2021-058055 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Rockers PC, Kruk ME, Laugesen MJ.Perceptions of the health system and public trust in government in low- and middle-income countries: evidence from the World Health Surveys. J Health Polit Policy Law. 2012;37:405–37. 10.1215/03616878-1573076 [DOI] [PubMed] [Google Scholar]
- 50.Lindelow M, Wagstaff A. Health facility surveys: an introduction. USA: The World Bank. 2003. [Google Scholar]
- 51.Leslie HH, Gage A, Nsona H, Hirschhorn LR, Kruk ME.Training and Supervision Did Not Meaningfully Improve Quality of Care for Pregnant Women or Sick Children in Sub-Saharan Africa. Health Aff (Millwood). 2016;35:1716–24. 10.1377/hlthaff.2016.0261 [DOI] [PubMed] [Google Scholar]
- 52.World Health Organization. Packages of Interventions for Family Planning, Safe Abortion care, Maternal, Newborn and Child. Geneva: World Health Organization; 2010. [Google Scholar]
- 53.Glasziou P, Straus S, Brownlee S, Trevena L, Dans L, Guyatt G, et al. Evidence for underuse of effective medical services around the world. Lancet. 2017;390:169–77. 10.1016/S0140-6736(16)30946-1 [DOI] [PubMed] [Google Scholar]
- 54.Johansson EW, Nsona H, Carvajal-Aguirre L, Amouzou A, Hildenwall H.Determinants of Integrated Management of Childhood Illness (IMCI) non-severe pneumonia classification and care in Malawi health facilities: analysis of a national facility census. J Glob Health. 2017;7:020408. 10.7189/jogh.07.020408 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Uwemedimo OT, Lewis TP, Essien EA, Chan GJ, Nsona H, Kruk ME, et al. Distribution and determinants of pneumonia diagnosis using Integrated Management of Childhood Illness guidelines: a nationally representative study in Malawi. BMJ Glob Health. 2018;3:e000506. 10.1136/bmjgh-2017-000506 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Carvajal-Vélez L, Amouzou A, Perin J, Maïga A, Tarekegn H, Akinyemi A, et al. Diarrhea management in children under five in sub-Saharan Africa: does the source of care matter? A Countdown analysis. BMC Public Health. 2016;16:830. 10.1186/s12889-016-3475-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Kruk ME, Gage AD, Arsenault C, Jordan K, Leslie HH, Roder-DeWan S, et al. High-quality health systems in the Sustainable Development Goals era: time for a revolution. Lancet Glob Health. 2018;6:e1196–252. 10.1016/S2214-109X(18)30386-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Dogba M, Fournier P.Human resources and the quality of emergency obstetric care in developing countries: a systematic review of the literature. Hum Resour Health. 2009;7:7. 10.1186/1478-4491-7-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Mendelson M, Matsoso MP.The World Health Organization global action plan for antimicrobial resistance. S Afr Med J. 2015;105:325. 10.7196/SAMJ.9644 [DOI] [PubMed] [Google Scholar]
- 60.McCarthy EA, Subramaniam HL, Prust ML, Prescott MR, Mpasela F, Mwango A, et al. Quality improvement intervention to increase adherence to ART prescription policy at HIV treatment clinics in Lusaka, Zambia: A cluster randomized trial. PLoS One. 2017;12:e0175534. 10.1371/journal.pone.0175534 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Mekoth N, Dalvi V.Does quality of healthcare service determine patient adherence? Evidence from the primary healthcare sector in India. Hosp Top. 2015;93:60–8. 10.1080/00185868.2015.1108141 [DOI] [PubMed] [Google Scholar]
- 62.Gage AD, Leslie HH, Bitton A, Jerome JG, Joseph JP, Thermidor R, et al. Does quality influence utilization of primary health care? Evidence from Haiti. Global Health. 2018;14:59. 10.1186/s12992-018-0379-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Batbaatar E, Dorjdagva J, Luvsannyam A, Savino MM, Amenta P.Determinants of patient satisfaction: a systematic review. Perspect Public Health. 2017;137:89–101. 10.1177/1757913916634136 [DOI] [PubMed] [Google Scholar]
- 64.Doyle C, Lennox L, Bell D.A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3:e001570. 10.1136/bmjopen-2012-001570 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Engender Health. Cost Analysis Tool: Simplifying Cost Analysis for Managers and Staff of healthcare services. New York: Engender Health; 2000. [Google Scholar]
- 66.Poortinga W.Social relations or social capital? Individual and community health effects of bonding social capital. Soc Sci Med. 2006;63:255–70. 10.1016/j.socscimed.2005.11.039 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.