Abstract
Introduction
People’s confidence in and endorsement of the health system are key measures of system performance, yet are undermeasured in low-income and middle-income countries (LMICs). We explored the prevalence and predictors of these measures in 12 countries.
Methods
We conducted an internet survey in Argentina, China, Ghana, India, Indonesia, Kenya, Lebanon, Mexico, Morocco, Nigeria, Senegal and South Africa collecting demographics, ratings of quality, and confidence in and endorsement of the health system. We used multivariable logistic regression to assess the association between confidence/endorsement and self-reported quality of recent healthcare.
Results
Of 13 489 respondents, 62% reported a health visit in the past year. Applying population weights, 32% of these users were very confident that they could receive effective care if they were to ‘become very sick tomorrow’; 30% endorsed the health system, that is, agreed that it ‘works pretty well and only needs minor changes’. Reporting high quality in the last visit was associated with 4.48 and 2.69 greater odds of confidence (95% CI 3.64 to 5.52) and endorsement (95% CI 2.33 to 3.11). Having health insurance was positively associated with confidence and endorsement (adjusted odds ratio (AOR) 1.68, 95% CI 1.49 to 1.90 and AOR 1.34, 95% CI 1.22 to 1.48), while experiencing discrimination in healthcare was negatively associated (AOR 0.67, 95% CI 0.56 to 0.80 and AOR 0.63, 95% CI 0.53 to 0.76).
Conclusion
Confidence and endorsement of the health system were low across 12 LMICs. This may hinder efforts to gain support for universal health coverage. Positive patient experience was strongly associated with confidence in and endorsement of the health system.
Keywords: health services research, health systems
Key questions.
What is already known?
Confidence in and endorsement of (ie, agreeing that the system works well) health systems are important measures of a high-quality health system but are understudied in low-income and middle-income countries.
Poor healthcare quality has been widely documented in these settings and may contribute to low confidence and endorsement.
What are the new findings?
Our findings demonstrate low confidence in and endorsement of health systems in 12 low-income and middle-income countries.
Reporting a recent high-quality experience and having health insurance are associated with higher health system confidence and endorsement, while negative experiences with healthcare are associated with low confidence and endorsement
What do the new findings imply?
Our study countries appear to have a deficit in health system confidence and endorsement.
This deficit may make it challenging to garner public support for healthcare reforms such as universal health coverage.
Introduction
The Lancet Global Health Commission on High-Quality Health Systems in the Sustainable Development Goals Era (HQSS) proposed three main outcomes of a high-quality health system—better health, economic benefit and confidence in the health system.1 A high-quality health system provides people with a sense of security, or confidence, that they or their family members could get effective care if illness strikes. Endorsement of the health system—agreeing that the system functions well—is a summative measure that is related to, but broader than, confidence.2 3 Measures of endorsement are designed to challenge the respondent to think beyond their personal healthcare access and experience. Both confidence in and endorsement of the health system are valuable metrics of system performance, particularly as health systems become more oriented to the needs and values of people.4–7
In addition to inspiring security, confidence in the health system can prompt stronger patient engagement including appropriate health service utilisation, higher adherence to healthcare recommendations and better continuity of care, which in turn can improve health.8–11 Confidence can also translate into a more successful response to crises because populations that have developed trust are more likely to heed health advice and turn to the health system during emergencies—this is a feature of resilient health systems.12 Health system endorsement—typically operationalised as ‘the system is functioning well and only needs minor changes’—has been collected in high-income and middle-income countries and reflects respondent perceptions of health system performance at the population level.2 3
Despite the importance of confidence in and endorsement of health systems, these outcomes have been understudied in low-income and middle-income countries (LMIC), as have been their determinants. There is a mounting body of evidence showing that healthcare in LMICs is overall poor and highly variable across conditions, which is likely to have a deleterious effect on both confidence and endorsement. The basic foundations of healthcare are often weak; many facilities lack basic treatments and workforce shortages are widespread. Clinical encounters are often short, basic elements of clinical assessment and diagnosis are missing, and patients are not always treated with the dignity and respect that they deserve.1 13 These deficiencies contribute to poor health outcomes, but they are also likely to dissipate people’s confidence in and endorsement of their health systems.
In this study, we assess the level of confidence in and endorsement of the health system among internet users in 12 LMICs. Internet users (‘Internet users’ are defined here as people who are using the internet. Using the United Nations variable definition, ‘The Internet is defined as a worldwide public computer network that provides access to a number of communication services including the World Wide Web and carries email, news, entertainment and data files. Internet access may be via a computer, Internet-enabled mobile phone, digital TV, games machine, etc…’) are a growing but understudied population in LMICs. They are more educated and wealthier than the population at large and thus are not representative. However, their relatively privileged position may herald the future direction of public opinion on healthcare. Additionally, surveying this population allows for rapid feedback on health systems that, when appropriately weighted, can be used to gauge performance. We explore the role of reported care quality on confidence and endorsement. We discuss the policy and political implications of these findings in the era of universal health coverage (UHC).
Methods
Study design
We fielded an internet survey in 12 LMICs: Argentina, China, Ghana, India, Indonesia, Kenya, Lebanon, Mexico, Morocco, Nigeria, Senegal and South Africa. Each respondent answered a short survey on demographics, healthcare utilisation, type and quality of the respondent’s last healthcare visit, their perceptions of the health system and healthcare vignettes (online supplementary appendices 1 and 2). All respondents were geo-located through their internet protocol (IP) address. The instrument was translated by two translators from English to local languages (online supplementary appendix 3) and back-translated by native speakers. Web-users aged 18 years or older were sampled. Data were collected in August and September 2017, and the survey was closed in each country when at least 1000 surveys were completed. This sample size allowed us to achieve a margin of error of ±3% at a 95% confidence level in all study countries.
bmjgh-2019-002205supp001.pdf (732.9KB, pdf)
An internet survey method was chosen to rapidly reach respondents in multiple countries and to minimise social desirability bias.14 Internet use is becoming increasingly common in LMICs, with 40% of the world’s people having internet access in 2019 and only 24% of countries having rates below 20%.15 Internet users in LMICs are typically younger (18–34 vs >35 years of age), wealthier, more educated and more likely to be male than non-users.16 Thus, they can be seen as a more empowered advance guard in LMICs—people who likely have greater agency in health decisions and more extensive healthcare choices. We selected LMICs with internet penetrance over 20% (online supplementary appendix 4) and with broad global representation.
Internet users were sampled using Random Domain Intercept Technology (RDIT). Users who entered a non-existent or expired website name into their browser’s address bar were randomly selected to see a pop-up message inviting them to participate in the survey. RDIT has been used to study perceptions of mental illness, antivaccination sentiment and medication use.17–19 Entering non-existent website names is common and generates a sample that approximates the internet-using population. In an analysis of RDIT in the USA, a country with particularly detailed data on internet users, an RDIT sample was nearly identical to the national population of internet users with correlations approaching convergence for several variables: geographic distribution of users, internet service provider used, and internet use characteristics such as the number of times a site was visited.20 An important consideration in some countries is that RDIT is not affected by government restrictions on social media because it does not depend on those sites for distribution.
This survey employed several methods for maximising the validity and reliability of responses. It randomly varied the response order for categorical responses and moved the screen location of the question to promote attention to the question (ie, reduce repetitive clicking). The survey disallowed duplicate responses from the same IP address. It used proprietary code to detect and deselect ‘bots’—or automated entries. The method has been found to produce stable findings over time—a measure of reliability. For example, a mental health survey repeatedly conducted in India every month for over 21 months produced consistent estimates with low standard errors (SE) as did a vaccine belief survey in Ontario.17–19
Finally, this approach has several advantages over more commonly used internet panels and email-based solicitation of web survey participants.21 22 Internet panels often comprise habitual survey respondents, not casual internet users. This can lead to inattention and jadedness.23 24 Email-based survey invitations may be filtered out as spam, cannot be delivered anonymously and also tend to over-represent habitual survey respondents (see online supplementary appendix 5 for further discussion of methods).21
Measures
Past work, including Gilson’s theoretical work on trust and confidence,5 25 shows that the quality of care experienced by people affects confidence and endorsement.4 We developed a conceptual framework (see online supplementary appendix 6) based on that work and other literature on quality measurement and reporting in LMICs.1 26–29 The framework was used to design our survey and study. The outcomes of interest were confidence in and endorsement of the health system. Confidence was measured with the question ‘How confident are you that if you become very sick tomorrow, you would be able to receive effective treatment from the health system?’ Confidence was defined as a response of very confident versus somewhat, not very or not at all confident. As a sensitivity analysis, we defined confidence as either very or somewhat confident. Endorsement of the health system was defined as agreeing with the statement ‘On the whole, the system works pretty well and only minor changes are necessary to make it work better’ versus the alternatives: ‘Our health care system has so much wrong with it that we need to completely rebuild it’ and ‘There are some good things in our health care system, but major changes are needed to make it work better’.
In this survey, quality of care was measured using the respondent’s rating of overall quality during their most recent outpatient care visit. High quality is defined as a rating of good, very good or excellent. The last visit was used to maximise the accuracy of recall. We also included the past experience of discrimination in the health system, defined as ever being discriminated against, hassled or made to feel inferior by a health provider or staff. Other health system variables included frequency of visits (number of outpatient care visits in the past year), having health insurance and whether the last visit was to a public or private facility.
Individual sociodemographic characteristics known to affect confidence were added to the model: age, gender, self-reported health, educational attainment and location (urban or rural). Country fixed effects controlled for unmeasured time-invariant country characteristics. Senegal was chosen as a reference category because it has the lowest gross domestic product among study countries. Finally, because there may be differences in how people across countries rate quality due to different experiences and norms, we included an anchoring vignette on quality.29 The vignette described a routine hypertension visit where a nurse greets the patient, introduces herself and changes the patient’s medication, but does not ask about his symptoms or check his blood pressure. We chose this vignette because it describes observable poor healthcare quality for a common condition. Respondents who consider these descriptions as adequate by rating them as good, very good or excellent quality are considered to have low expectations of quality. Vignettes describing poor-quality of care have been used to gauge respondent expectations in a variety of settings, including in LMICs.26 30 31
Analysis and sample
We described the variables of interest across the sampled countries for all respondents who completed the entire survey. Only surveys that were completed through our questions of interest were included because respondents could not progress through the instrument if responses were missing. We then focused on the subsample of respondents who visited a health facility at least once in the past year and described their quality at their last visit and their confidence in and endorsement of the health system. We measured the association between the predictors described above and health system confidence and endorsement using multivariable logistic regression. This model allowed us to control for measured variables at the individual level as well as unmeasured variation between countries by including country dummy variables. Correlation at the country level was dealt with by clustering SEs. The binary outcomes make comparing different outcomes (ie, confidence vs endorsement) more readily accessible to the reader. Descriptive statistics are presented in table 1 with sampling weights. Descriptive statistics without sampling weights are included in online supplementary appendix 7. These sampling weights were created using a ranking algorithm to approximate a nationally representative sample based on the respondent’s age, gender, location (urban or rural) and education level. Age and weight targets were based on the Census Bureau’s 2017 population estimates of the country32; education and location weights are described in online supplementary appendix 5.
Table 1.
Argentina | China | Ghana | India | Indonesia | Kenya | Lebanon | Mexico | Morocco | Nigeria | Senegal | South Africa | 12 countries average | ||||||||||||||
N | % | N | % | N | % | N | % | N | % | N | % | N | % | N | % | N | % | N | % | N | % | N | % | |||
N respondents | 1153 | 1422 | 1048 | 1321 | 1179 | 1106 | 1003 | 1239 | 1124 | 1166 | 1019 | 1069 | 13 849 | |||||||||||||
Sociodemographics | ||||||||||||||||||||||||||
Age | ||||||||||||||||||||||||||
18–29 | 248 | 22 | 382 | 27 | 485 | 46 | 466 | 35 | 361 | 31 | 446 | 40 | 298 | 30 | 381 | 31 | 335 | 30 | 623 | 53 | 321 | 31 | 385 | 36 | 4730 | 34 |
30–49 | 394 | 34 | 597 | 42 | 338 | 32 | 552 | 42 | 460 | 39 | 424 | 38 | 440 | 44 | 496 | 40 | 482 | 43 | 402 | 35 | 331 | 33 | 478 | 45 | 5394 | 39 |
50+ | 511 | 44 | 444 | 31 | 226 | 22 | 303 | 23 | 358 | 30 | 236 | 21 | 265 | 26 | 362 | 29 | 307 | 27 | 141 | 12 | 367 | 36 | 206 | 19 | 3725 | 27 |
Female | 601 | 52 | 646 | 45 | 439 | 42 | 680 | 51 | 613 | 52 | 517 | 47 | 464 | 46 | 603 | 49 | 569 | 51 | 416 | 36 | 576 | 57 | 584 | 55 | 6708 | 48 |
Rural | 70 | 6 | 538 | 38 | 483 | 46 | 805 | 61 | 682 | 58 | 848 | 77 | 107 | 11 | 214 | 17 | 449 | 40 | 353 | 30% | 599 | 59% | 354 | 33 | 5501 | 40 |
Secondary or more education | 660 | 57 | 1023 | 72 | 720 | 69 | 545 | 41 | 648 | 55 | 385 | 35 | 638 | 64 | 784 | 63 | 455 | 41 | 946 | 81 | 205 | 20 | 953 | 89 | 7963 | 57 |
Good self-rated health status | 902 | 78 | 1061 | 75 | 894 | 85 | 800 | 61 | 710 | 60 | 760 | 69 | 833 | 83 | 956 | 77 | 658 | 59 | 1006 | 86 | 539 | 53 | 880 | 82 | 9998 | 72 |
Experience with the healthcare system | ||||||||||||||||||||||||||
No visits to the health system in the past year | 338 | 29 | 637 | 45 | 453 | 43 | 455 | 34 | 474 | 40 | 374 | 34 | 461 | 46 | 347 | 28 | 471 | 42 | 398 | 34 | 526 | 52 | 323 | 30 | 5256 | 38 |
N visits in the past year (mean/SD) | 3.1 | 3.2 | 2.1 | 2.8 | 1.8 | 2.4 | 3.6 | 3.6 | 2.5 | 3.0 | 2.5 | 3.0 | 1.8 | 2.4 | 3.0 | 3.1 | 2.7 | 3.3 | 2.4 | 2.7 | 2.0 | 3.0 | 2.9 | 3.2 | 2.6 | 3.1 |
Last visit was to a private facility | 409 | 50 | 238 | 30 | 271 | 46 | 492 | 57 | 509 | 72 | 300 | 41 | 342 | 63 | 328 | 37 | 266 | 41 | 428 | 56 | 235 | 48 | 219 | 29 | 4036 | 47 |
Has health insurance | 811 | 70 | 946 | 67 | 628 | 60 | 488 | 37 | 533 | 45 | 401 | 36 | 445 | 44 | 743 | 60 | 530 | 47 | 437 | 37 | 351 | 34 | 313 | 29 | 6625 | 48 |
Perceptions of the healthcare system | ||||||||||||||||||||||||||
Last visit was high quality | 698 | 86 | 462 | 59 | 543 | 91 | 549 | 63 | 471 | 67 | 527 | 72 | 409 | 75 | 612 | 69 | 320 | 49 | 658 | 86 | 399 | 81 | 599 | 80 | 6246 | 73 |
Ever experienced discrimination | 197 | 17 | 461 | 32 | 227 | 22 | 324 | 24 | 378 | 32 | 297 | 27 | 215 | 21 | 274 | 22 | 415 | 37 | 267 | 23 | 358 | 35 | 222 | 21 | 3635 | 26 |
High rating of poor quality | 607 | 53 | 672 | 47 | 533 | 51 | 723 | 55 | 645 | 55 | 386 | 35 | 551 | 55 | 610 | 49 | 458 | 41 | 604 | 52 | 518 | 51 | 513 | 48 | 6819 | 49 |
Very confident could receive effective care | 300 | 26 | 294 | 21 | 520 | 50 | 276 | 21 | 286 | 24 | 502 | 45 | 328 | 33 | 272 | 22 | 209 | 19 | 624 | 54 | 354 | 35 | 484 | 45 | 4449 | 32 |
Agrees system works pretty well | 339 | 29 | 379 | 27 | 238 | 23 | 368 | 28 | 488 | 41 | 308 | 28 | 370 | 37 | 298 | 24 | 289 | 26 | 353 | 30 | 293 | 29 | 377 | 35 | 4100 | 30 |
The denominator is all respondents who visited a healthcare facility in the past 12 months. See online supplementary appendix 1 for the full survey instrument.
Analyses were conducted with Stata V.14.2. This study (protocol number IRB17-0907) was determined exempt by the Harvard University Human Research Protection Program. A brief consent to participate began the online survey; potential respondents who consented were able to continue with the survey and those who declined could not. We used The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines for reporting cross-sectional studies (see online supplementary appendix 8 for the checklist).
Patients and public involvement
Patients were first involved in this study during data collection. The study is based on previous research showing poor patient experience with healthcare in LMICs.
Results
A total of 57 786 individuals engaged with the survey by answering the first question—‘what is your age and gender?’ We included 13 849 who completed the entire survey (24% completion rate); their characteristics using population sampling weights are described in table 1. For the full sample described in table 1, 48% of respondents were female and 40% lived in a rural area. The majority (57%) had a secondary education or higher. Over a third (38%) had not visited a health facility at least once in the past year; the mean number of visits was 3.1 in the past year. The percent with health insurance varied from 29% in South Africa to 72% in Indonesia. Many respondents did not recognise poor-quality care when it was described in a vignette; nearly half of respondents gave a high rating for the anchoring vignette describing poor-quality care. Experiencing discrimination was not uncommon among the respondents; across the countries, 26% of respondents reported ever experiencing discrimination in a healthcare visit ranging from 17% in Argentina to 37% in Morocco.
Figure 1 presents ratings of quality components for the most recent visit by respondents who reported facility use in the past year (8532 respondents). The demographic characteristics of this group are in online supplementary appendix 9. In most countries, a majority of respondents rated the overall quality of care as good, very good or excellent, ranging from 49% in Morocco to 91% in Ghana. Wait time and the time spent with the provider received the lowest ratings, with 57% and 67% of respondents, respectively, giving a high rating. The provider’s knowledge and level of respect they showed the respondent received the highest ratings, respectively, ranging from 54% to 85% and 52% to 90% across the countries. Because respondents were asked to rate the quality of a single visit across a variety of dimensions, quality ratings were found to be positively correlated with one another (online supplementary appendix 10).
Figure 2 shows the responses to the questions on confidence and endorsement of the health system among respondents who visited a health facility in the past year. Respondents in Ghana had the greatest confidence, with 80% of respondents indicating that they were very or somewhat confident they could receive effective treatment if they ‘become sick tomorrow’. Respondents in Morocco and India were the least confident; 45% were somewhat or very confident. The per cent of respondents that agreed with the statement ‘On the whole, the system works pretty well and only minor changes are necessary to make it work better’ ranged from 23% in China to 48% in Senegal. Across all countries, the greatest number of respondents agreed that major changes were needed. Respondents who had not visited a facility in the past year were slightly more likely to be very confident, while there was no significant difference in health system endorsement between recent visitors and non-visitors (online supplementary appendix 11).
The predictors of health system confidence and endorsement are shown in table 2. Controlling for sociodemographic characteristics, the respondent’s experience with the health system was strongly associated with their confidence and endorsement. Respondents who rated the overall quality of their last visit as good, very good or excellent had 4.48 times higher odds (95% CI 3.64 to 5.52) of stating they could get effective treatment when needed than those who rated the care as fair or poor, and 2.69 times higher odds (95% CI 2.33 to 3.11) of believing the system needed only minor changes. Health insurance was associated with 1.68 times higher odds (95% CI 1.49 to 1.90) of confidence and 1.34 times higher odds (95% CI 1.22 to 1.48) of endorsement. Experiencing discrimination was associated with lower odds of confidence and endorsement. Respondents who rated the anchoring vignette as good quality care had 2.08 and 1.43 times higher odds (95% CI 1.74 to 2.49, and 1.23 to 0.66) of being confident and endorsing the health system, respectively. Using a private facility and frequent (3+ in last year) visits to the health system were not associated with either outcome. The results were robust to lowering the threshold of confidence to somewhat or very confident; this sensitivity analysis is presented in online supplementary appendix 12.
Table 2.
Very confident could get effective care if needed | Agrees that the health system works pretty well and only needs minor changes | |
Adjusted OR (95% CI) | Adjusted OR (95% CI) | |
Experience with the health system | ||
Quality of last visit good, very good or excellent | 4.48 (3.64 to 5.52) | 2.69 (2.33 to 3.11) |
Ever experienced discrimination | 0.67(0.5 to 0.80) | 0.63 (0.53 to 0.76) |
3 or more visits to a health facility | 1.03 (0.97 to 1.10) | 1.03 (0.94 to 1.12) |
Has health insurance | 1.68 (1.49 to 1.90) | 1.34 (1.22 to 1.48) |
Last visit was to private facility | 1.00 (0.90 to 1.12) | 0.89 (0.80 to 1.00) |
Vignette rating of good or better | 2.08 (1.74 to 2.49) | 1.43 (1.23 to 1.66) |
Sociodemographic characteristics | ||
Female | 0.97 (0.87 to 1.07) | 0.90 (0.77 to 1.07) |
Age (18–29 ref) | ||
30–49 | 0.88 (0.78 to 0.99) | 0.82 (0.73 to 0.92) |
50+ | 1.16 (0.9 to 1.49) | 0.89 (0.79 to 1.00) |
Secondary or higher education | 1.09 (0.87 to 1.36) | 0.83 (0.66 to 1.04) |
Rural | 1.33 (1.06 to 1.65) | 0.99 (0.86 to 1.14) |
Good self-rated health | 1.74 (1.45 to 2.10) | 1.25 (1.10 to 1.41) |
Country (Senegal ref) | ||
Argentina | 0.86 (0.81 to 0.90) | 1.22 (1.18 to 1.26) |
China | 0.56 (0.53 to 0.59) | 1.71 (1.60 to 1.82) |
Ghana | 2.33 (2.20 to 2.47) | 1.25 (1.20 to 1.30) |
India | 1.07 (1.01 to 1.13) | 1.40 (1.34 to 1.46) |
Indonesia | 1.19 (1.12 to 1.25) | 2.51 (2.36 to 2.68) |
Kenya | 1.79 (1.70 to 1.89) | 1.60 (1.54 to 1.67) |
Lebanon | 1.24 (1.18 to 1.30) | 2.10 (2.00 to 2.20) |
Mexico | 0.63 (0.61 to 0.65) | 0.88 (0.85 to 0.91) |
Morocco | 0.66 (0.63 to 0.68) | 0.99 (0.94 to 1.05) |
Nigeria | 3.16 (3.05 to 3.27) | 1.38 (1.34 to 1.42) |
South Africa | 2.91 (2.76 to 3.08) | 1.76 (1.67 to 1.85) |
N | 8531 | 8530 |
Results are from multivariable logistic regressions and are in bold if p<0.001. Please see online supplementary appendix 1 for full survey instrument.
Discussion
Confidence in the health system—defined as the belief that people can get the healthcare they need if they ‘become very sick tomorrow’— was low in this sample of 13 849 internet users in 12 countries with only one-third of respondents expressing that they were very confident. Similarly, only 30% of respondents agreed with the statement ‘On the whole, the system works pretty well and only minor changes are necessary’ with the remainder calling for major reforms or complete rebuilding of the health system. Our results are consistent with prior research. For example, a study in China reported that 28% of respondents had ‘a great deal or complete trust’ in their health system.33
Overall, confidence in the health system was strongly associated with the respondent’s experience with the health system. Experiencing good, very good or excellent quality care during the last visit was associated with 4.48 times greater odds of being very confident in the health system in comparison with those who reported a fair or poor-quality visit. Independent of the quality rating, we found that having ever experienced discrimination during a healthcare encounter was associated with substantially lower confidence and endorsement. This illustrates the salience of respect and equitable treatment by the health system—an emerging theme in global health discourses.6 Neither quantity of visits nor the type of provider (public vs private) was associated with the study outcomes. Our finding that an individual’s experience in the health system is predictive of confidence in the system is consistent with studies from high-income countries and LMICs alike.33–35 Macinko and colleagues2 found that problems in the quality of received primary care services in Latin America were associated with worse perceptions of health system performance.2 A study of health system confidence in the UK found that perceptions of quality at the clinical visit level had a greater influence on confidence than perceptions of the quality of the system.34
Although experience with the health system is most predictive of confidence in our model, individual factors are also associated with the outcome. Good self-reported health substantially increased confidence in healthcare although it had a more modest effect on endorsement. This is consistent with previous findings on trust in healthcare.36 The higher confidence may come from the minimisation of future risk of illness by healthy people, from having been able to obtain good care in the past, or from a positive psychological outlook or a combination.36 37 People who gave high-quality ratings for the poor-quality anchoring vignette were twice as likely to be confident compared with those who rated quality as fair or poor. This is reasonable because receiving effective treatment may appear more feasible to respondents with low expectations of quality or limited experience with the clinical condition in the vignette.26 Somewhat surprisingly people in rural areas were more confident that they could get needed care, though the effect was small (AOR 1.33, 95% CI 1.06 to 1.65). Given the challenges of internet connectivity in rural areas, those residents with internet access in rural communities may have particularly high agency and have a better knowledge of and access to the best available healthcare resources. Education (secondary or higher) was not associated with either outcome, perhaps because this was overall a well-educated group. This sample is wealthier, more educated, younger and more likely to be male than the general populations in our survey countries. It is plausible that the overall population and socioeconomically disadvantaged groups, such as those without insurance and in worse health, may have lower confidence than our study sample.
Our study has several limitations. Though the technology we used for this survey has been shown to generate samples that are representative of the internet using public,20 internet surveys in countries with generally low internet penetration are not representative of the full population because internet users are likely to be male, wealthy, young and more urban than the general population.38 This is most problematic in several low-income countries in our sample with particularly low internet penetration, such as Indonesia (20.4% internet penetration rate), Senegal (23.4%), Ghana (28.4%) and India (34.8%). The remaining countries have penetration rates upward of 45%. Internet surveys are also known to have lower response rates and potentially lower respondent attention to questions than face-to-face surveys.39 However, our survey had a relatively high response rate for internet surveys.21 39 We addressed inattention by limiting the length of the questionnaire, varying location of questions on the screen and structuring the survey for ease of response. Using only an internet survey meant that we relied on respondent reporting of health and keeping the survey short meant that we could only include the most essential questions. For example, we asked about health insurance status to capture a respondent’s protection from catastrophic health expenditures, but could not also explicitly ask about out-of-pocket expenditures. To address recall bias, we limited respondent reporting of quality to visits that occurred during the last 12 months. The resulting subpopulation may report quality differently than the full sample. However, an analysis of our outcomes of interests between those who did and those who did not have a visit in the last 12 months showed only a slightly higher likelihood of reporting confidence among those who had not had a visit and no difference in endorsement. Finally, and as is common to multicountry studies, respondents from different countries are likely to define and understand terms and questions differently. In addition to carefully structuring questions with this in mind, translating, back-translating and piloting our instrument before collecting data, we included the country in our statistical models as well as vignettes designed to measure varying expectations of healthcare quality.
The study also has several strengths. We know of only two multicountry surveys outside of high-income countries that assess these outcomes.2 35 The World Health Surveys and Afrobarometer surveys ask fewer questions about health systems and, in the case of the World Health Surveys, the data are now 15 years old.4 40 Another strength is the use of an internet survey, which allowed for a rapid assessment of sentiment and cross-national comparison. Internet surveys are particularly well suited for exploring topics prone to social desirability and acquiescence biases, as health system ratings might be since respondents can submit opinions anonymously.41
This research demonstrates that there is a sizeable gap in confidence and endorsement of the health system among the internet using public in these 12 LMICs. Furthermore, internet users are a relatively elite subgroup in LMICs, suggesting that these results may underestimate low health system confidence. The findings are troubling for several reasons. First, HQSS argues that confidence in health systems is one of the three primary outcomes of a high-quality health system.1 By this measure, each of the study countries still needs to make substantial improvements to achieve high-quality care.
Second, the perceived quality of care received during healthcare visits is the strongest predictor of confidence in our models. The implication is that improving confidence will require the hard work of improving processes of care, both technical and interpersonal, a task which will only have large impacts and be sustainable if the foundations of a health system are strengthened.1 42 Four universal actions for improving health system quality are recommended by HQSS: transform the workforce, ignite demand, redesign service delivery, govern for quality. Though each country will have a different balance of challenges, system strengths and system weaknesses and thus will need a unique configuration of policies and interventions addressing these universal actions,43 44 all countries should prioritise and plan for improved quality of care in order to address low system confidence.
Finally, populations that do not have confidence in their health systems may impede progress towards ambitious new development goals, especially UHC. Without careful planning, lack of confidence in the public health system in countries working towards UHC may divert users to poorly regulated private options, exposing them to financial hardship.45 Achieving quality UHC will also require the support of citizens who believe that the health system is a worthwhile use of their contributions and public resources.46 47
Further research on population confidence in health systems is needed and especially important as LMICs try to garner public support and funding for UHC. In addition to understanding the state of confidence in populations, scholarship on the relationships between quality healthcare processes and confidence in systems as well as the relationship between confidence and health outcomes and economic benefits of high-quality care is needed. Research that highlights the perceptions and experiences of vulnerable populations, populations that are largely excluded from this internet-based study, will be essential as countries embark on UHC.
Conclusion
This study draws attention to a significant gap in population confidence in and endorsement of health systems in 12 LMICs. Respondents with poor-quality experiences during their last visit are more likely to lack confidence, suggesting that UHC and related efforts, such as the revitalisation of primary healthcare, should place high-quality and respectful care at their centre. Data on confidence and endorsement should be used to track the progress of health systems as they reform.
Footnotes
Handling editor: Eduardo Gómez
Twitter: @agage93, @mkruk
Contributors: The study was designed and implemented by MK, SR-D and AG. SR-D and AG wrote and prepared the first draft. All authors interpreted results, revised the manuscript and approved the final manuscript for submission.
Funding: This study was funded by the Bill & Melinda Gates Foundation.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Patient consent for publication: Not required.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement: Data are available in a public, open access repository. Data are available from https://dataverse.harvard.edu/.
References
- 1.Kruk ME, Gage AD, Arsenault C, et al. . High-quality health systems in the sustainable development goals era: time for a revolution. Lancet Glob Health 2018;6:e1196–252. 10.1016/S2214-109X(18)30386-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Macinko J, Guanais FC, Mullachery P, et al. . Gaps in primary care and health system performance in six Latin American and Caribbean countries. Health Aff 2016;35:1513–21. 10.1377/hlthaff.2015.1366 [DOI] [PubMed] [Google Scholar]
- 3.The Commonwealth Fund 2013 Commonwealth fund international health policy survey, 2013. [Google Scholar]
- 4.Rockers PC, Kruk ME, Laugesen MJ. Perceptions of the health system and public trust in government in low- and middle-income countries: evidence from the world health surveys. J Health Polit Policy Law 2012;37:405–37. 10.1215/03616878-1573076 [DOI] [PubMed] [Google Scholar]
- 5.Gilson L. Trust and the development of health care as a social institution. Soc Sci Med 2003;56:1453–68. 10.1016/S0277-9536(02)00142-9 [DOI] [PubMed] [Google Scholar]
- 6.World Health Organization WHO global strategy on people-centred and integrated health services: interim report; 2015.
- 7.World Health Organization, World Bank . Tracking universal health coverage: first global monitoring report. World Health Organization, World Bank, 2015. [Google Scholar]
- 8.Ozawa S, Sripad P. How do you measure trust in the health system? A systematic review of the literature. Soc Sci Med 2013;91:10–14. 10.1016/j.socscimed.2013.05.005 [DOI] [PubMed] [Google Scholar]
- 9.Russell S. Treatment-seeking behaviour in urban Sri Lanka: trusting the state, trusting private providers. Soc Sci Med 2005;61:1396–407. 10.1016/j.socscimed.2004.11.077 [DOI] [PubMed] [Google Scholar]
- 10.Hall MA, Zheng B, Dugan E, et al. . Measuring patients' trust in their primary care providers. Med Care Res Rev 2002;59:293–318. 10.1177/1077558702059003004 [DOI] [PubMed] [Google Scholar]
- 11.Rowe R, Calnan M. Trust relations in health care--the new agenda. Eur J Public Health 2006;16:4–6. 10.1093/eurpub/ckl004 [DOI] [PubMed] [Google Scholar]
- 12.Kruk ME, Myers M, Varpilah ST, et al. . What is a resilient health system? Lessons from Ebola. Lancet 2015;385:1910–2. 10.1016/S0140-6736(15)60755-3 [DOI] [PubMed] [Google Scholar]
- 13.Irving G, Neves AL, Dambha-Miller H, et al. . International variations in primary care physician consultation time: a systematic review of 67 countries. BMJ Open 2017;7:e017902. 10.1136/bmjopen-2017-017902 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Heerwegh D. Mode differences between face-to-face and web surveys: an experimental investigation of data quality and social desirability effects. Int J Public Opin Res 2009;21:111–21. 10.1093/ijpor/edn054 [DOI] [Google Scholar]
- 15.Internet live stats: world wide web Foundation, 2019. Available: https://www.internetlivestats.com/
- 16.Poushter J. Smartphone Ownership and Internet Usage Continues to Climb in Emerging Economies. Pew Research Center [Internet], 2018. Available: http://www.pewglobal.org/2016/02/22/smartphone-ownership-and-internet-usage-continues-to-climb-in-emerging-economies/
- 17.Seeman N, Ing A, Rizo C. Assessing and responding in real time to online anti-vaccine sentiment during a flu pandemic. Healthc Q 2010;13 Spec No:8–15. 10.12927/hcq.2010.21923 [DOI] [PubMed] [Google Scholar]
- 18.Seeman N, Tang S, Brown AD, et al. . World survey of mental illness stigma. J Affect Disord 2016;190:115–21. 10.1016/j.jad.2015.10.011 [DOI] [PubMed] [Google Scholar]
- 19.Rizo C, Deshpande A, Ing A, et al. . A rapid, web-based method for obtaining patient views on effects and side-effects of antidepressants. J Affect Disord 2011;130:290–3. 10.1016/j.jad.2010.07.027 [DOI] [PubMed] [Google Scholar]
- 20.ComScore Representativeness of the RIWI sampling methodology in the United States (internal report); 2014.
- 21.Schonlau M, Couper MP. Options for conducting web surveys. Statist Sci 2017;32:279–92. 10.1214/16-STS597 [DOI] [Google Scholar]
- 22.Erens B, Burkill S, Copas A, et al. . How well do volunteer web panel surveys measure sensitive behaviours in the general population, and can they be improved? A comparison with the third British National Survey of Sexual Attitudes & Lifestyles (Natsal-3). Lancet 2013;382:S34 10.1016/S0140-6736(13)62459-9 [DOI] [Google Scholar]
- 23.Toepoel V, Das M, van Soest A. Relating question type to panel conditioning: comparing trained and fresh Respondents. Surv Res Method 2009;3:73–80. [Google Scholar]
- 24.Murphy L, Pospichal L, Liebenson D, et al. . GRIT consumer participation in research report: a global study of habitual vs. Non-Habitual survey takers. New York, NY: Greenbook and RIWI, 2014. [Google Scholar]
- 25.Gilson L. Trust in health care: theoretical perspectives and research needs. J Health Organ Manag 2006;20:359–75. 10.1108/14777260610701768 [DOI] [PubMed] [Google Scholar]
- 26.Roder-DeWan S, Gage AD, Hirschhorn LR, et al. . Expectations of healthcare quality: a cross-sectional study of Internet users in 12 low- and middle-income countries. PLoS Med 2019;16:e1002879. 10.1371/journal.pmed.1002879 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Valentine N, Verdes-Tennant E, Bonsel G. Health systems' responsiveness and reporting behaviour: multilevel analysis of the influence of individual-level factors in 64 countries. Soc Sci Med 2015;138:152–60. 10.1016/j.socscimed.2015.04.022 [DOI] [PubMed] [Google Scholar]
- 28.Batbaatar E, Dorjdagva J, Luvsannyam A, et al. . Determinants of patient satisfaction: a systematic review. Perspect Public Health 2017;137:89–101. 10.1177/1757913916634136 [DOI] [PubMed] [Google Scholar]
- 29.Bleich SN, Özaltin E, Murray CKL. How does satisfaction with the health-care system relate to patient experience? Bull World Health Organ 2009;87:271–8. 10.2471/BLT.07.050401 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Murray CJ, Kawabata K, Valentine N. People's experience versus people's expectations. Health Aff 2001;20:21–4. 10.1377/hlthaff.20.3.21 [DOI] [PubMed] [Google Scholar]
- 31.Salomon JA, Tandon A, Murray CJL. Comparability of self rated health: cross sectional multi-country survey using anchoring vignettes. BMJ 2004;328:258. 10.1136/bmj.37963.691632.44 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.United States Census Bureau International database, 2017. [Google Scholar]
- 33.Zhao D, Zhao H, Cleary PD. Understanding the determinants of public trust in the health care system in China: an analysis of a cross-sectional survey. J Health Serv Res Policy 2019;24:37–43. 10.1177/1355819618799113 [DOI] [PubMed] [Google Scholar]
- 34.Calnan MW, Sanford E. Public trust in health care: the system or the doctor? Qual Saf Health Care 2004;13:92–7. 10.1136/qshc.2003.009001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Zhao D, Zhao H, Cleary PD. International variations in trust in health care systems. Int J Health Plann Manage 2019;34:130–9. 10.1002/hpm.2597 [DOI] [PubMed] [Google Scholar]
- 36.Mohseni M, Lindstrom M. Social capital, trust in the health-care system and self-rated health: the role of access to health care in a population-based study. Soc Sci Med 2007;64:1373–83. 10.1016/j.socscimed.2006.11.023 [DOI] [PubMed] [Google Scholar]
- 37.Svoronos T, Macauley RJ, Kruk ME. Can the health system deliver? Determinants of rural Liberians' confidence in health care. Health Policy Plan 2015;30:823–9. 10.1093/heapol/czu065 [DOI] [PubMed] [Google Scholar]
- 38.Couper MP, Miller PV. Web survey methods: introduction. Public Opin Q 2008;72:831–5. 10.1093/poq/nfn066 [DOI] [Google Scholar]
- 39.Manfreda KL, Bosnjak M, Berzelak J, et al. . Web surveys versus other survey modes: a meta-analysis comparing response rates. Int J Market Res 2008;50:79–104. 10.1177/147078530805000107 [DOI] [Google Scholar]
- 40.Afrobarometer Data. Afrobarometer, 2017. [Google Scholar]
- 41.Kreuter F, Presser S, Tourangeau R. Social desirability bias in cati, IVR, and web surveys. Public Opinion Q 2008;72:847–65. [Google Scholar]
- 42.World Health Organization. Bank W. Delivering Quality Health Services : A Global Imperative for Universal Health Coverage. Geneva: World Health Organization, 2018. [Google Scholar]
- 43.Olivier de Sardan J-P, Diarra A, Moha M. Travelling models and the challenge of pragmatic contexts and practical norms: the case of maternal health. Health Res Policy Syst 2017;15:60. 10.1186/s12961-017-0213-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Yamey G. Scaling up global health interventions: a proposed framework for success. PLoS Med 2011;8:e1001049. 10.1371/journal.pmed.1001049 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Nabyonga Orem J, Mugisha F, Kirunga C, et al. . Abolition of user fees: the Uganda paradox. Health Policy Plan 2011;26(Suppl 2):ii41–51. 10.1093/heapol/czr065 [DOI] [PubMed] [Google Scholar]
- 46.Kutzin J. Anything goes on the path to universal health coverage? No. Bull World Health Organ 2012;90:867–8. 10.2471/BLT.12.113654 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Sumriddetchkajorn K, Shimazaki K, Ono T, et al. . Universal health coverage and primary care, Thailand. Bull World Health Organ 2019;97:415–22. 10.2471/BLT.18.223693 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjgh-2019-002205supp001.pdf (732.9KB, pdf)