Skip to main content
Journal of the Royal Society of Medicine logoLink to Journal of the Royal Society of Medicine
. 2017 Sep 12;110(9):365–375. doi: 10.1177/0141076817724599

Comparative health system performance in six middle-income countries: cross-sectional analysis using World Health Organization study of global ageing and health

Riyadh Alshamsan 1,2,, John Tayu Lee 2,3, Sangeeta Rana 4,5, Hasan Areabi 1, Christopher Millett 2
PMCID: PMC5987910  PMID: 28895493

Abstract

Objective

To assess and compare health system performance across six middle-income countries that are strengthening their health systems in pursuit of universal health coverage.

Design

Cross-sectional analysis from the World Health Organization Study on global AGEing and adult health, collected between 2007 and 2010.

Setting

Six middle-income countries: China, Ghana, India, Mexico, Russia and South Africa.

Participants

Nationally representative sample of adults aged 50 years and older.

Main outcome measures

We present achievement against key indicators of health system performance across effectiveness, cost, access, patient-centredness and equity domains.

Results

We found areas of poor performance in prevention and management of chronic conditions, such as hypertension control and cancer screening coverage. We also found that cost remains a barrier to healthcare access in spite of insurance schemes. Finally, we found evidence of disparities across many indicators, particularly in the effectiveness and patient centredness domains.

Conclusions

These findings identify important focus areas for action and shared learning as these countries move towards achieving universal health coverage.

Keywords: Health policy, global health, public health

Introduction

Health systems strengthening and achieving universal health coverage in low- and middle-income countries are essential to confronting the major challenges faced today: addressing demographic and epidemiological transitions, improving population financial protection and meeting public demand for improved health outcomes.1 Many low- and middle-income countries have committed to achieving universal health coverage through increased health spending and other health systems strengthening measures.2

Assessment of health system performance is a key driver of improvement.3 It provides an important mechanism to identify areas of high and low performance, enabling efforts to strengthen and increase effectiveness of health systems to achieve universal health coverage, and it provides an important opportunity for benchmarking and cross-country learning. Although cross-country comparisons are often conducted between health systems in high-income countries,4 few studies have been undertaken that include and compare low- and middle-income countries, particularly looking across the domains of the healthcare system. One recent example adding to the evidence base on health system comparisons in low- and middle-income countries was the analysis of equity across three low- and middle-income countries conducted by Mills et al.5 that focused specifically on equity in financing and overall use of health services.

Despite growing enthusiasm for improving health systems in low- and middle-income countries inadequate information systems, lack of common definitions for performance indicators and an absence of standardised data collection mechanisms across countries resulted in limited performance comparability across low- and middle-income countries.6 This has been recognised as an important knowledge gap in the recent World Health Report on universal health coverage,7 which calls for continued efforts to improve measurement and monitoring of health systems progress. The World Health Organization Study on global AGEing and health (SAGE) began to address this gap by collecting a wide range of health system data on six middle-income countries: China, Ghana, India, Mexico, Russia and South Africa. The SAGE instrument has been validated and implemented similarly across the six countries.8

Actions towards universal health coverage have been taken in several of these countries in recent years, through major health system reforms and substantial increases in health spending (Tables 1 and 2). For example, Ghana introduced a national health insurance scheme in 2004 to provide financial protection to its citizens,5 and China embarked on systematic reforms in 2009 to improve its social insurance scheme and strengthen primary healthcare.9 We aim to use SAGE data to assess and compare health system performance across these six countries.

Table 1.

Macroeconomic indicators.

GDP per capita (constant 2010 US$)
Gini coefficienta
Human Development Indexa
World Bank income classification
2000 2014 2014 2000 2014 2000 2014
China 1771 6497 37.0 0.591 0.727 Lower middle income Upper middle income
Ghana 975 1696 42.8 0.487 0.579 Low income Lower middle income
India 770 1750 33.6 0.483 0.609 Low income Lower middle income
Mexico 8568 9510 48.1 0.699 0.756 Upper middle income Upper middle income
Russia 6491 11,038 39.7 0.717 0.798 Lower middle income Upper middle income
South Africa 6069 7593 65.0 0.628 0.666 Upper middle income Upper middle income

Source: The World Bank: http://data.worldbank.org/

a

Human development report: http://hdr.undp.org/en/countries.

Table 2.

Health statistics.

Life expectancy in 2014, years Total expenditure on health as % of GDP
Government expenditure on health as % of total government expenditure
Out-of-pocket health expenditure as % of total expenditure on health
2000 2014 2000 2014 2000 2014
China 76 4.6 5.5 10.9 10.4 59.0 32.0
Ghana 61 3.0 3.6 7.8 6.8 31.8 26.8
India 68 4.3 4.7 4.4 5.0 67.1 62.4
Mexico 77 5.1 6.3 10.5 11.6 50.9 44.0
Russia 70 5.4 7.1 12.7 9.5 30.0 45.8
South Africa 57 8.1 8.8 13.6 14.2 13.0 6.5

Source: The World Bank: http://data.worldbank.org/ and World Health Organization Global Health Observatory Data Repository: http://apps.who.int/gho/data/node.main

Methods

Sample and data

We analysed cross-sectional data from the World Health Organization SAGE (wave 1), collected between 2007 and 2010. The survey included data from nationally representative cohorts of adults aged 50 years and older, as well as smaller comparative cohorts of adults aged 18–49 years.

The SAGE collected a wide range of information on the health and wellbeing of the adult population in each country through the use of standardised survey instruments, including self-assessments of health and wellbeing and objective measures of health. The survey was administered through interviews and measurements of health markers, such as weight and blood pressure. SAGE used a multi-stage cluster sampling strategy. More details on the survey objectives are described elsewhere.10

Our analysis was conducted based on the sample of respondents aged 50 years and older, which included the majority of the study population. The only exceptions to this were analyses of breast and cervical cancer screening outcomes, where age ranges appropriate to each screening programme were used: women aged 50–74 years and 25–69 years, respectively.11

Framework for analysis and variables used

We assessed health system performance using the conceptual framework proposed by Arah et al.12 This framework was originally developed to evaluate a list of quality indicators for use within Organization for Economic Cooperation and Development countries and has been widely used for health system evaluation.6,13

Indicators

Indicator variables were constructed and categorised for four of the performance domains: effectiveness, cost, access and patient-centredness; equity was then assessed across each of these domains. As the SAGE does not include any measures pertaining to patient safety, we were unable to assess performance within this domain. A full list of variables assessed is included in online Appendix Table 1.

Effectiveness

We constructed 11 indicators relating to the prevention and management of common chronic conditions (Table 3). Respondents self-reported the management and prevention services for common chronic conditions that they received. The exception to this is in the case of hypertension, where respondents were considered to have hypertension if they self-reported a diagnosis of hypertension or if they had a mean systolic blood pressure measurement of ≥140 mmHg or diastolic blood pressure of ≥90 mmHg. Those respondents identified as having hypertension on measurement, but not self-reporting the condition, were defined as being undiagnosed hypertensive. Controlled hypertension was defined as those self-reporting the condition, having mean systolic blood pressure of ≤140 mmHg and diastolic blood pressure of ≤90 mmHg.

Table 3.

Effectiveness domain indicators in SAGE countries.

China India Ghana Mexico South Africa Russia
Undiagnosed hypertension (%) 56.0a 55.3 76.3aC 51.4 61.5 26.6C
Prescribed meds persons with known hypertension in the past 12 months (%) 37.7a 32.9a 18.9aC 38.6 33.1 69.3aC
Hypertension controlled (%) 20.1 50.1C 29.1C 17.8 27.4C 59.1C
Prescribed meds for diabetes in the past 12 months (%) 83.3 71.1 79.4 78.6 80.6 75.0
Special diet/weight control for diabetes (%) 67.7 58.4 66.4a 57.8 66.7 73.7
Prescribed meds for depression in the past 12 months (%) 37.3 27.3 43.8 19.6 64.2C 46.9
Breast screening coverage in the past three years (%) 19.2a 0.7C 1.7C 43.3aC 9.9aC 34.9C
Cervical screening coverage in the past three years (%) 27.1a 0.9aC 3.8C 62.3aC 28.1a 72.0
Eye examination in the past three years (%) 20.4a 26.7aC 18.4aC 50.9aC 34.7aC 75.6aC
Operation if have cataracts (%) 22.4 50.6aC 47.6C 49.3C 44.1C 26.5
Medications or treatment from a dentist in the past 12 months (%) 36.7 34.7 17.7C 29.8a 43.2C 75.8

C: significantly different from China (p < 0.05).

a

Affluent respondents fared better than deprived respondents.

To assess coverage of cancer screening, we used responses to the following questions: ‘When was the last time you had a mammography?’ and ‘When was the last time you had a pelvic examination?’ Respondents who answered positively were then asked: ‘The last time you had a pelvic examination, did you have a Pap smear test?’ Following commonly used guidelines for breast and cervical cancer screening in low- and middle-income countries, coverage of breast cancer screening was defined as the percentage of the eligible population (women aged 50–74 years) who had a mammography in the past three years, and coverage of cervical cancer screening was defined as the percentage of the eligible population (women aged 25–69 years) who had a pap smear in the past three years.11

Cost

Indicators included in the cost domain for outpatient and inpatient care were: (1) the percentage of respondents who reported that their last visit was free; (2) the median out-of-pocket spending amount for those who reported their last visit was not free; and (3) the proportion of out-of-pocket expenditures by type of service (healthcare provider fees, medicines, medical tests, transport or other). All spending data were adjusted for cost-of-living differences using purchasing power parities for 2010 and presented in US dollars (Table 4).

Table 4.

Healthcare costs domain indicators in SAGE countries.

China India Ghana Mexico South Africa Russia
Outpatient
The last outpatient visit was free (%) 8.3 6.2C 16.7C 54.3aC 75.4aC 61.4C
Median of out-of-pocket spendingb 22.4 13.8 7.6 32.6 28.0 31.6
Type of spending as a percentage of out-of-pocket expenditure
Provider fees 4.1 14.1C 10.3C 21.5C 53.0C 12.6C
Medicines 85.8 68.6aC 49.0aC 36.4C 14.7C 68.8
Test 7.2 5.1C 3.8C 15.4 1.5C 2.6C
Transport 1.9 9.5C 34.5C 26.6C 29.9C 15.4C
Other 1 2.7C 2.4C 0.1C 0.9 0.6
Inpatient
The last inpatient visit was free (%) 4.1 5.8 13.9 62.8C 81.2C 57.3C
The median of out-of-pocket spendingb 664.7 207.0 47.6 651.9 46.2 94.8
Type of spending as a percentage of out-of- pocket expenditure
Provider fees 13.2 15.3 18.5 62.8C 75.7C 11.5
Medicines 57.4 51.3C 18.1C 12.1C 1.0C 61.1a
Test 17 11.2C 7.2C 3.2C 1.6C 6.8C
Transport 3 11.3C 51.2C 19.9C 14.2C 13.9C
Other 9.4 10.8 5.0C 2.0C 7.4 6.6

C: significantly different from China (p < 0.05).

a

Affluent respondents fared better than deprived respondents.

b

For those who reported the last visit was not free.

Access

The access domain included: (1) the percentage of respondents who received healthcare the last time when it was needed; (2) the percentage of respondents who indicated that cost was a barrier to getting healthcare; (3) whether or not respondents received any outpatient or inpatient care last year; (4) the number of inpatient and outpatient facilities visited last year; and (5) the time taken to travel to an outpatient clinic or hospital (Table 5).

Table 5.

Healthcare access domain indicators in SAGE countries.

China India Ghana Mexico South Africa Russia
Received healthcare last time when needed 95.2a 98.0C 91.5C 99.1C 98.9 95.0C
Cost was a barrier to getting healthcare (%) 23.3a 34.8a 46.6C 40.4 0.4C 1.5C
Outpatient
Any outpatient visits in the past 12 months (%) 60.2a 87.4C 65.2aC 40.5C 61.9 67.2
Number of outpatient visits in the past 12 months 2.5a 2.9 1.7aC 2.1 3.1 2.2
How long it took you to get to the clinic (% > 1 h) 2.6a 9.1C 7.7C 5.7C 5.5C 3.6
Inpatient
Any hospital stays in the past three years (%) 22.2 14.5C 9.7C 13.6C 11.6aC 30.1C
Number of hospital stays in the past 12 months 0.14 0.12 0.09C 0.24 0.11a 0.21
How long it took you to get to the hospital (% > 1 h) 7 36.8aC 19.2C 27.0C 11.3C 5.5

C: significantly different from China (p < 0.05).

a

Affluent respondents fared better than deprived respondents.

Patient-centredness

The patient-centredness domain included indicators in the areas of perceived: (1) promptness of care; (2) being treated respectfully; (3) clarity of communication; (4) involvement in decision-making; (5) confidentiality; (6) choice of provider; (7) facility cleanliness; (8) overall satisfaction with care received; (9) health condition improvement following care; and (10) outcome or result of care as expected (Table 6).

Table 6.

Patient-centredness domain indicators in SAGE countries.

China India Ghana Mexico South Africa Russia
Outpatient
Prompt attention 73.1 69.9aC 67.3C 72.9 58.2aC 60.7C
Respect 74.3 72.7aC 76.5aC 79.1C 70.7aC 71.6
Clarity of communication 72.5 72.5a 71.6 76.9C 70.4a 69.2
Involvement in decision-making 71.6a 71.6a 67.9 74.8 66.4aC 66.1aC
Confidentiality 71.6a 71.6aC 75.2a 77.0 71.3a 68.9C
Choice of provider 73.5 72.9a 67.9C 76.5 69.1aC 68.7C
Facility cleanliness 72.4a 74.2aC 79.3aC 81.0C 75.1aC 68.5C
Satisfaction 73.7 72.4a 79.6C 78.5aC 76.4C 71.9
Condition improved 77.7 75.0aC 76.5 73.5C 74.4aC 70.0C
Outcome expectedb 90.5a 87.2C 86.1C 92.5 85.2C 88.8a
Inpatient
Prompt attention 71.9 69.7aC 67.5 76.9C 68.6a 63.8C
Respect 72.6 73.6a 77.5C 74.4 73.4a 71.6
Clarity of communication 69.6 73.0a 73.8 74.0 65.3a 66.7C
Involvement in decision-making 71.6a 72.0a 70.3 72.6 69.5a 61.8C
Confidentiality 70.7a 71.2a 77.6C 78.0C 74.1a 67.6C
Choice of provider 71.8 72.4a 67.4 77.9C 71.3a 67.7a
Facility cleanliness 71.6 75.3aC 82.2C 77.1C 75.3C 66.7aC
Satisfaction 71.7 74.4aC 81.7C 82.2C 76.2C 71.0a
Condition improved 80.6 76.8C 79.1 79.2 81.2 75.6C
Outcome expectedb 88.1 92.1 90.1 86.4 85.6 82.8a

Values are presented on a scale from 0 to 100, with 0 indicating the lowest response and 100 the highest.

C: significantly different from China (p < 0.05).

a

Affluent respondents fared better than deprived respondents.

b

Percentage out of 100.

Responses for these indicators were originally coded on five levels from 1 (best) to 5 (worst), with the exception of outcome expected, which was a binary indicator. We first reverse coded responses in the patient-centredness domain (apart from outcome expected) on a scale from 0 (worst) to 4 (best), and then scaled from 0 to 100, with 0 indicating the lowest response and 100 indicating the highest response.

Equity

Equity was assessed through evaluation of statistically significant differences in outcomes between the most affluent and the most deprived population within each country. This was evaluated for each indicator across all domains.

Statistical analysis

We first summarised the mean, median or proportion of achievement for each indicator as appropriate. To assess disparities for outcomes within countries, we ran regression models for each country separately, and identified any statistically significant differences in outcomes between the most affluent and the most deprived populations within each country. We used multiple logistic, ordinal logistic and linear regression models (for binary, ordinal and linear outcomes, respectively), adjusting for the following characteristics: age, gender, residence and wealth status. To compare differences in outcomes across countries, our model included dummy variables for each country using China as the reference group. We applied sample weights in all our analyses using the svyset command in Stata version 12. For country comparisons, we normalised country specific weights across the dataset.

Results

We included data from a total of 35,239 respondents across the six countries: 13,367 from China, 4724 from Ghana, 7150 from India, 2306 from Mexico, 3938 from Russia and 3754 from South Africa. The mean age of respondents ranged from 61 years old in India and South Africa to 64 years old in Ghana. The sex of respondents in the sample was approximately evenly divided in all countries apart from Russia, where the proportion of men surveyed was lower (38%). For full sample characteristics, see online Appendix Table 1.

Effectiveness domain

Performance achievement did not surpass 80% in any of the effectiveness indicators assessed across the six countries (Table 3). Performance varied widely across indicators, both across countries and within each country. For example, the percentage of respondents with undiagnosed hypertension ranged from 27% in Russia to 76% in Ghana. Among respondents with hypertension across the six countries, between 19% and 39% reported that they were prescribed blood pressure control medications, apart from Russia where the proportion was 69%.

The majority of respondents with diabetes reported having been prescribed medications to control their blood sugar level (over 70% in all countries). The majority also reported following a special diet for diabetes; 58% in India and Mexico, and over two-thirds in China, Ghana, South Africa and Russia.

There were large variations across countries in women’s breast and cervical cancer screening. The level of cervical cancer screening coverage ranged from 1% in India to 72% in Russia and breast cancer screening coverage ranged from a low of 1% and 2% in India and Ghana to a high of 43% in Mexico.

There were evident differences within each country’s performance across indicators, particularly in prescription of medication to those with known hypertension, eye examination, and breast and cervical cancer screening.

Cost domain

The percentage of inpatient and outpatient visits that were free of charge differed greatly, with less than 10% of respondents in China and India reporting that their last inpatient or outpatient healthcare visit was free (Table 4). For outpatient care, the highest proportion of spending reported in most countries was on medicines, with the exception of South Africa where providers accounted for the highest proportion of spending (50%).

For inpatient care, the highest proportion of out-of-pocket spending was spent on provider fees (Mexico and South Africa) or medicines (China, India and Russia). Spending on tests in the inpatient setting, as in the outpatient setting, was at similar levels across the six countries, accounting for less than 20% of spending.

Access domain

More than 90% of respondents reported receiving care when it was needed (Table 5); however, there were disparities in this indicator in China, with the most deprived populations in China less likely to report receiving healthcare whenever needed compared to affluent populations.

Respondents reporting that cost was a barrier to care ranged from low levels in South Africa and Russia (less than 2%) to higher levels in India (35%), Mexico (40%) and Ghana (47%).

The average number of outpatient visits in the past 12 months across countries ranged from 1.7 visits in Ghana to 3.1 visits in South Africa. The average number of inpatient stays in the past 12 months was similar across countries, ranging from 0.09 in Ghana to 0.24 in Mexico.

In the inpatient setting, respondents from India were most likely to report it took them more than an hour to reach the hospital. Only 5% and 7% of respondents from Russia and China reported it took them more than an hour to reach a hospital, compared to 37% in India. Similarly, in the outpatient setting, 9% of respondents from India reported it took them more than an hour to travel to clinic; this was higher than the proportion of respondents in the other five countries.

Patient-centredness domain

Scores for the patient-centredness indicators were similar across the six countries surveyed (Table 6). The lowest score ranges across the six countries were reported for inpatient involvement in decision-making (score range 62–73) and outpatient promptness of attention (score range 58–73). The highest range of scores reported across countries was for outcome as expected, both in the inpatient (score range 82–92) and outpatient (score range 86–93) settings.

In both the inpatient and outpatient settings, Mexico had the greatest proportion of high scores (highest score for six of 10 inpatient indicators and seven of 10 outpatient indicators). Russia lagged behind in achievement on most of the patient-centredness indicators.

There was a high degree of disparities across the patient-centredness indicators, particularly in India and South Africa. In India and South Africa, for the majority of indicators for both the inpatient and outpatient settings the most deprived populations reported lower scores compared to affluent populations. The number of indicators demonstrating within country differences in responses between affluent and deprived populations was lowest in Russia (six of 20 indicators) and Mexico (one indicator).

Discussion

Principal findings

Using a large, nationally representative dataset, this study presents a snapshot of health system performance across six middle-income countries, which together account for more than half of the world’s population. We found shortcomings in several indicators, particularly in the effectiveness, cost and equity domains. Many of these shortcomings are experienced by high-income countries as well; for example, cervical cancer screening rates continue to be low in many Organization for Economic Cooperation and Development countries.14

Across the six countries, for most indicators within the effectiveness domain performance against indicators did not surpass 80%. For instance, less than 38% of respondents from all countries surveyed, with the exception of Russia, had been prescribed hypertension medication in the past 12 months. Performance in key preventive interventions such as cervical screening was also strikingly low, particularly in India and Ghana. This is consistent with findings from other studies using household survey data.11,15 This low performance could be attributed to a variety of factors, including stigma, lack of knowledge about cancer screening programs, or lack of resources allocated to preventive programmes.1618

Reducing out-of-pocket payments can improve financial affordability of services, which is considered a core dimension of universal health coverage.19 Within the cost indicators, spending on medicines appeared to be a key factor in out-of-pocket spending across the countries surveyed. In all but one of the countries, the highest proportion of out-of-pocket spending for outpatient care was on medicines. This could negatively impact the management of chronic conditions that require medical treatment, such as hypertension.20 In Ghana for instance, only 19% of respondents with known hypertension were prescribed medications and almost half of the respondents experienced cost as a barrier to accessing healthcare. Barriers to affordability of secondary prevention medicines in India have been similarly documented elsewhere.21

We found that Russia lagged behind in almost all indicators in the patient centredness domain, behind even countries with lower GDP per capita such as Ghana. This is consistent with existing knowledge of user views of the Russian health system. A public opinion survey conducted in Russia in 2008, for example, found that more than 58% of respondents were not satisfied with the health system.22 Dissatisfaction with the health system could impact healthcare access and utilisation. Goeppel et al.,23 for example, found that individuals were less likely to seek care if they were not satisfied with their health system.

Differences indicating within country disparities were evident across many of the indicators assessed. In the effectiveness domain, all countries displayed disparities in responses for at least two of the 11 indicators. For example, in Ghana we found within country differences between poor and affluent groups having been prescribed medications for the control of hypertension, being on a special diet/weight control for diabetes control and having had an eye examination within the previous three years. Other national surveys conducted in Ghana have also found that richer households had better access to medicines for chronic conditions.20 In the cost domain, all countries apart from China displayed disparities in responses for one indicator within inpatient or outpatient care. In the healthcare access domain, China, India, Ghana and South Africa all displayed disparities in responses, with China displaying disparities for the highest number of indicators within the domain (four of eight indicators). Finally, in the patient-centredness domain, all countries displayed disparities in responses across the indicators, with the highest number of disparities in indicators displayed in India and the lowest number in Mexico.

Strengths and limitations

This is one of the few studies assessing health system performance broadly across multiple middle-income countries, using a standardised survey, and conducted in a similar time frame. However, this study faces similar challenges to other health system comparison studies, including the reliability, accuracy, and validity of indicators assessed, as many of the indicators assessed were based on self-reported data.

To ensure a comprehensive overview of the health system, it is essential to consider the indicators assessed here in conjunction with other indicators that are not captured in the SAGE data. Many key healthcare quality indicators, such as waiting times and operation outcomes were not included in the SAGE data. Further, our analyses did not take into consideration the extent to which differences in population expectations, norms and culture characteristics between countries may influence respondent ratings of performance.24 Finally, indicators presented within the access domain may also reflect utilisation of services rather than access alone.

In assessing health system performance, we used the Arah framework, which is frequently used to review the performance of high- and middle-income countries. For example, the Organization for Economic Cooperation and Development ‘Health at a Glance’ report uses this framework to assess health systems, including for SAGE countries such as India.25 The framework acknowledges that the health system is one determinant of health and other tiers in the model can be used to compare performance across countries; this likewise requires standardised data collected with similar methodology across countries, such as the SAGE data.26

We focused in this study on health system performance using data for adults aged 50 years and older, reflecting the challenges faced across middle-income countries in addressing the health needs of aging populations and non-communicable and chronic care needs. However, continued assessment of health systems will require multiple data sources and comparisons across the life-course, and health system performance in early life may impact the needs of adults later in life; however, we did not explore such an effect in our study. A study using the SAGE and climate research data from India found that exposure to climate shocks in early life was associated with higher risk in adults of developing hypertension later in their life.27

It is also worth noting that the six countries studied here are at different stages of economic development, and in their sociodemographic and epidemiological pictures. Therefore, caution must be applied in directly attributing the comparative findings for a specific indicator to specific policies in the respective country. As the countries assessed were classed as middle-income countries as of 2010, the findings may be less directly applicable to countries in different stages of economic development.

Nevertheless, the results of our study highlight potential issues and focus areas for continued investigation across low- and middle-income countries, to explore why some areas of the health system perform better in certain countries than others, and make this knowledge available to inform policy and action. Data used in this study have been collected between 2007 and 2010. With the collection of the next wave of SAGE data currently underway, an assessment of the comparative performance of the six health systems for which survey data are currently available provides a useful dashboard of performance within and between countries.

Implication for policy-makers

With many countries around the world embarking on health system reforms to achieve universal health coverage, it is vital that health system performance assessment continues to be an integral part of health system strengthening.3 Concerted efforts are needed to collect data on a wide array of indicators. One example of such an effort is the Primary Health Care Performance Initiative that brings together a consortium of policy-makers and health system managers to develop better measurement tools to drive improvement in primary healthcare systems.28

Conclusion

Health system performance comparison should be conducted using comparable frameworks, tools and metrics in countries with similar socioeconomic, demographic and epidemiological profiles, enabling results to be used for policy action and continuous shared learning.29,30 Assessment of health system is multidimensional, and multiple sources are needed to provide a comprehensive picture of health system performance.26

Our findings suggest common problems and areas for focus across middle-income countries, as well as health system performance challenges that are unique to particular countries. India and Ghana are facing particular challenges in achieving high coverage of preventative measures such as cervical screening. Improving service coverage for low-income populations within India and Ghana may improve outcomes while also reducing inequalities.31 To achieve better health outcomes at a lower cost, interventions that are feasible and cost-effective should also be prioritised for action.32

Supplementary Material

Supplementary material
Supplementary_Tables.pdf (341.7KB, pdf)

Declarations

Competing Interests

None declared.

Funding

CM is funded by an NIHR Research Professorship award and his work in India is supported by a Wellcome Trust Capacity Strengthening Strategic Award. The funding sources had no role in the design of the study, analysis, interpretation of the results or writing of the manuscript. SAGE is supported by World Health Organization, the US National Institute on Aging (NIA) through Interagency Agreements (OGHA 04034785; YA1323-08-CN-0020; Y1-AG-1005-01) and Grants (R01-AG034479; R21-AG034263-0182), and with financial or in-kind support from governments and/or instituting agencies in each participating country.

Ethics approval

The SAGE study received human subjects testing and ethics council approval from research review boards local to each participating site, and from the World Health Organization Ethical Review Committee, as detailed elsewhere. Informed consent was obtained from each respondent before interview and examination.

Guarantor

RA.

Contributorship

CM and RA conceived the paper. RA and JTL performed the data analysis, RA and JTL wrote the first draft. All authors contributed to the revision of subsequent drafts.

Acknowledgements

This article uses data from the World Health Organization Study on Global Ageing and Adult Health (SAGE) Wave 1 version 1∙1∙0.

Provenance

Not commissioned; peer-reviewed by Bruce Currey and Ali Shukor.

References

  • 1.Samb B, Desai N, Nishtar S, Mendis S, Bekedam H, Wright A, et al. Prevention and management of chronic disease: a litmus test for health-systems strengthening in low-income and middle-income countries. Lancet 2010; 376: 1785–1797. [DOI] [PubMed] [Google Scholar]
  • 2.United Nations Department of Economic and Social Affairs. Transforming our world: the 2030 Agenda for Sustainable Development: Sustainable Development Knowledge Platform. See https://sustainabledevelopment.un.org/post2015/transformingourworld (last checked 18 July 2017).
  • 3.Berman P and Bitran R. Health systems analysis for better health system strengthening. Report No.: 65927, May 2011. USA: The World Bank, pp.1–68.
  • 4.Osborn R, Moulds D, Squires D, Doty MM, Anderson C. International survey of older adults finds shortcomings in access, coordination, and patient-centered care. Health Aff (Millwood) 2014; 33: 2247–2255. [DOI] [PubMed] [Google Scholar]
  • 5.Mills A, Ataguba JE, Akazili J, Borghi J, Garshong B, Makawia S, et al. Equity in financing and use of health care in Ghana, South Africa, and Tanzania: implications for paths to universal coverage. Lancet 2012; 380: 126–133. [DOI] [PubMed] [Google Scholar]
  • 6.Papanicolas I, Kringos D, Klazinga NS, Smith PC. Health system performance comparison: new directions in research and policy. Health Policy 2013; 112: 1–3. [DOI] [PubMed] [Google Scholar]
  • 7.World Health Organization. Research for Universal Health Coverage: World Health Report 2013 2013, Geneva: World Health Organization; p.168. [Google Scholar]
  • 8.Basu S, Millett C. Social epidemiology of hypertension in middle-income countries determinants of prevalence, diagnosis, treatment, and control in the WHO SAGE study. Hypertension 2013; 62: 18–26. [DOI] [PubMed] [Google Scholar]
  • 9.Yip WC-M, Hsiao WC, Chen W, Hu S, Ma J, Maynard A. Early appraisal of China’s huge and complex health-care reforms. Lancet 2012; 379: 833–842. [DOI] [PubMed] [Google Scholar]
  • 10.Kowal P, Chatterji S, Naidoo N, Biritwum R, Fan W, Ridaura RL, et al. Data resource profile: the World Health Organization Study on global AGEing and adult health (SAGE). Int J Epidemiol 2012; 41: 1639–1649. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Akinyemiju TF. Socio-economic and health access determinants of breast and cervical cancer screening in low-income countries: analysis of the World Health Survey. PloS One 2012; 7: e48834–e48834. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Arah OA, Westert GP, Hurst J, Klazinga NS. A conceptual framework for the OECD Health Care Quality Indicators Project. Int J Qual Health Care 2006; 18: 5–13. [DOI] [PubMed] [Google Scholar]
  • 13.Rotar AM, van den Berg MJ, Kringos DS, Klazinga NS. Reporting and use of the OECD Health Care Quality Indicators at national and regional level in 15 countries. Int J Qual Health Care 2016; 28: 398–404. [DOI] [PubMed] [Google Scholar]
  • 14.Squires D. Multinational comparisons of health systems data, 2013, 2014. See www.commonwealthfund.org/publications/chartbooks/2014/multinational-comparisons (last checked 18 July 2017).
  • 15.Olson B, Gribble B, Dias J, Curryer C, Vo K, Kowal P, et al. Cervical cancer screening programs and guidelines in low- and middle-income countries. Int J Gynecol Obstet 2016; 134: 239–246. [DOI] [PubMed] [Google Scholar]
  • 16.Goss PE, Strasser-Weippl K, Lee-Bychkovsky BL, Fan L, Li J, Chavarri-Guerra Y, et al. Challenges to effective cancer control in China, India, and Russia. Lancet Oncol 2014; 15: 489–538. [DOI] [PubMed] [Google Scholar]
  • 17.Shetty P. India faces growing breast cancer epidemic. Lancet 2012; 379: 992–993. [DOI] [PubMed] [Google Scholar]
  • 18.Opoku SY, Benwell M, Yarney J. Knowledge, attitudes, beliefs, behaviour and breast cancer screening practices in Ghana, West Africa. Pan Afr Med J 2012; 11: 28–28. [PMC free article] [PubMed] [Google Scholar]
  • 19.Evans DB, Hsu J, Boerma T. Universal health coverage and universal access. Bull World Health Organ 2013; 91: 546–546A. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Vialle-Valentin CE, Serumaga B, Wagner AK, Ross-Degnan D. Evidence on access to medicines for chronic diseases from household surveys in five low- and middle-income countries. Health Policy Plan 2015; 30: 1044–1052. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Khatib R, McKee M, Shannon H, Chow C, Rangarajan S, Teo K, et al. Availability and affordability of cardiovascular disease medicines and their effect on use in high-income, middle-income, and low-income countries: an analysis of the PURE study data. Lancet 2016; 387: 61–69. [DOI] [PubMed] [Google Scholar]
  • 22.Popovich L, Potapchik E, Shishkin S, Richardson E, Vacroux A, Mathivet B. Russian Federation. Health system review. Health Syst Transit 2011; 13: 1–190. xiii–xiv. [PubMed] [Google Scholar]
  • 23.Goeppel C, Frenz P, Grabenhenrich L, Keil T, Tinnemann P. Assessment of universal health coverage for adults aged 50 years or older with chronic illness in six middle-income countries. Bull World Health Organ 2016; 94: 276–85C. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Rice N, Robone S, Smith PC. Vignettes and health systems responsiveness in cross-country comparative analyses. J R Stat Soc Ser A Stat Soc 2012; 175: 337–369. [Google Scholar]
  • 25.Health at a Glance 2015. OECD indicators – en – OECD. See www.oecd.org/health/health-systems/health-at-a-glance-19991312.htm (last checked 18 July 2017).
  • 26.Papanicolas I and Smith P, eds. Health System Performance Comparison: An Agenda for Policy, Information and Research. London, UK: Open University Press, 2013.
  • 27.Ho JY. Early-life environmental exposures and height, hypertension, and cardiovascular risk factors among older adults in India. Biodemography Soc Biol 2015; 61: 121–146. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Primary Health Care Performance Initiative. See http://phcperformanceinitiative.org/about-us/about-phcpi (last checked 18 July 2017).
  • 29.Hosseinpoor AR, Bergen N, Koller T, Prasad A, Schlotheuber A, Valentine N, et al. Equity-oriented monitoring in the context of universal health coverage. PLOS Med 2014; 11: e1001727–e1001727. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Wagstaff A, Dmytraczenko T, Almeida G, Buisman L, Eozenou PH-V, Bredenkamp C, et al. Assessing Latin America’s progress toward achieving universal health coverage. Health Aff (Millwood) 2015; 34: 1704–1712. [DOI] [PubMed] [Google Scholar]
  • 31.Lee JT, Huang Z, Basu S, Millett C. The inverse equity hypothesis: does it apply to coverage of cancer screening in middle-income countries? J Epidemiol Community Health 2015; 69: 149–155. [DOI] [PubMed] [Google Scholar]
  • 32.Wagstaff A, Cotlear D, Eozenou PH-V and Buisman LR. Measuring progress towards universal health coverage: with an application to 24 developing countries. Oxf Rev Econ Policy 2016; 32: 147–189.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary material
Supplementary_Tables.pdf (341.7KB, pdf)

Articles from Journal of the Royal Society of Medicine are provided here courtesy of Royal Society of Medicine Press

RESOURCES