Skip to main content
BMJ Open logoLink to BMJ Open
. 2020 Sep 6;10(9):e037079. doi: 10.1136/bmjopen-2020-037079

Critical review of multimorbidity outcome measures suitable for low-income and middle-income country settings: perspectives from the Global Alliance for Chronic Diseases (GACD) researchers

John R Hurst 1,, Gina Agarwal 2, Job F M van Boven 3, Meena Daivadanam 4,5,6,7,8, Gillian Sandra Gould 9,10, Erick Wan-Chun Huang 11,12, Pallab K Maulik 13,14,15, J Jaime Miranda 16, M O Owolabi 17, Shahirose Sadrudin Premji 18, Joan B Soriano 19,20,21, Rajesh Vedanthan 22, Lijing Yan 23, Naomi Levitt 24; on behalf of the GACD Multi-Morbidity Working Group
PMCID: PMC7478040  PMID: 32895277

Abstract

Objectives

There is growing recognition around the importance of multimorbidity in low-income and middle-income country (LMIC) settings, and specifically the need for pragmatic intervention studies to reduce the risk of developing multimorbidity, and of mitigating the complications and progression of multimorbidity in LMICs. One of many challenges in completing such research has been the selection of appropriate outcomes measures. A 2018 Delphi exercise to develop a core-outcome set for multimorbidity research did not specifically address the challenges of multimorbidity in LMICs where the global burden is greatest, patterns of disease often differ and health systems are frequently fragmented. We, therefore, aimed to summarise and critically review outcome measures suitable for studies investigating mitigation of multimorbidity in LMIC settings.

Setting

LMIC.

Participants

People with multimorbidity.

Outcome measures

Identification of all outcome measures.

Results

We present a critical review of outcome measures across eight domains: mortality, quality of life, function, health economics, healthcare access and utilisation, treatment burden, measures of ‘Healthy Living’ and self-efficacy and social functioning.

Conclusions

Studies in multimorbidity are necessarily diverse and thus different outcome measures will be appropriate for different study designs. Presenting the diversity of outcome measures across domains should provide a useful summary for researchers, encourage the use of multiple domains in multimorbidity research, and provoke debate and progress in the field.

Keywords: primary care, public health, statistics & research methods, clinical trials


Strengths and limitations of this study.

  • There is no existing review of outcome measures suitable for use in studies to mitigate multimorbidity in low-income and middle-income country (LMIC) settings.

  • The article is the written by the Global Alliance for Chronic Diseases researchers.

  • It is not a systematic review.

  • Further work is required to develop a core-outcome set for use in LMIC.

Introduction

There is growing recognition around the importance of multimorbidity in low-income and middle-income countries (LMICs).1 Multimorbidity, as defined by the UK Academy of Medical Sciences (AMS), refers to ‘the coexistence of two or more chronic conditions, each of which is either a physical non-communicable disease (NCD) of long duration, a mental health condition of long duration or an infectious disease of long duration’.1 The AMS report highlights the challenges in delivering multimorbidity research,2 including the selection of appropriate outcome measures. In 2018, Smith completed a Delphi exercise to develop a core-outcomes set for multimorbidity research (COSmm).3 The highest scoring outcomes were health-related quality of life, mental health outcomes and mortality. While ground-breaking, this process did not specifically target the challenges of multimorbidity in LMICs where the global burden is greatest, patterns of disease often differ and health systems are frequently fragmented.

The Global Alliance for Chronic Diseases (GACD) is an alliance of health research funders, whose research teams form a network of multidisciplinary researchers from both LMICs and high-income countries (HICs). We aim to reduce the impact of NCDs through a focus on implementation science research in LMICs, and high-priority populations in HICs. Recognising synergies across our disease-specific programmes, in 2017, we formed a Multimorbidity Working Group and published a GACD Researchers’ Statement concluding that ‘a greater focus on multimorbidity is overdue and necessary to successfully improve global health outcomes, thus acknowledging the specific challenge of multimorbidity in the LMIC context.4 The statement went on to propose three strategic objectives, one of which was to change the way research is commissioned, funded and delivered when considering NCDs in LMICs.

Discussion with research funders subsequently highlighted that one barrier to funding research addressing multimorbidity in LMICs was a perceived lack of robust outcome measures. We have, therefore, developed this GACD Researchers’ perspective on outcome measures suitable for studies of multimorbidity in LMICs, taking into account the challenges of (routine) data collection and patient–provider factors such as differences in interpreting social constructs and health literacy. The intent is to build on the COSmm work.3 Derived from a common base of expertise in NCD implementation research in LMICs, we present a diversity of potential measures that can accommodate different aspects of impact in LMICs, ranging from individual-level outcomes to health service and health system effects. This is not an attempt to provide a core outcome measures set. Rather, together, the potential outcome measures inform different evaluations of effectiveness and/or process for multimorbidity. We present these as a useful resource for those designing and reviewing intervention studies for multimorbidity in LMIC settings, and hope this initiative may promote harmonisation across studies that will be essential to better map the impact of multimorbidity in LMIC settings.

Method

Potential outcome measures suitable for studies of multimorbidity in LMICs were collected through a survey among the GACD multimorbidity working group, and distilled by the writing committee (the Authors) into categories through consensus discussion. All GACD researchers were invited to take part in the multimorbidity working group and those expressing interest were then invited to provide suggestions for suitable outcome measures via free-text e-mail to the group leads. In total, 31 group members participated (listed as the Authors and Contributors), with representation from all WHO Regions except the Eastern Mediterranean. GACD researchers have considerable collective experience conducting implementation science trials in LMIC settings. All measures had to be suitable for use in multimorbidity intervention studies in LMIC, either at the individual or the population level, and from an implementation science perspective. Criteria for suitability included ease of measurement (such as availability of data, ease of data collection, availability of local translations and cost), generalisability (applicability of the proposed outcome across diverse populations within and between LMIC settings) and statistical considerations (the feasibility of demonstrating a clinically significant change with conventional statistical significance). Each outcome approach is fully described below. The initial synthesis was reviewed by members of the GACD Multimorbidity Working Group for additional comments and suggestions (the Contributors). The resulting narrative review summarises the group’s collective thoughts within each domain of outcome measures studied.

Patient and public involvement

Patients or the public were not involved in the design, conduct, reporting or dissemination plans of our research.

Outcome measures for multimorbidity interventions in LMIC

Mortality

Death is the final common outcome for all individuals. Thus (premature) mortality is the most broadly applicable, generalisable and comparable outcome for multimorbidity research. Indeed, mortality was considered as an ‘essential’ core outcome measure for multimorbidity research according to the COSmm consensus.3

However, precisely because mortality is so broadly applicable, it suffers from a lack of specificity. While cause-specific mortality is a potential solution to the issue of specificity, this approach moves away from the goal of multimorbidity-based outcome consideration. In addition, mortality does not reflect the quality of life that an individual experiences during the time of survival; particularly in the context of multimorbidity, both disability and quality of life considerations are important in terms of an individual’s experience of illness, wellness and life. Indeed, death is not always the most important outcome from a patient-centred perspective, as has been demonstrated in studies assessing patient preferences of different potential health outcomes5–7 and conceptualised as disability-adjusted life years.

Practical challenges with mortality as an outcome measure include statistical power and sample size for an outcome that is relatively rare compared with other outcomes and proxies, potentially requiring much longer follow-up periods, except for older and/or more severely affected populations. It is, however, generally easy to measure and while the primary cause may be ascertained through techniques such as verbal autopsy (2016 WHO VA standard),8 assessing the contribution of multimorbidity at verbal autopsy is more challenging. While misclassifying the cause of death can impact the effect size for cause-specific mortality, power will be preserved for all-cause mortality. In some LMICs, ascertainment of deaths remains difficult due to the lack of mature vital registry systems and cultural traditions promoting deaths at home with delay in reporting.

Thus, mortality as an outcome for multimorbidity research has been infrequently used, particularly in the context of LMIC settings.9–11 Demographic surveillance sites that have a long record of verbal autopsy could, however, provide a useful data reservoir to examine associations between multimorbidity and mortality.

Generic quality of life scales

Health-related quality of life (HRQoL) instruments measure multidimensional well-being and functioning. Such scales may be generic such as EQ-5D and 36-item Short Form Survey (SF-36), or disease (/area) specific. While disease-specific measures may have better content and face validity as well as better responsiveness and sensitivity to change compared with generic measures, generic measures are (by definition) not disease specific and likely better for comparison of HRQoL among different diseases and for diseases in combination, an important consideration for multimorbidity research. Tools to assess the related construct of self-reported well-being have been reviewed and summarised elsewhere.12

Among generic tools, the COSmm consensus3 ranked the EQ-5D, SF-36 and 12-item Short Form Survey (SF-12), and Global quality of life (WHOQOL-BREF) most highly.

The EQ-5D13 has been widely used since introduction in the 1990s, facilitating health economic analysis (see below). It is designed to be completed by the participant and is available in multiple languages and thus widely applicable. The EQ-5D questionnaire has two components (health state description and evaluation). In the health state description, health status is measured across five dimensions: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. In the evaluation section, the respondents evaluate their overall health status using a Visual Analogue Scale.

The SF-3614 has 36 questions across eight domains: vitality, physical functioning, bodily pain, general health perceptions, physical role functioning, emotional role functioning, social role functioning and mental health.

The WHOQOL-BREF15 is an abbreviated version of the WHOQOL-100 quality of life assessment, originally developed by the WHOQOL Group working across fifteen international field centres to develop a quality of life assessment applicable across multiple settings.

HRQoL tools have a number of advantages over mortality as an outcome, being amenable to changes in the short term. HRQoL outcomes are particularly meaningful as the aim of clinical treatment and management is generally optimising quality of life. Consequently, managing multimorbidity needs to take quality of life into account both as an outcome marker, but also an input factor into formulating clinical management. Practical considerations in LMIC include the availability of valid translations in local languages (these are more often available for the more commonly used tools, in the more commonly used languages, but coverage remains incomplete), and the challenges of use in populations with low literacy or understanding of Visual Analogue Scales. Other unanswered questions include whether thresholds for minimum clinically important difference (MCIDs) on these scales should be altered in the context of multimorbidity. Notably, some common NCDs such as hypertension are not generally associated with significant symptom burden.

Multidimensional indices of function

The AMS1 recommended that reports of multimorbidity should provide details of functional deficits or disabilities and frailty. In both instances, the recommendation was made that this should be coded using a standardised classification scheme. For the former, the WHO Disability Assessment Schedule 2.0 (WHODAS 2.0) or the International Classification of Functioning, Disability and Health were suggested. For the latter, the cumulative deficit model of frailty or Fried’s phenotype model was recommended (see below).

WHO Disability Assessment Schedule

The WHODAS 2.0 has been widely used in epidemiological and observational studies in LMICs. It is a self-administered 12-item questionnaire that assesses six different adult life tasks over the preceding month. The specific areas covered are: (1) understanding and communication; (2) self-care; (3) mobility; (4) interpersonal relationships; (5) work and household roles and (6) community and civic roles. WHODAS has been included as a secondary outcome measure in three multimorbidity trials in LMIC (currently unreported16 17).

Frailty assessment instruments

There are many methods to assess frailty including the Fried Index, the Frailty Index and the British Frailty Index. While these have been used to examine the prevalence, correlates or outcomes of frailty in LMIC, further validation is still required in these settings.18 Of the various metrics, the Fried Index19 has been the most commonly used in LMIC. This index measures frailty by the presence of three or more of five physical deficits—exhaustion, weakness, slowness, low levels of activity and weight loss. Three of the items are collected using questionnaires, but slowness is assessed using a walking test and weakness by assessing grip strength. The Frailty Index has also been commonly used in LMICs and uses the presence or absence of medical conditions or poor performance on functional tasks to assess the number of deficits present and thus frailty.18 Using frailty as an outcome measure for intervention studies in patients with multimorbidity in LMIC may be limited by factors such as a lack of equipment (eg, to measure grip strength), and the question remains as to how susceptible to change such measurements are, and what an MCID might be. Despite this, frailty instruments remain an important outcome in LMIC settings given that frailty may be a confounding factor in self-care, treatment adherence and family burden.

Assessment of physical functioning

Physical functioning measures are commonly studied outcomes. The most frequently used indices include activities of daily living (ADL) (such as eating, dressing and toileting), instrumental activities of daily living (such as shopping and answering phone calls) and the Barthel Index (self-reported outcomes on degree of assistance needed for mobility, self-care and continence). Smith et al 3 described ADL, physical function and physical activity as core outcomes in multimorbidity interventions. For ADL the following measures received greatest support: Frenchay Activities Index, Nottingham Extended Activities of Daily Living and the Instructions for Activities of Daily Living questionnair, but these have not been evaluated in the context of LMICs.

The modified Rankin Scale is an example of a disease-specific (in this case, stroke) composite outcome measure including rating of functioning from no interference with daily life, through various degrees of disability to death. These outcomes are relatively easy to assess and have particular relevance in LMICs as people generally express strong desires in maintaining physical functioning including their ability to work, avoiding financial consequences and burden on family caregiving.

Health economic implications

The AMS report1 highlighted the economic burden of multimorbidity in LMICs and thus health economic implications are relevant in any consideration of multimorbidity outcome measures. However, most economic data on multimorbidity were gathered in HICs and the question arises as to whether measurement instruments, data and outcomes commonly used to assess cost implications of multimorbidity in HICs are applicable to LMIC settings.

One of the most common economic evaluations of healthcare interventions makes use of a technique called cost-effectiveness analysis and specifically the incremental cost-effectiveness ratio (ICER).20 The method to calculate the ICER is not disease specific, making it just as suitable to assess multimorbidity interventions as single disease interventions. However, it requires specific attention to the definitions and collection of costs and effect data in LMICs. Within this ratio, costs and effects can be defined, measured and calculated in different ways, of which some are more suitable in economic assessment of multimorbidity interventions in LMICs than others. Interpretation of the ratio may differ in different settings.

In healthcare, interventions can impact different types of direct and indirect costs within and outside healthcare systems. The different costs to be included in cost-effectiveness analysis depends on the perspective that is taken (eg, the healthcare payer, the society, the patient or the family). Costs that directly result from the intervention and which occur within healthcare systems should be included when a healthcare payer perspective is taken. However, in LMICs that lack universal health coverage, the perspective of the patient and family may be more relevant and a key focus could be on out-of-pocket costs. Examples of indirect costs are work productivity losses and these costs are especially relevant when a patient or societal perspective is taken.

In health economic studies, the effect of intervention uses a measure that is independent of a specific disease: the quality-adjusted life year (QALY). The QALY is a combination of utility (preferably measured using the EQ-5D) and survival. With the EQ-5D, certain health states are defined, to which a specific utility is assigned. Utility is the value a society gives to a specified health state and for each country a specific algorithm should be estimated from large general population samples. In many LMIC settings, these still need to be further developed to allow for generalisable models of effectiveness.

While most HICs have defined guidelines and make use of fixed thresholds or ranges to assess whether a certain ICER is considered cost-effective, such guidelines and thresholds are generally lacking in LMICs. This complicates the interpretation of cost-effectiveness analyses in LMICs. As a general rule, WHO defines an intervention that costs less than three times the gross domestic product per capita as cost-effective.21 It is important to note that the implications of economic analyses discussed here are not challenges specific to multimorbidity, but are nonetheless suitable for the study of multimorbidity.

Healthcare access and utilisation

Multimorbidity is associated with repeated care seeking, often at different providers. This not only results in multiple interactions with healthcare settings through outpatient and inpatient admissions but also involves paramedical services and practitioners of traditional medicine.

Although we identified no study that has specifically looked at generating or testing multimorbidity related healthcare access indices in LMICs, the WHO Study on Global Ageing and Adult Health which focused on LMICs tracked indicators specific to multimorbidity in ageing populations.22 23 These included the number of outpatient visits in the last 12 months, overnight hospital stays in the past 3 years, and the number of overnight stays in hospital in the past 12 months. A UK National Health Service document24 outlines equity indicators that may also map multimorbidity relevant in LMIC settings, and some of these have direct healthcare access relevance such as emergency hospitalisations for chronic conditions and repeat emergency hospitalisations in the same year. Access to medicines listed on the WHO Essential Medications list would provide another metric, as would recommendations on attention to comorbidity and pharmacological interactions in treatment guidelines.

This lack of LMIC specific multimorbidity indices to plot healthcare access leads to a critically important avenue of research that could draw on that conducted in HICs.25 The latter work lists a range of objectives that need to be addressed in healthcare practices catering to clients with multimorbidity and lists a set of preventive services for such cases which health facilities should provide. Health-seeking behaviour is a further dimension related to healthcare access that is shaped by unique socioeconomic and cultural contexts faced by patients in LMICs. We suggest it would be useful to develop health-seeking behaviour indices relevant across LMICs. This needs a contextual framework to best understand what is feasible and what can be tracked within specific LMIC settings, acknowledging the challenges introduced by the fragmentation of care and the multiplicity of levels of provision of care in the public and private sectors. Such indices could be linked with existing monitoring frameworks used to assess Universal Health Coverage.26

The Global Burden of Disease initiative has recently incorporated a new metric at national level termed the Healthcare Access and Quality (HAQ) Index.27 The HAQ index is a scale from 0 to 100, calculated by measuring mortality rates from causes that should not be fatal (amenable mortality) in the presence of effective medical care. This correlates with the Sociodemographic Index, a measure of overall development consisting of income per capita, average years of education and total fertility rates.

Treatment burden

The burden of treatment, a relatively new concept, emerged from disease-centred healthcare systems in response to the growing needs of coping with chronic conditions. In the context of multimorbidity, this may be considered as the workload and impact on a patient as a result of receiving medical care.28 High treatment burden may lead to overwhelmed patients who struggle to access healthcare and adhere to suggested treatment while coordinating their own care and other aspects of life, a particular issue among patients with multimorbidity. As a consequence, polypharmacy and non-adherence to treatment and poor clinical outcomes may follow, resulting in an even higher burden of treatment, a deterioration cycle depicted in the Cumulative Complexity Model.29 Therefore, assessing treatment burden is a priority in order to achieve better quality healthcare, and treatment burden is a potential outcome measure in interventions directed against multimorbidity. There is also the challenge, more pronounced in LMICs, that in areas of no care there can be no ‘burden’ from treatment which it is impossible to access.

Assessing the burden of treatment is not an easy task. It generally requires multidimensional measures that are tailored to the medical condition(s), health system(s) and cultural background. Tailoring to specific conditions may diminish value in multimorbidity. Eton et al proposed a conceptual framework of treatment burden based on qualitative inquiries to patients with chronic conditions, consisting of 3 themes and 15 subthemes.30 A number of tools for evaluating treatment burden for patients with multimorbidity have been developed in the past few years. Eton et al designed and validated the Patient Experience with Treatment and Self-management.31 The Treatment Burden Questionnaire (TBQ) is another instrument, consisting of 15 items32 and later further adapted.33 34 In 2018, Duncan published the Multimorbidity TBQ, a 10-item measure initially validated in primary care in the UK.35 The Healthcare Task Difficulty questionnaire is an 11-question tool designed to measure only one aspect—perceived difficulty in performing healthcare management tasks.36 Finally, the Multimorbidity Illness Perceptions Scale, unlike other instruments, was designed to measure the perceived impact of multimorbidity.37 The scale includes treatment burden (six questions) as one of the subscales.

As these questionnaires are relatively new, validation and translation for different populations and geographical areas remain limited, especially in LMICs. Exploring the notion and measurement of treatment burden in LMIC remains relatively unexplored,34 38 as does the important concept of patient-reported experience measures in LMIC settings which may themselves affect health outcomes.39

There are a number of remaining issues to be considered before applying these tools in LMICs. First, the strengths and limitations of each tool should be examined as careful validation has often not been conducted in such settings. Second, using mixed-methods incorporating experiences and opinions from patients and healthcare providers may help identify relevant issues relating to differences in contexts, cultures and health system structures. Third, as all of these instruments have been available for less than a decade, longitudinal evidence of change over time is absent.

Measures of ‘Healthy Living’

Multimorbidity is complex to operationalise, which makes common denominators very relevant. Measures of ‘Healthy Living’ are direct common denominators for being at risk of developing individual components of multimorbidity, and thus measuring change in these measures provides potential generic outcomes of interventions to mitigate future multimorbidity. Most current behavioural interventions have targeted only one behaviour at a time.

Healthy Living encompasses many different aspects of health and well-being, including diet, physical activity including sedentary behaviour, tobacco and alcohol consumption, developing health literacy, maintaining good hygiene and sanitation. Most current behavioural interventions have targeted only one behaviour at a time.

Diet

Dietary assessments are complex. Self-reported dietary intake measurements are the most common form of dietary assessments, which include prospective recording of actual food consumed or retrospective recall.40 41 With respect to multimorbidity, the focus must be on long-term usual intake. Dietary diversity scores are one such measure that can be estimated for the individual, or the household using counts of food items (food variety score) or food groups (dietary diversity score) consumed over a prespecified period.42 43 Dietary diversity can be estimated at the Household level using the Household Dietary Diversity Score, which assesses household access to a variety of foods, or at individual level for women and children respectively using the Minimum Dietary Diversity for Women of Reproductive Age tool and WHO Infant and Young Child Minimum Dietary Diversity Tool.44

Physical activity including sedentary behaviour

Convincing interventional evidence showing a clear dose–response relationship between physical activity (PA) and improved health outcomes comes mainly from HICs, although associations of PA with reduced cardiovascular mortality and morbidity are available globally.45 Sedentary behaviour, defined as those that involve sitting or reclining and low levels of energy expenditure during waking hours,46 has also been associated with having at least two morbidities, independent of light, moderate or vigorous PA46 47 in HICs and LMICs. The Global Physical Activity Questionnaire (GPAQ) that is part of the WHO STEPwise Approach to Chronic Disease Risk Factor Surveillance data collection tool48 is a commonly used tool to collect self-reported data on PA. The GPAQ which is a shorter (16-item) version of the longer International Physical Activity Questionnaire also assesses sitting time in addition to PA in three domains (work, travel and leisure time). This is used to estimate the duration of moderate to vigorous PA or intensity in terms of metabolic equivalent minutes per week of total and domain-specific activities. However, agreement between PA estimated by GPAQ and more objective measures has been moderate at best. Objective measures of PA allow real-time monitoring and can be easily completed using an application on a mobile device or a wearable pedometer or accelerometer, although this has mostly been tested in HIC settings. Considering the rapid acceleration of smart phone ownership in LMIC, and the availability of cheaper but robust wearable devices, these are now viable options and an optional tool to capture objective PA has since been incorporated into the GPAQ.

Tobacco and alcohol use

Tobacco use has been consistently linked as a causative factor for chronic respiratory disorders such as chronic obstructive pulmonary disease, cardiovascular disease and many cancers including lung cancer. Similarly, alcohol use has strong associations with NCDs. Ever and current use of tobacco or current use of alcohol are commonly used assessments in addition to questions focusing on frequency and amount of consumption, and these are part of the WHO STEPS instrument.48 Where available, verification of smoking status can be achieved through measurement of carbon monoxide or urinary cotinine. Assessment of household, environmental and occupational airborne exposures are more complex.

Healthy Living Index

In addition to individual risks and behaviours, composite indicators that assess Healthy Living may be more relevant in the context of multimorbidity. Tools to assess the environment in terms of its potential to offer opportunities for Healthy Living have been limited, especially in LMICs. Environmental Profile of a Community’s Health (EPOCH) is a quantitative tool designed to capture community perceptions of tobacco, nutrition and social environments, validated in five countries (China, India, Brazil, Colombia and Canada).49 50 EPOCH comprises an objective assessment of the physical environment, and an interviewer-administered questionnaire on residents’ perceptions of their community to capture both objective and subjective measures of the environment.49 The Community Healthy Living Index developed in the USA assessed the environmental support potential of a community across five domains assessing a specific venue: schools, afterschool child care sites, work sites, neighbourhoods and communities-at-large.51 Such tools could be adapted for use in LMICs.

Self-efficacy and social functioning

Self-efficacy and social functioning relate to social determinants of health such as age, gender, marital status, family background, employment, education level and socioeconomic status,52–58 affecting in turn how an individual is able to look after their health conditions (self-efficacy) and interact in society with other individuals leading a fulfilling life (social functioning). This raises the important question of whether indices of self-efficacy and social functioning may be suitable as outcomes measures in studies to mitigate multimorbidity in LMIC settings.

There are limited studies that explore which social determinants are more influential than others in determining self-efficacy and social functioning. Positive personality traits and higher self-esteem demonstrated in adolescence positively affect self-efficacy.59 Competent behaviour, such as skills of focusing on others’ well-being, affiliative behaviours/interpersonal cooperation and participation, which are culturally valued and socially competent are associated with higher self-efficacy.60 61 Liebke et al 62 reported that loneliness and social functioning are associated. Loneliness may be caused by impaired social skills, such as maintaining conversations or expressing feelings, which are essential to adequate social functioning.62 Values placed on social determinants of health may vary across different cultures. Differences in cultural traditions may affect the sources of self-efficacy belief systems.52 55 56

Given the multitude of cultural factors affecting the precursors of self-efficacy and social functioning, populations in LMICs may have fewer opportunities to develop such skills. Therefore, while measures of self-efficacy and social functioning could be used as multimorbidity outcome measure in LMIC, a single index is unlikely to be useful across all settings.

Conclusions

The case has been made for the growing global importance of multimorbidity, the need for pragmatic intervention studies to reduce the risk of developing multimorbidity in LMIC settings, and of mitigating the complications and progression of multimorbidity. One of many challenges in such research has been the selection of appropriate outcomes measures.

We present the GACD Researchers’ perspective on outcome measures suitable for multimorbidity intervention studies in the context of LMICs. We have considered outcome measures across eight domains (figure 1). Some represent direct measurements of clinical outcomes, while others represent intermediate variables on the pathway to multimorbidity. Some measures are single, others are composite. They vary in their ease of collection and cost. It is critical to choose appropriate outcomes for the study design, cultural context and participant preference in order to demonstrate and understand the effect of an intervention, and our aim is therefore not to suggest a preference of one outcome measure over any other. Studies in multimorbidity are necessarily diverse and thus different outcome measures will be appropriate for different study designs. As with the COSmm consensus,3 we recognise the key importance of mortality and HRQoL as multimorbidity outcomes, and these are suitable for use in LMIC settings. Many other outcomes from the COSmm work, including patient-reported impacts and behaviours (such as treatment burden and self-efficacy), physical activity and function, and health systems indicators (notably health economic indices) are also suitable for LMIC settings, though in the context and with the caveats that we have described above. Some of the challenges applying these outcome measures in LMIC are also relevant in HIC.

Figure 1.

Figure 1

Eight domains of outcome measures for multimorbidity interventions in LMIC. LMIC, low-income and middle-income country.

The diversity of outcome measures across domains demonstrated here should provide a useful summary for researchers, and encourage the use of multiple domains in multimorbidity research, rather than just a single outcome measure. Ultimately, the proof of utility for these outcome measures will be the demonstration that an effective multimorbidity intervention can improve the health of the community in which it is tested. Meanwhile, there remains the urgent need for further study and development of outcome measures suitable for multimorbidity intervention studies in the context of LMIC.

There are limitations to this work, which is not intended to be a core outcome set, nor a systematic review. Development of both these would be an important contribution to the field, as would further work to understand the perceptions of these outcome measures from people directly affected by multimorbidity and tools suitable for assessing patient-reported experience in the context of multimorbidity. Here, we present a critical, narrative synthesis describing the range of outcome measures that might be selected for use in such settings, and their challenges. The key strength of our work is the broad representation of views from GACD researchers who have considerable collective experience of implementation science research in LMIC settings. We anticipate this will be useful to other researchers designing and conducting such studies, and to provoke debate and progress in the field.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @GillianSGould

Correction notice: This article has been corrected since it was published. The licence has been updated.

Collaborators: GACD Multimorbidity Working Group: Ricardo Araya, Kirsten Bobrow, Niels H Chavannes, F Xavier Gómez-Olivé, Shabbar Jaffar, Bruce J Kirenga, Rianne M J J van der Kleij, Muralidhar M Kulkarni, Laura Loli-Dano, Patricio Lopez-Jaramillo, Shane Norris, Josefien van Olmen, Gary Parker, Trishul Siddharthan, Kamran Siddiqi, Najma Siddiqi, Antigona C Trofor.

Contributors: The concept for this paper arose from discussion at the GACD Multimorbidity Working Group chaired by JRH. The authors (JRH, GA, JFMvB, MD, GSG, EW-CH, PKM, JJM, MOO, SP, JS, RV, LY and NL) planned and conducted the e-mail survey. All authors and contributors (RA, KB, NHC, FXG-O, SJ, BJK, RMJJvdK, MMK, LL-D, PL-J, SN, JvO, GP, TS, KS, NS and ACT) provided suggestions for outcome measures. Individual sections of the manuscript were drafted by the authors, coordinated by JRH into a first complete draft. All authors revised this initial draft. All authors and contributors provided important intellectual content on the revised draft and approved the final version for submission.

Funding: The article was supported by the Global Alliance for Chronic Diseases (GACD) secretariat. The Authors are investigators on individual studies funded in collaboration with the GACD.

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Patient consent for publication: Not required.

Provenance and peer review: Not commissioned; externally peer reviewed.

Data availability statement: Data sharing not applicable as no datasets generated and/or analysed for this study.

Contributor Information

on behalf of the GACD Multi-Morbidity Working Group:

Ricardo Araya, Kirsten Bobrow, Niels H Chavannes, F Xavier Gómez-Olivé, Shabbar Jaffar, Bruce J Kirenga, Rianne M J J van der Kleij, Muralidhar M Kulkarni, Laura Loli-Dano, Patricio Lopez-Jaramillo, Shane Norris, Josefien van Olmen, Gary Parker, Trishul Siddharthan, Kamran Siddiqi, Najma Siddiqi, and Antigona C Trofor

References

  • 1. Academy of Medical Sciences Multimorbidity: a priority for global health research: full report. Available: https://acmedsci.ac.uk/policy/policy-projects/multimorbidity [Accessed 26 Apr 2020].
  • 2. Academy of Medical Sciences Advancing research to tackle multimorbidity: the UK and LMIC perspectives workshop report. Available: https://acmedsci.ac.uk/policy/policy-projects/multimorbidity [Accessed 26 Apr 2020].
  • 3. Smith SM, Wallace E, Salisbury C, et al. . A core outcome set for multimorbidity research (COSmm). Ann Fam Med 2018;16:132–8. 10.1370/afm.2178 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Hurst JR, Dickhaus J, Maulik PK, et al. . Global alliance for chronic disease researchers’ statement on multimorbidity. Lancet Glob Health 2018;6:e1270–1. 10.1016/S2214-109X(18)30391-7 [DOI] [PubMed] [Google Scholar]
  • 5. Vaanholt MCW, Kok MM, von Birgelen C, et al. . Are component endpoints equal? A preference study into the practice of composite endpoints in clinical trials. Health Expect 2018;21:1046–55. 10.1111/hex.12798 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. van Summeren JJ, Schuling J, Haaijer-Ruskamp FM, et al. . Outcome prioritisation tool for medication review in older patients with multimorbidity: a pilot study in general practice. Br J Gen Pract 2017;67:e501–6. 10.3399/bjgp17X690485 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Fried TR, Tinetti M, Agostini J, et al. . Health outcome prioritization to elicit preferences of older persons with multiple health conditions. Patient Educ Couns 2011;83:278–82. 10.1016/j.pec.2010.04.032 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. WHO Verbal autopsy standards: ascertaining and attributing causes of death. Available: https://www.who.int/healthinfo/statistics/verbalautopsystandards/en/ [Accessed 26 Apr 2020].
  • 9. Garvey J, Connolly D, Boland F, et al. . Optimal, an occupational therapy led self-management support programme for people with multimorbidity in primary care: a randomized controlled trial. BMC Fam Pract 2015;16:59. 10.1186/s12875-015-0267-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Gitlin LN, Hauck WW, Dennis MP, et al. . Long-Term effect on mortality of a home intervention that reduces functional difficulties in older adults: results from a randomized trial. J Am Geriatr Soc 2009;57:476–81. 10.1111/j.1532-5415.2008.02147.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Gitlin LN, Winter L, Dennis MP, et al. . A randomized trial of a multicomponent home intervention to reduce functional difficulties in older adults. J Am Geriatr Soc 2006;54:809–16. 10.1111/j.1532-5415.2006.00703.x [DOI] [PubMed] [Google Scholar]
  • 12. Linton M-J, Dieppe P, Medina-Lara A. Review of 99 self-report measures for assessing well-being in adults: exploring dimensions of well-being and developments over time. BMJ Open 2016;6:e010641. 10.1136/bmjopen-2015-010641 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Dolan P. Modeling valuations for EuroQol health states. Med Care 1997;35:1095–108. 10.1097/00005650-199711000-00002 [DOI] [PubMed] [Google Scholar]
  • 14. Jenkinson C, Coulter A, Wright L. Short form 36 (SF36) health survey questionnaire: normative data for adults of working age. BMJ 1993;306:1437–40. 10.1136/bmj.306.6890.1437 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Skevington SM, Lotfy M, O’Connell KA, et al. . The world Health organization’s WHOQOL-BREF quality of life assessment: psychometric properties and results of the International field trial. A report from the WHOQOL group. Qual Life Res 2004;13:299–310. 10.1023/B:QURE.0000018486.91360.00 [DOI] [PubMed] [Google Scholar]
  • 16. Fairall L, Petersen I, Zani B, et al. . Collaborative care for the detection and management of depression among adults receiving antiretroviral therapy in South Africa: study protocol for the cobalt randomised controlled trial. Trials 2018;19:193. 10.1186/s13063-018-2517-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Petersen I, Bhana A, Folb N, et al. . Collaborative care for the detection and management of depression among adults with hypertension in South Africa: study protocol for the PRIME-SA randomised controlled trial. Trials 2018;19:192. 10.1186/s13063-018-2518-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.pp.Gray WK, Richardson J, McGuire J, et al. . Frailty screening in low- and middle-income countries: a systematic review. J Am Geriatr Soc 2016;64:806–23. 10.1111/jgs.14069 [DOI] [PubMed] [Google Scholar]
  • 19. Fried LP, Tangen CM, Walston J, et al. . Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci 2001;56:M146–57. 10.1093/gerona/56.3.M146 [DOI] [PubMed] [Google Scholar]
  • 20. van Boven JFM, van de Hei SJ, Sadatsafavi M. Making sense of cost-effectiveness analyses in respiratory medicine: a practical guide for non-health economists. Eur Respir J 2019;53:1801816. 10.1183/13993003.01816-2018 [DOI] [PubMed] [Google Scholar]
  • 21. Marseille E, Larson B, Kazi DS, et al. . Thresholds for the cost-effectiveness of interventions: alternative approaches. Bull World Health Organ 2015;93:118–24. 10.2471/BLT.14.138206 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Arokiasamy P, Uttamacharya U, Jain K, et al. . The impact of multimorbidity on adult physical and mental health in low- and middle-income countries: what does the study on global ageing and adult health (SAGE) reveal? BMC Med 2015;13:178. 10.1186/s12916-015-0402-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Lee JT, Hamid F, Pati S, et al. . Impact of noncommunicable disease multimorbidity on healthcare utilisation and out-of-pocket expenditures in middle-income countries: cross sectional analysis. PLoS One 2015;10:e0127199. 10.1371/journal.pone.0127199 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Cookson R, Asaria M, Ali S, et al. . Health equity indicators for the English NHS: a longitudinal whole-population study at the small-area level. Health Serv Deliv Res 2016;4:1–224. 10.3310/hsdr04260 [DOI] [PubMed] [Google Scholar]
  • 25. Rijken M, Hujala A, van Ginneken E, et al. . Managing multimorbidity: profiles of integrated care approaches targeting people with multiple chronic conditions in Europe. Health Policy 2018;122:44–52. 10.1016/j.healthpol.2017.10.002 [DOI] [PubMed] [Google Scholar]
  • 26. Boerma T, Eozenou P, Evans D, et al. . Monitoring progress towards universal health coverage at country and global levels. PLoS Med 2014;11:e1001731. 10.1371/journal.pmed.1001731 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. GBD 2015 Healthcare Access and Quality Collaborators Healthcare access and quality index based on mortality from causes amenable to personal health care in 195 countries and territories, 1990-2015: a novel analysis from the global burden of disease study 2015. Lancet 2017;390:231–66. 10.1016/S0140-6736(17)30818-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Mair FS, May CR. Thinking about the burden of treatment. BMJ 2014;349:g6680. 10.1136/bmj.g6680 [DOI] [PubMed] [Google Scholar]
  • 29. Leppin AL, Montori VM, Gionfriddo MR. Minimally disruptive medicine: a Pragmatically comprehensive model for delivering care to patients with multiple chronic conditions. Healthcare 2015;3:50–63. 10.3390/healthcare3010050 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Eton DT, Ridgeway JL, Egginton JS, et al. . Finalizing a measurement framework for the burden of treatment in complex patients with chronic conditions. Patient Relat Outcome Meas 2015;6:117–26. 10.2147/PROM.S78955 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Eton DT, Yost KJ, Lai J-S, et al. . Development and validation of the patient experience with treatment and self-management (pets): a patient-reported measure of treatment burden. Qual Life Res 2017;26:489–503. 10.1007/s11136-016-1397-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Tran V-T, Montori VM, Eton DT, et al. . Development and description of measurement properties of an instrument to assess treatment burden among patients with multiple chronic conditions. BMC Med 2012;10:68. 10.1186/1741-7015-10-68 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Déruaz-Luyet A, N’Goran AA, Tandjung R, et al. . Multimorbidity in primary care: protocol of a national cross-sectional study in Switzerland. BMJ Open 2015;5:e009165. 10.1136/bmjopen-2015-009165 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Tran V-T, Messou E, Mama Djima M, et al. . Patients’ perspectives on how to decrease the burden of treatment: a qualitative study of HIV care in sub-Saharan Africa. BMJ Quality & Safety 2019;28:266. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Duncan P, Murphy M, Man M-S, et al. . Development and validation of the multimorbidity treatment burden questionnaire (MTBQ). BMJ Open 2018;8:e019413. 10.1136/bmjopen-2017-019413 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Boyd CM, Wolff JL, Giovannetti E, et al. . Healthcare task difficulty among older adults with multimorbidity. Med Care 2014;52:S118–25. 10.1097/MLR.0b013e3182a977da [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Gibbons CJ, Kenning C, Coventry PA, et al. . Development of a multimorbidity illness perceptions scale (multiples). PLoS One 2013;8:e81852. 10.1371/journal.pone.0081852 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Matima R, Murphy K, Levitt NS, et al. . A qualitative study on the experiences and perspectives of public sector patients in Cape town in managing the workload of demands of HIV and type 2 diabetes multimorbidity. PLoS One 2018;13:e0194191. 10.1371/journal.pone.0194191 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Birkhäuer J, Gaab J, Kossowsky J, et al. . Trust in the health care professional and health outcome: a meta-analysis. PLoS One 2017;12:e0170988. 10.1371/journal.pone.0170988 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Naska A, Lagiou A, Lagiou P. Dietary assessment methods in epidemiological research: current state of the art and future prospects. F1000Res 2017;6:926. 10.12688/f1000research.10703.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Shim J-S, Oh K, Kim HC. Dietary assessment methods in epidemiologic studies. Epidemiol Health 2014;36:e2014009. 10.4178/epih/e2014009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. de Oliveira Otto MC, Anderson CAM, Dearborn JL, et al. . American heart association behavioral change for improving health factors Committee of the Council on lifestyle and cardiometabolic health and Council on epidemiology and prevention; Council on cardiovascular and stroke nursing; Council on clinical cardiology; and stroke Council. dietary diversity: implications for obesity prevention in adult populations: a science Advisory from the American heart association. Circulation 2018;138:e160–8.30354383 [Google Scholar]
  • 43. Rathnayake KM, Madushani P, Silva K. Use of dietary diversity score as a proxy indicator of nutrient adequacy of rural elderly people in Sri Lanka. BMC Res Notes 2012;5:469. 10.1186/1756-0500-5-469 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Walls HL, Johnston D, Mazalale J, et al. . Why we are still failing to measure the nutrition transition. BMJ Glob Health 2018;3:e000657. 10.1136/bmjgh-2017-000657 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Barr AL, Young EH, Sandhu MS. Objective measurement of physical activity: improving the evidence base to address non-communicable diseases in Africa. BMJ Glob Health 2018;3:e001044. 10.1136/bmjgh-2018-001044 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Koyanagi A, Stubbs B, Vancampfort D. Correlates of sedentary behavior in the general population: a cross-sectional study using nationally representative data from six low- and middle-income countries. PLoS One 2018;13:e0202222. 10.1371/journal.pone.0202222 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Vancampfort D, Stubbs B, Koyanagi A. Physical chronic conditions, multimorbidity and sedentary behavior amongst middle-aged and older adults in six low- and middle-income countries. Int J Behav Nutr Phys Act 2017;14:147. 10.1186/s12966-017-0602-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. World Health Organization Stepwise approach to surveillance. Available: https://www.who.int/ncds/surveillance/steps/en/ [Accessed 26 Apr 2020].
  • 49. Chow CK, Lock K, Madhavan M, et al. . Environmental profile of a community’s health (epoch): an instrument to measure environmental determinants of cardiovascular health in five countries. PLoS One 2010;5:e14294. 10.1371/journal.pone.0014294 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Corsi DJ, Subramanian SV, McKee M, et al. . Environmental profile of a community’s health (epoch): an ecometric assessment of measures of the community environment based on individual perception. PLoS One 2012;7:e44410. 10.1371/journal.pone.0044410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Kim S, Adamson KC, Balfanz DR, et al. . Development of the community healthy living index: a tool to foster healthy environments for the prevention of obesity and chronic disease. Prev Med 2010;50:S80–5. 10.1016/j.ypmed.2009.07.025 [DOI] [PubMed] [Google Scholar]
  • 52. Hur MH. Demographic and socioeconomic determinants of self-efficacy: an empirical study of Korean older adults. Int J Aging Hum Dev 2018;87:289–308. 10.1177/0091415017738081 [DOI] [PubMed] [Google Scholar]
  • 53. Callander EJ, Schofield DJ. Impact of multidimensional poverty on the self-efficacy of older people: results from an Australian longitudinal study. Geriatr Gerontol Int 2017;17:308–14. 10.1111/ggi.12689 [DOI] [PubMed] [Google Scholar]
  • 54. Kollia N, Caballero FF, Sánchez-Niubó A, et al. . Social determinants, health status and 10-year mortality among 10,906 older adults from the English longitudinal study of aging: the ATHLOS project. BMC Public Health 2018;18:1357. 10.1186/s12889-018-6288-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Qian H, Yuan C. Factors associated with self-care self-efficacy among gastric and colorectal cancer patients. Cancer Nurs 2012;35:E22–31. 10.1097/NCC.0b013e31822d7537 [DOI] [PubMed] [Google Scholar]
  • 56. Schnell-Hoehn KN, Naimark BJ, Tate RB. Determinants of self-care behaviors in community-dwelling patients with heart failure. J Cardiovasc Nurs 2009;24:40–7. 10.1097/01.JCN.0000317470.58048.7b [DOI] [PubMed] [Google Scholar]
  • 57. Baheiraei A, Bakouei F, Mohammadi E, et al. . The social determinants of health in association with women’s health status of reproductive age: a population-based study. Iran J Public Health 2015;44:119–29. [PMC free article] [PubMed] [Google Scholar]
  • 58. Walker RJ, Gebregziabher M, Martin-Harris B, et al. . Independent effects of socioeconomic and psychological social determinants of health on self-care and outcomes in type 2 diabetes. Gen Hosp Psychiatry 2014;36:662–8. 10.1016/j.genhosppsych.2014.06.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Caprara GV, Vecchione M, Alessandri G, et al. . The contribution of personality traits and self-efficacy beliefs to academic achievement: a longitudinal study. Br J Educ Psychol 2011;81:78–96. 10.1348/2044-8279.002004 [DOI] [PubMed] [Google Scholar]
  • 60. Di Giunta L, Eisenberg N, Kupfer A, et al. . Assessing perceived empathic and social self-efficacy across countries. Eur J Psychol Assess 2010;26:77–86. 10.1027/1015-5759/a000012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. van der Slot WMA, Nieuwenhuijsen C, van den Berg-Emons RJG, et al. . Participation and health-related quality of life in adults with spastic bilateral cerebral palsy and the role of self-efficacy. J Rehabil Med 2010;42:528–35. 10.2340/16501977-0555 [DOI] [PubMed] [Google Scholar]
  • 62. Liebke L, Bungert M, Thome J, et al. . Loneliness, social networks, and social functioning in borderline personality disorder. Personal Disord 2017;8:349–56. 10.1037/per0000208 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES