Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2016 Feb 5;11(2):e0148830. doi: 10.1371/journal.pone.0148830

Health Impact Index. Development and Validation of a Method for Classifying Comorbid Disease Measured against Self-Reported Health

Geir Fagerjord Lorem 1,*,#, Henrik Schirmer 2,3,#, Nina Emaus 1,#
Editor: Takeru Abe4
PMCID: PMC4746071  PMID: 26849044

Abstract

The objective of this study was to develop a method of classifying comorbid conditions that accounts for both the severity and joint effects of the diseases. The Tromsø Study is a cohort study with a longitudinal design utilizing a survey approach with physical examinations in the Tromsø municipality from 1974 to 2008, where in total 40051 subjects participated. We used Tromsø 4 as reference population and the Norwegian Institute of Public Health (FHI) panel as validation population. Ordinal regression was used to assess the effect of comorbid disease on Self-Reported Health (SRH). The model is controlled for interaction between diseases, mental health, age, and gender. The health impact index estimated levels of SRH. The comparison of predicted and observed SRH showed no significant differences. Spearman’s correlation showed that increasing levels of comorbidity were related to lower levels of SRH (RS = -0.36, p <.001). The Charlson Comorbidity Index(CCI) was also associated with SRH (r = -.25, p <.001). When focusing on only individuals with a comorbid disease, the relation between SRH and the Health Impact Index (HII) was strengthened (r = -.42, p <.001), while the association between SRH and CCI was attenuated (r = -.14, p <.001). CCI was designed to control for comorbid conditions when survival/mortality is the outcome of interest but is inaccurate when the outcome is SRH. We conclude that HII should be used when SRH is not available, and well-being or quality of survival/life is the outcome of interest.

Introduction

The prevalence of coexisting chronic conditions is rising [1]. Comorbidity is associated with worse health outcomes, more complex clinical management and increased health care costs [2]. However, how do we establish information about the impact of comorbid disease on general health status? Comorbid disease is a problem in longitudinal designs. In clinical studies of high-risk groups such as disease groups with high prevalence of comorbidity, excluding patients that develop comorbid disease will be a design weakness, especially when comorbidity is relevant for care [3].

There are several different methods to measure comorbid impact on health that utilize mortality as the preferred outcome of interest [47]. They were developed as methods to deal with comorbidity in prospective studies but are also applied by health planners and policy makers to estimate risk and future health costs, to assure quality in health services [6, 8, 9]. The Charlson Comorbidity Index (CCI) is the most extensively studied. The CCI identifies diseases associated with higher mortality rates but does not reflect health behaviors, resources or ability to cope with health threats. However, a recent UK study concludes that Self-Reported Health (SRH) and several other self-reported variables significantly outperformed the CCI [10]. It is a methodical weakness if the existing methods to deal with comorbidity in epidemiological studies fail to identify and correctly weigh the health impact of different diseases [1116].

SRH is well a known, independent predictor of future health outcomes, health service use and mortality even in populations with a small or no known disease burden [10, 17]. The association between perceived health status and future health outcomes suggests a close relation between perceived health status and more objective measures of health status [14, 15]. SRH thus helps to identify at-risk individuals and illuminate underlying illnesses that may otherwise go undetected during routine examinations in both healthy and patient populations [1416]. SRH is also related to personal, socio-environmental, behavioral and psychological factors such as coping resources, psychological strain, and physical fitness [16, 1820]. It is proven stable across cultures, communities and different age groups [11, 13, 2128]. SRH thus seems to go beyond a model of health as absence of disease, and several authors argue that SRH reflects comorbidity better than any additive measure of diseases [2931]. Many studies of SRH that focus on comorbidity or more objective biological health measures are performed in patient populations. The Tromsø study allows us to estimate the impact of comorbid diseases in a general population, utilizing a survey approach and physical examinations in large representative samples of the Tromsø population [32].

We aim to use data from the Tromsø study to investigate how differences in gender, age, mental health symptoms and specific medical conditions relate to different levels of SRH. We also aim to develop and validate a new method of classifying comorbid conditions that accounts for both the severity and joint effects of the diseases. Both aims were achieved and are reported in this article.

Material and Methods

Sample and design

The Tromsø Study consists of six surveys conducted in the municipality of Tromsø from 1974 to 2008 [32]. The study population was recruited from all inhabitants in specific age groups in the city. The aim has been to include large, representative samples of the Tromsø population, with the invitation of whole birth cohorts and random samples. A total of 40051 participants gave informed signed consent and attended up to six separate health examinations. The attendance rate was high (66–75%). We collected samples from the Tromsø studies conducted in 1994/1995 (the Tromsø 4 panel) and 2001/2002 (the FHI panel). Our samples were drawn from the general population. They did not only include persons already suffering from a disease but also healthy subjects [32].

We used Tromsø 4 as the reference population. All inhabitants in Tromsø municipality 25 years or older were invited. The attendance rate was 69.6% for men and 74.9% for women. We excluded all that missed SRH (n = 39). The reference population thus included 12,661 men and 14,023 women aged 25–97.

Tromsø 5 invited two groups. The primary group consisted of all who had participated in the special study in 1994–95 and a smaller group (n = 1916) whom the Norwegian Institute of Public Health (FHI) invited as part of its nationwide health study (the FHI panel). We used the FHI panel as validation population. We excluded all subjects that participated in Tromsø 4 (n = 1112) to ensure independence. The validation population thus included 442 women and 362 men aged 30–79.

Measurements

The participants completed a self-administered questionnaire that included questions on a wide range of diseases and symptoms, health behavior, social conditions, education, financial difficulties and level of physical activity. We considered three groups of health-related variables: (1) self-reported health, (2) specific medical conditions, and (3) mental health.

Self-reported health

The independent variable self-reported health was reported by answering the survey question ‘What is your current state of health?’ with answers ranging from poor (1) to very good (4).

Specific medical conditions

The conditions were self-reported by answering survey questions as “Do you have or have you had….?” We classified each participant for each known diagnosis. We included all available specific medical conditions to avoid missing possible long-term after-effects on SRH. The conditions therefore include acute diseases (e.g. myocardial infarction), chronic conditions (e.g. epilepsy) as well as conditions that had been completely resolved at the time of the survey (e.g. kidney stone). All conditions are listed in Table 1. Only participants older than 70 years answered questions about Parkinson’s disease, arthritis, rheumatoid arthritis, urinary incontinence, glaucoma, and cataract.

Table 1. Percentage of patients entered for each SRH category and odds ratios from the ordinal regression models by comorbid disease in the reference population (Tromsø 4).
Self-Reported Health Impact on Self-Reported Health
Count Meana SD. Unadjusted models Base model Mental conditions Full con- textual modeld
Age 10-year groups
25–29 3046 3.14 .64 1.00e 1.00 e
30–39 6769 3.07 .64 1.29 1.28
40–49 6644 2.88 .65 2.30 2.14
50–59 4413 2.70 .67 4.15 3.46
60–69 3099 2.49 .64 7.48 5.84
70–79 2145 2.38 .68 10.08 6.47
>80 607 2.27 .64 14.19 8.78
Gender
Female 14023 2.79 .71 1.00 e 1.00 e
Male 12661 2.88 .68 .76 1.04
Mental health
No symptoms 2061 3.22 .71 1.00 e 1.00 1.00 e
Some symptoms 15751 2.92 .64 2.73 2.89 2.97
Sub-threshold symptoms 4964 2.59 .65 7.12 6.93 7.66
Significant symptoms 1762 2.21 .67 21.63 17.65 20.79
Myocardial and vascular
Angina 1097 2.09 .56 8.89 4.94 4.71 2.77
Myocardial infarction 758 2.21 .62 5.67 2.85 3.03 2.09
Cerebrovascular stroke 414 2.21 .70 5.77 3.89 3.37 2.12
Pulmonary
Asthma 1876 2.55 .71 2.24 1.67 1.66 1.63
Chronic bronchitis 1460 2.50 .70 3.10 1.65 1.48 1.38
Neurologic
Epilepsy 284 2.69 .74 1.70 1.10 1.03 1.12
Migraine 3280 2.68 .69 1.83 1.42 1.33 1.38
Parkinson's disease 20 1.75 .44 8.59 15.66 12.18 12.56
Endocrine
Thyroid 788 2.47 .69 3.12 2.01 1.92 1.65
Diabetes 482 2.28 .67 4.68 3.07 3.10 2.30
Renal
Kidney stone 1113 2.58 .69 2.35 1.52 1.59 1.16
Gastrointestinal
Liver disease 393 2.49 .73 2.80 1.34 1.17 1.11
Ventricular ulcer 1026 2.42 .70 3.83 2.12 2.08 1.72
Duod. ulcer 953 2.48 .69 3.09 1.71 1.70 1.52
Cancer
Cancer survivor 790 2.51 .72 2.80 1.69 1.61 1.19
Dermatological
Psoriasis 1636 2.72 .70 1.58 1.25 1.21 1.22
Atopic eczema b 2325 2.85 .70 1.08 .88 .84 .99
Hand eczema 3450 2.81 .69 1.26 1.06 1.06 1.09
Miscellaneous
Pollen allergies c 2851 2.88 .71 .97 .72 .71 .81
Osteoporosis 350 2.11 .57 9.29 4.70 4.63 2.56
Arthritis 730 2.18 .60 3.05 2.17 1.99 1.99
Rheumatoid arthritis 162 1.99 .64 4.63 3.09 2.94 2.99
Food allergies 1769 2.77 .71 1.41 1.14 1.13 1.29
Hypersensitivity 3184 2.71 .70 1.75 1.25 1.13 1.20
Fibromyalgia 1872 2.23 .62 8.19 6.78 6.07 5.93
Urinary incontinence 409 2.15 .64 2.88 1.71 1.41 1.40
Glaucoma 141 2.25 .66 1.75 .82 .99 .96
Cataract 421 2.27 .63 1.77 1.19 1.05 1.01

a Independent samples Mann-Whitney U test show significant lower SRH levels for all comorbid conditions (p <.001) except for

bp =.086 and

c p =.494.

d Full contextual model (n = 17,475), Log likelihood = -14876.112, Nagelkerke R2 =.160, χ2 (32) = 399.05, P <.001, Contextual model over 70y (n = 1094) is marked by italics, Log likelihood = -909.06, Nagelkerke R2 =.180, χ2 (35) = 414.47, P <.001.

e = reference category

Mental health

Tromsø 5 and 6 used the Hopkins Symptom Check List (HSCL-10), which is a self-reported symptom inventory comprising ten items that are representative of the symptom configurations commonly observed among outpatients [33]. Tromsø 4 used the mental health index (MHI) based on seven questions on different dimensions of mental distress. MHI was partly derived from HSCL and the General Health Questionnaire (GHQ). The scales were compared in the Cohort Norway panel (CONOR) that included both HSCL-10 and MHI. It was found that MHI was highly correlated to HSCL-10, with the conclusion that the Mental Health Index composed of the seven questions on mental distress is a valuable and valid tool in epidemiological research. For significant symptoms we use the recommended cut-off of 1.85 for HSCL-10 and 2.15 for MHI [34, 35].

Statistical analysis

We used STATA v14 for the entire analysis. Steps 1–4 are based on the reference population, while Step 5 is based on the validation populations. Step 6 compares predicted and observed SRH in both populations.

Step 1: Describing the impact of individual comorbid diseases on SRH

We used SRH from Tromsø 4 as the outcome of interest when estimating the effect of the comorbid disease. We show count, mean, and standard deviation for all variables. We compared different SRH levels for gender, comorbid condition, age, and mental health symptoms, utilizing non-parametric statistics (Mann-Whitney and Kruskal-Wallis).

Step 2: Identifying relevant predictive factors and estimating their effect on SRH

We utilized ordinal logistic regression to assess the relationship of important potential predictive variables to SRH in the reference population. Such models can be used to estimate the odds of being at or above a given threshold across all cumulative splits, considering the effects of a set of explanatory variables [36]. Proportional odds models focus on cumulative probabilities rather than probabilities for discrete categories. The odds ratios are the odds of scoring at lower levels of SRH for those with the disease compared with those without the disease. An OR>1 is thus associated with a probable negative impact on SRH.

The models were built stepwise, starting with the unadjusted models that estimate the total effect of each comorbid disease, age, mental health, and gender. The base model controls each comorbid disease against all others. The mental health model controls for mental health. The full contextual model controls for all variables including age and gender.

Step 3: Establishing the comorbidity index

We created a scoring system based on the estimated ORs. We excluded comorbid disease with OR≤1.2. The assigned weight is the OR for the condition rounded off to the closest natural number. The health impact index score (HII) is the total of the weighted score for every condition the patient has. We calculated the HII for the reference and validation population and created the comorbidity groups “Not ill” (HII = 0), “Mildly ill” (HII = 1–2), “Moderately ill” (HII = 3–5) and “Seriously ill” (HII≥6).

Step 4: Calculating the predicted SRH in the reference population

We utilized ordinal regression to analyze how HII affects SRH when controlling for mental health symptoms, age, and gender. To predict SRH, we include all the factors identified in Step 2. The model, therefore, equals the full contextual model but replaces the specific medical conditions with HII. It was given by:

logit (Yi)= (Zi+ β2hii+ β3mhi+ β4age+ β5sex),  i=1,2,3

We report the category thresholds (logit/Zi) and location (βn) values. We can now calculate each subject’s cumulative odds by filling in the variables and the coefficient into the model equation or we can use postestimation in STATA to calculate the category probability for the reference population. Cumulative odds are EXP (Zi + β2hii + β3mhi + β4age + β5sex). The cumulative proportions are 1/(1+cumulative odds). Category probability is the difference between the cumulative proportions at each level against the level above. The estimated average for each subject is the total of the cumulative proportions [36].

Step 5: Calculating predicted SRH in the validation population

For the validation population, we need to calculate the category probability without using the observed SRH. We utilized the model from the reference population to predict category distribution and estimated SRH. We calculated the predicted category and SRH using the coefficients from step 4 and the variables from the FHI panel for each subject.

Step 6: Comparing the predicted and observed SRH in both populations

We checked the goodness of fit by comparing the observed SRH to the distribution of the predicted variables, with the statistical significance of the test summarized by a p-value utilizing Wilcoxon signed rank matched pairs [37]. We used Spearman’s correlation to compare the association of SRH to both HII and the Charlson Comorbidity Index (CCI). These are non-parametric statistics based on ranked data and are useful to minimize the effects of extreme scores [34]. Spearman’s correlation was performed for the whole sample and for a subsample including individuals with at least one identified comorbid disease (HII>0 for the HII and CCI>0 for the CCI). The analytical goal was to determine whether the association remained stable in those subjects that the indexes identified with a comorbid condition.

Ethics

The Norwegian Data Protection Authority and the Regional Committees for Medical and Health Research Ethics North Norway approved the Tromsø Study.

Results

Determining impact and interaction of comorbid disease

Table 1 shows count, mean and standard deviation of SRH for each age group, gender, and comorbid disease. Although the effect of comorbid disease differs in severity, SRH levels were significantly lower in the presence of a comorbid disease (p <.001), except for pollen allergies (p = .494) and atopic eczema (p = .086). The youngest age group had the highest score, with a successive and significant decline in the SRH distribution with increasing age (p <.001). The presence of mental health symptoms had a significant negative effect on SRH with increasing effect depending on the severity of symptoms (p <.001).

The impact on SRH is reported as Odds Ratio (OR) and conditions such as angina (OR 8.9) and osteoporosis (OR 9.3) had the highest impact on SRH while pollen allergies (OR .97) and atopic eczema (OR 1.1) had low impact. Comparing the unadjusted OR with the base model showed that the OR was lower when controlling for each comorbid disease against all others. Diabetes had an OR of 4.7, but it is 3.1 when controlling for other diseases, meaning that comorbid disease explained part of its total effect. Glaucoma had an OR at 1.8 unadjusted and 0.8 adjusted. This means that even though we initially found that all comorbid disease was associated with a lower SRH, this association was not always explained by the condition itself but by other comorbid diseases.

For most comorbid conditions, the negative effect was weaker when controlling for mental health. This means that mental conditions explain part of the negative impact. Some conditions were not affected by mental conditions, e.g. asthma (OR 1.7) and diabetes (OR 3.0). We also see that significant symptoms have a large negative effect on SRH (OR 17.7), controlled for all comorbid conditions.

The full contextual model controls for all variables including age and gender. The main effects on SRH were comorbid conditions, mental health, and age. Here, angina, myocardial infarction, stroke, and osteoporosis had a much lower OR, mainly because age explains part of the effect. The effect of age implies that the persons react differently to illness with increasing age. Age had a negative impact on SRH with an OR 8.9 for subjects older than 80 years. Although men on average reported higher levels of SRH (2.9 vs. 2.8 for women), the contextual model indicated that males were associated with a 5% negative impact (OR 1.05) on SRH as compared to females in the fitted model. Significant mental health symptoms were associated with a substantial negative effect (OR 20.8).

Establishing the comorbidity index

Table 2 shows the Health Impact Index with weights assigned to each comorbid condition based on the full contextual model. The HII is the total sum of the assigned weights for all the conditions the subject has. We observed two contrasts to indexes based on death as outcome: Diseases that were not classified as comorbid conditions according to Charlson et al. were significantly related to SRH [4, 5]. Diseases were also weighted differently, indicating that mortality does not explain comorbid effect on SRH.

Table 2. Weighted health impact of comorbid physical conditions.

Comorbid conditions Assigned weight
Hypersensitivity 1
Psoriasis 1
Food allergies 1
Chronic bronchitis 1
Migraine 1
Urinary incontinence 1
Duod. ulcer 2
Asthma 2
Thyroid 2
Ventricular ulcer 2
Arthritis 2
Myocardial infarction 2
Cerebrovascular stroke 2
Diabetes 2
Osteoporosis 3
Angina 3
Rheumatoid arthritis 3
Fibromyalgia 6
Parkinson's disease 13

Assigned weights for each condition the participant has. The total equals the score. A patient with angina (3) and diabetes (2) will have a full contextual score of 3+2 = 5.

Validating the comorbidity index

The health impact index was significantly related to how well people scored their SRH (RS = -0.360, p <.001). We also found that SRH was significantly related to the Charlson Comorbidity Index (RS = -0.250, p <.001). However, by excluding all individuals classified as “not ill”, the relation between SRH and HII was strengthened (RS = -0.421, p <.001), while the relation between SRH and Charlson’s index was attenuated (RS = -0.141, p <.001). It shows that CCI does not correctly assess SRH, especially concerning the presence of comorbid conditions.

Table 3 shows the results from the ordinal regression model in Step 4, using HII as variable instead of the specific medical diagnosis. We see that HII had a negative effect on SRH in the fitted model. Fig 1 is based on the ordinal regression model and visualizes how increasing HII implied reduced SRH levels. We also observe that mental health and age are significant factors. We find no significant gender differences.

Table 3. The results from the ordinal regression model showing the impact of comorbid disease on SRH controlled for mental health symptoms, gender, and age.

Full contextual model with HII
Coef. Std. Err. z P>z [95% Conf. Interval]
Health Impact Index -0.249 0.006 -42.030 <.001 -0.260 -0.237
Mental Health Index -1.915 0.036 -53.550 <.001 -1.985 -1.845
Age -0.048 0.001 -48.270 <.001 -0.049 -0.046
Gender -0.036 0.027 -1.340 0.180 -0.088 0.017
/threshold1 -10.566 0.110 -10.781 -10.351
/threshold2 -6.682 0.083 -6.844 -6.520
/threshold3 -3.330 0.073 -3.473 -3.188

Log likelihood = -22364.373, LR chi2(4) = 9817.75, p <.0001

Fig 1. Category probability across HII score.

Fig 1

The figure shows how increased comorbid strain was associated with a probability of scoring at lower levels on the SRH scale.

Table 4 shows the comparison of the estimated and reported SRH from Steps 4–6 of the analysis. Figs 2 and 3 visualize the comparison of observed Self-Rated Health and predicted Self-Rated Health. We found no significant difference at a significance level of .05 for either the FHI panel (z = 1.007, p = 0.314) or the Tromsø 4 panel (z = 1.254, p = 0.210). This means that the model predictions are not significantly different from the observations.

Table 4. Comparison of observed and predicted Self-Rated Health.

Tromsø 4 panel a FHI panel b
Observed SRH (Mean) Predicted SRH (Mean) Count Observed SRH (Mean) Predicted SRH (Mean) Count
Not ill 3.00 3.00 12.982 3.02 3.18 176
Mildly ill 2.84 2.85 6.881 3.11 3.10 482
Moderately ill 2.49 2.54 2.824 2.87 2.88 97
Seriously ill 2.17 2.20 2.552 2.28 2.33 39

a. Wilcoxon signed rank matched pairs: z = 1.254, P = 0.2100

b. Wilcoxon signed rank matched pairs: z = 1.007, P = 0.3137

Fig 2. Predicted category distribution based on the ordinal regression model in the reference populations versus the health impact score.

Fig 2

Dashed lines represent the observed category distribution. Visual inspection shows that the observed category distributions are similar to those predicted.

Fig 3. Comparison of observed and predicted category distribution.

Fig 3

Dashed lines represent the observed SRH. The figure shows how SRH decreases with increasing comorbidity, and the difference between predicted and observed SRH.

Discussion

We found that disease had a varied but consistent negative impact on SRH. The regression models show how part of this effect was explained by comorbidity as well as age, gender and mental health symptoms. Comorbidity, increasing age and presence of mental health symptoms were associated with the probability of lower SRH. Females scored lower on SRH than men. Based on these findings, we constructed an index (HII) that estimates the comorbid strain on SRH, controlling for gender, age, mental health symptoms and other diseases. When applying the index to both the reference and validation population, our estimation and the observed SRH showed no significant differences.

Our findings concur with other studies that focus on the association between SRH and bio-medical variables. Specific medical conditions represent one crucial biological pathway that affects SRH; however, even when controlling for comorbid disease, SRH remains an independent predictor of mortality [14]. A second biological pathway that has been debated is the associations between SRH and more objective health measures and known health risk factors (e.g. resting heart rate, blood pressure, cholesterol, BMI, and endocrine measures). Although the effect of SRH attenuates when such variables are controlled, SRH remains an independent variable for future health outcomes [15, 16, 20, 3840]. The literature on self-reported health suggests that self-ratings of health are produced in a cognitive process that is inherently subjective and contextual but that the basis of self-rated health lies in the biological and physiological state of the individual organism, which might explain why it predicts mortality and other health outcomes [14].

We know from our literature review that the association between SRH and future health outcomes becomes stronger when combined with other health measures such as specific medical conditions, biological markers as well as mental health and social context [12, 1416]. The contribution of this study is to provide a method to include specific medical conditions with a variable that is related to comorbid strain on self-reported health.

Current methods, e.g. CCI, use mortality as a measure of general health status. The alternative approach, reported in this article, is to classify patients with comorbid disease according to the impact on SRH. Both methods are concerned with health loss due to comorbid disease, but the health impact index (HII) estimates the comorbid effect on SRH as the outcome of interest instead of death. HII has thus the potential to measure health along a broad spectrum of health-related variables. This implies not only that other diseases come into focus but also that the severity is weighted differently from mortality-based methods.

We found that CCI was also associated with SRH; however, the association was attenuated when focusing on comorbid disease. The reason CCI predicts SRH is that it identifies some conditions that have a negative impact on SRH. There will consequently be a difference between those with CCI = 0 (n = 19,586) and all those without (n = 5,653). CCI was designed to control for comorbid conditions when survival/mortality is the outcome of interest. Consequently, it cannot be expected to address the problem of comorbid disease as a confounder with other outcomes.

The methodological approach represented by HII is easy to use and to assess presence and severity of comorbid disease. For longitudinal designs, patients could enter with comorbid conditions or the conditions may arise during the time of follow-up. Our study uses HII as a continuous variable to predict SRH. For most clinical studies, it should be possible to stratify the population into 2–5 groups based on HII. In a general population, participants classified as ‘not ill’ (HII = 0) could serve as the reference group. In follow-up studies, it is an alternative to stratify by change/no change in HII.

One advantage of an SRH-based index is that it allows comparison of conditions that do not necessarily translate into mortality. It is, therefore, possible to pursue health impact on social and psychological variables. We found significant associations between SRH and mental health. HSCL-10 is particularly sensitive to anxiety and depression [33, 34]. It should be possible to construct a similar comorbidity index for mental health conditions.

Comorbidity indexes have previously been applied by health planners and policy makers to estimate risk and future health costs [6, 8, 9]. SRH is a well-established, simple, patient-centered tool for the assessment of illness in the context of multiple chronic disease diagnoses. It has also been suggested that SRH should guide clinicians when prioritizing patients, based on its ability to predict future health outcomes and use of health services [1]. However, since SRH is self-reported, it might become biased if patients know their responses will be connected to individual rights and access to health services. The use of HII could assist clinicians and health policy makers to prioritize at both the group and individual level, e.g. those registering with three or more diseases and/or with poorer self-rated health may warrant further assessment and intervention to improve their physical and subjective health [1]. To our knowledge, it is not a systematic practice to assess comorbid health strain. The next step would be to show that it has clinical significance in a follow-up study.

A balanced health assessment would lead to emphasis on of the phenomenon of comorbidity in clinical care, epidemiology, and health services [2], because it allows for comparison of different phenomena that do not necessarily translate into mortality, but still translate into health [12, 14].

Limitations

Although this study, to our knowledge, is the first to validate a comorbidity index based on SRH, it could be further developed. The Tromsø Study contains a wide variety of diagnoses, but lacks information on degree of severity. It is particularly relevant to cancer diagnoses. The low score of the cancer survivors (2.8) is interesting; despite being the “emperor of all maladies” [41] it has a rather small impact on SRH. One explanation is that the condition includes all cancer diagnoses, including fully recovered/survivors. In contrast, fibromyalgia, osteoporosis, and angina are not conditions associated with high mortality, and yet they influence the SRH to a greater degree, showing that mortality risk and SRH are separate dimensions of health. In a preliminary analysis of those who died within two years and 20 years of the study, the SRH was 2.2 and 2.4, respectively. It is comparable to the myocardial and vascular disease group; however, surviving (>20 years) with the diagnosis still lowers the SRH (2.7). This indicates that being diagnosed with cancer in itself could belong in the index but we need data that differentiates the severity of the diagnosis.

Parkinson’s disease is a limiting case. It is the strongest finding with an OR of 12.6. Even though it is based on just 20 cases, it is highly significant (p <.001) but with a wide confidence interval (3.0–53.0). Steps 3–6 were run with and without Parkinson. It did not affect any of our estimates. Based on the confidence interval, it should at least acquire a weight of 3. Accordingly, we have kept it in the index but more data would be preferable.

All ordinal models were tested for proportional odds (PO) assumption with a 1000 random sample and with separate binary, ordinal regression models for each cutoff point. PO implies that the OR is the same across the categories. PO is a conservative criterion and sensitive to a large number of variables, many participants, and interactions between variables [36] and yet the assumption was fulfilled for all except for myocardial infarction and angina. Partial proportional odds models were run for these conditions. The OR at the middle threshold represents the median value for both.

Power calculations for the validation population show that with a power of 80% at an alpha level of .05, the test is sensitive to a delta of .10 [42]. The reported mean difference was .025 that is within this limit with a good margin.

Conclusion

Comorbid strain on health can be measured by using either survival or self-reported health as outcome of interest. CCI estimates comorbid mortality while HII estimates the comorbid impact on SRH. HII outperforms CCI in predicting SRH, especially in the group with a comorbid disease. We conclude that the health impact index should be used when self-reported health is not available, and well-being or quality of survival/life is the outcome of interest. The result of utilizing SRH as the basis for the impact of comorbidity on health could be population health research that does not focus solely on health as absence of disease but also on the well-being of living with infirmity and disease.

Acknowledgments

We thank both the reviewers for their constructive criticism. We thank professor Tom Wilsgaard for his guidance and constructive suggestions.

Data Availability

We received the data from The Tromsø Study. The data contain sensitive health information about the participants. Data cannot be made publicly available without compromising participant confidentiality and privacy. Directives from the Research ethical committee and The Norwegian Data Protection Authority thus prohibits us from making the minimal data set publicly available. Data is available from The Tromsø study for researchers who meet the criteria for access to confidential data (https://en.uit.no/prosjekter/prosjekt?p_document_id=80172). Readers may also contact Professor Inger Njølstad, inger.njolstad@uit.no, to request the data or receive a confirmation that data will be available upon request to all interested researchers. Furthermore, all variables are described in the NESSTAR database, http://tromsoundersokelsen.uit.no/webview/.

Funding Statement

UiT The Arctic University of Norway funded the study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Mavaddat N, Valderas JM, van der Linde R, Khaw KT, Kinmonth AL. Association of self-rated health with multimorbidity, chronic disease and psychosocial factors in a large middle-aged and older cohort from general practice: a cross-sectional study. BMC family practice. 2014;15(1):185. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Valderas JM, Starfield B, Sibbald B, Salisbury C, Roland M. Defining comorbidity: implications for understanding health and health services. The Annals of Family Medicine. 2009;7(4):357–63. 10.1370/afm.983 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Pentakota SR, Rajan M, Fincke BG, Tseng C-L, Miller DR, Christiansen CL, et al. Does diabetes care differ by type of chronic comorbidity? An evaluation of the Piette and Kerr framework. Diabetes care. 2012;35(6):1285–92. 10.2337/dc11-1569 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. Journal of Clinical Epidemiology. 1994;47(11):1245–51. [DOI] [PubMed] [Google Scholar]
  • 5.Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. Journal of Chronic Diseases. 1987;40(5):373–83. [DOI] [PubMed] [Google Scholar]
  • 6.Needham DM, Scales DC, Laupacis A, Pronovost PJ. A systematic review of the Charlson comorbidity index using Canadian administrative databases: a perspective on risk adjustment in critical care research. Journal of Critical Care. 2005;20(1):12–9. [DOI] [PubMed] [Google Scholar]
  • 7.de Groot V, Beckerman H, Lankhorst GJ, Bouter LM. How to measure comorbidity: a critical review of available methods. Journal of clinical epidemiology. 2003;56(3):221–9. [DOI] [PubMed] [Google Scholar]
  • 8.D'Hoore W, Bouckaert A, Tilquin C. Practical considerations on the use of the charlson comorbidity index with administrative data bases. Journal of Clinical Epidemiology. 1996;49(12):1429–33. [DOI] [PubMed] [Google Scholar]
  • 9.Charlson M, Wells MT, Ullman R, King F, Shmukler C. The Charlson Comorbidity Index Can Be Used Prospectively to Identify Patients Who Will Incur High Future Costs. PloS one. 2014;9(12):e112479 10.1371/journal.pone.0112479 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Ganna A, Ingelsson E. 5 year mortality predictors in 498 103 UK Biobank participants: a prospective population-based study. The Lancet. 2015. [DOI] [PubMed] [Google Scholar]
  • 11.Hardy MA, Acciai F, Reyes AM. How Health Conditions Translate into Self-Ratings: A Comparative Study of Older Adults across Europe. Journal of Health and Social Behavior. 2014;55(3):320–41. 10.1177/0022146514541446 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Mavaddat N, Kinmonth AL, Sanderson S, Surtees P, Bingham S, Khaw KT. What determines Self-Rated Health (SRH)? A cross-sectional study of SF-36 health domains in the EPIC-Norfolk cohort. Journal of Epidemiology and Community Health. 2011;65(9):800–6. 10.1136/jech.2009.090845 [DOI] [PubMed] [Google Scholar]
  • 13.Mikolajczyk RT, Brzoska P, Maier C, Ottova V, Meier S, Dudziak U, et al. Factors associated with self-rated health status in university students: a cross-sectional study in three European countries. BMC public health. 2008;8(1):215. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Jylhä M. What is self-rated health and why does it predict mortality? Towards a unified conceptual model. Social Science & Medicine. 2009;69(3):307–16. [DOI] [PubMed] [Google Scholar]
  • 15.Kaplan GA, Goldberg DE, Everson SA, Cohen RD, Salonen R, Tuomilehto J, et al. Perceived health status and morbidity and mortality: Evidence from the Kuopio Ischaemic Heart Disease Risk Factor Study. International journal of epidemiology. 1996;25(2):259–65. [DOI] [PubMed] [Google Scholar]
  • 16.Idler EL, Benyamini Y. Self-rated health and mortality: a review of twenty-seven community studies. Journal of health and social behavior. 1997:21–37. [PubMed] [Google Scholar]
  • 17.Weiss N. All-cause mortality as an outcome in epidemiologic studies: proceed with caution. European journal of epidemiology. 2014;29(3):147–9. 10.1007/s10654-014-9899-y [DOI] [PubMed] [Google Scholar]
  • 18.Miilunpalo S, Vuori I, Oja P, Pasanen M, Urponen H. Self-rated health status as a health measure: The predictive value of self-reported health status on the use of physician services and on mortality in the working-age population. Journal of Clinical Epidemiology. 1997;50(5):517–28. [DOI] [PubMed] [Google Scholar]
  • 19.McHorney CA, Ware JE Jr, Raczek AE. The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and Clinical Tests of Validity in Measuring Physical and Mental Health Constructs. Medical care. 1993;31(3):247–63. [DOI] [PubMed] [Google Scholar]
  • 20.Halford C, Ekselius L, Anderzen I, Arnetz B, Svärdsudd K. Self-rated health, life-style, and psychoendocrine measures of stress in healthy adult women. Upsala journal of medical sciences. 2010;115(4):266–74. 10.3109/03009734.2010.496910 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Hirve S, Oud JL, Sambhudas S, Juvekar S, Blomstedt Y, Tollman S, et al. Unpacking Self-Rated Health and Quality of Life in Older Adults and Elderly in India: A Structural Equation Modelling Approach. Soc Indic Res. 2014;117(1):105–19. [Google Scholar]
  • 22.Craigs CL, Twiddy M, Parker SG, West RM. Understanding causal associations between self-rated health and personal relationships in older adults: A review of evidence from longitudinal studies. Archives of gerontology and geriatrics. 2014;59(2):211–26. 10.1016/j.archger.2014.06.009 [DOI] [PubMed] [Google Scholar]
  • 23.Eriksson I, Undén A-L, Elofsson S. Self-rated health. Comparisons between three different measures. Results from a population study. International journal of epidemiology. 2001;30(2):326–33. [DOI] [PubMed] [Google Scholar]
  • 24.Moen P, Dempster-McClain D, Williams RM Jr. Successful aging: A life-course perspective on women's multiple roles and health. American Journal of Sociology. 1992:1612–38. [Google Scholar]
  • 25.Vingilis ER, Wade TJ, Seeley JS. Predictors of Adolescent Self-rated Health: Analysis of the National Population Health Survey. Canadian Journal of Public Health / Revue Canadienne de Sante'e Publique. 2002;93(3):193–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Franks P, Gold MR, Fiscella K. Sociodemographics, self-rated health, and mortality in the US. Social Science & Medicine. 2003;56(12):2505–14. [DOI] [PubMed] [Google Scholar]
  • 27.Shetterly SM, Baxter J, Mason LD, Hamman RF. Self-rated health among Hispanic vs non-Hispanic white adults: the San Luis Valley Health and Aging Study. American journal of public health. 1996;86(12):1798–801. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Jylhä M, Guralnik JM, Ferrucci L, Jokela J, Heikkinen E. Is self-rated health comparable across cultures and genders? The Journals of Gerontology Series B: Psychological Sciences and Social Sciences. 1998;53(3):S144–S52. [DOI] [PubMed] [Google Scholar]
  • 29.Idler EL, Benyamini Y. Self-rated health and mortality: a review of twenty-seven community studies. J Health Soc Behav. 1997;38(1):21–37. [PubMed] [Google Scholar]
  • 30.Benyamini Y. Why does self-rated health predict mortality? An update on current knowledge and a research agenda for psychologists. Psychology & health. 2011;26(11):1407–13. [DOI] [PubMed] [Google Scholar]
  • 31.Bishop F, Yardley L. The development and initial validation of a new measure of lay definitions of health: The wellness beliefs scale. Psychology and Health. 2010;25(3):271–87. 10.1080/08870440802609980 [DOI] [PubMed] [Google Scholar]
  • 32.Jacobsen BK, Eggen AE, Mathiesen EB, Wilsgaard T, Njølstad I. Cohort profile: The Tromsø Study. International journal of epidemiology. 2012;41(4):961–7. 10.1093/ije/dyr049 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Derogatis LR, Lipman RS, Rickels K, Uhlenhuth EH, Covi L. The Hopkins Symptom Checklist (HSCL): A self‐report symptom inventory. Behavioral science. 1974;19(1):1–15. [DOI] [PubMed] [Google Scholar]
  • 34.Søgaard AJ, Bjelland I, Tell GS, Røysamb E. A comparison of the CONOR Mental Health Index to the HSCL-10 and HADS. Norsk epidemiologi. 2003;13(2):279–84. [Google Scholar]
  • 35.Kvamme J-M, Wilsgaard T, Florholmen J, Jacobsen BK. Body mass index and disease burden in elderly men and women: the Tromsø Study. European journal of epidemiology. 2010;25(3):183–93. 10.1007/s10654-009-9422-z [DOI] [PubMed] [Google Scholar]
  • 36.O'Connell AA. Logistic regression models for ordinal response variables: Sage Publications; Thousand Oaks, California:; 2006. [Google Scholar]
  • 37.Gelman A, Hill J. Data analysis using regression and multilevel/hierarchical models: Cambridge University Press; 2006. [Google Scholar]
  • 38.Haring R, Feng Y-S, Moock J, Völzke H, Dörr M, Nauck M, et al. Self-perceived quality of life predicts mortality risk better than a multi-biomarker panel, but the combination of both does best. BMC medical research methodology. 2011;11(1):103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Halford C, Welin C, Bogefeldt J, Wallman T, Rosengren A, Bardel A, et al. A population-based study of nearly 15 000 observations among Swedish women and men during 1973–2003. BMJ open. 2012;2(6). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Halford C, Anderzén I, Arnetz B. Endocrine measures of stress and self-rated health: A longitudinal study. Journal of psychosomatic research. 2003;55(4):317–20. [DOI] [PubMed] [Google Scholar]
  • 41.Mukherjee S. The emperor of all maladies: a biography of cancer. New York: Scribner; 2010. [Google Scholar]
  • 42.Lehmann EL, D’Abrera H. Nonparametrics: Statistical Methods Based on Ranks (rev. ed.) Prentice-Hall; Englewood Cliffs, NJ: 1998;292:23. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

We received the data from The Tromsø Study. The data contain sensitive health information about the participants. Data cannot be made publicly available without compromising participant confidentiality and privacy. Directives from the Research ethical committee and The Norwegian Data Protection Authority thus prohibits us from making the minimal data set publicly available. Data is available from The Tromsø study for researchers who meet the criteria for access to confidential data (https://en.uit.no/prosjekter/prosjekt?p_document_id=80172). Readers may also contact Professor Inger Njølstad, inger.njolstad@uit.no, to request the data or receive a confirmation that data will be available upon request to all interested researchers. Furthermore, all variables are described in the NESSTAR database, http://tromsoundersokelsen.uit.no/webview/.


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES