Skip to main content
BMJ - PMC COVID-19 Collection logoLink to BMJ - PMC COVID-19 Collection
. 2021 Nov 18;11(11):e053281. doi: 10.1136/bmjopen-2021-053281

Stratification of the risk of developing severe or lethal Covid-19 using a new score from a large Italian population: a population-based cohort study

Giovanni Corrao 1,2,, Federico Rea 1,2, Flavia Carle 2,3, Salvatore Scondotto 2,4, Alessandra Allotta 4, Vito Lepore 5, Antonio D'Ettorre 5, Cinzia Tanzarella 5, Patrizia Vittori 6, Sabrina Abena 6, Marica Iommi 3, Liana Spazzafumo 2,7, Michele Ercolanoni 8, Roberto Blaco 8, Simona Carbone 9, Cristina Giordani 9, Dario Manfellotto 10, Massimo Galli 11, Giuseppe Mancia 12,13; the 'Monitoring and Assessing care Pathways (MAP)' working group of the Italian Ministry of Health
PMCID: PMC8602929  PMID: 34794995

Abstract

Objectives

To develop a population-based risk stratification model (COVID-19 Vulnerability Score) for predicting severe/fatal clinical manifestations of SARS-CoV-2 infection, using the multiple source information provided by the healthcare utilisation databases of the Italian National Health Service.

Design

Retrospective observational cohort study.

Setting

Population-based study using the healthcare utilisation database from five Italian regions.

Participants

Beneficiaries of the National Health Service, aged 18–79 years, who had the residentship in the five participating regions. Residents in a nursing home were not included. The model was built from the 7 655 502 residents of Lombardy region.

Main outcome measure

The score included gender, age and 29 conditions/diseases selected from a list of 61 conditions which independently predicted the primary outcome, that is, severe (intensive care unit admission) or fatal manifestation of COVID-19 experienced during the first epidemic wave (until June 2020). The score performance was validated by applying the model to several validation sets, that is, Lombardy population (second epidemic wave), and the other four Italian regions (entire 2020) for a total of about 15.4 million individuals and 7031 outcomes. Predictive performance was assessed by discrimination (areas under the receiver operating characteristic curve) and calibration (plot of observed vs predicted outcomes).

Results

We observed a clear positive trend towards increasing outcome incidence as the score increased. The areas under the receiver operating characteristic curve of the COVID-19 Vulnerability Score ranged from 0.85 to 0.88, which compared favourably with the areas of generic scores such as the Charlson Comorbidity Score (0.60). A remarkable performance of the score on the calibration of observed and predicted outcome probability was also observed.

Conclusions

A score based on data used for public health management accurately predicted the occurrence of severe/fatal manifestations of COVID-19. Use of this score may help health decision-makers to more accurately identify high-risk citizens who need early preventive or treatment interventions.

Keywords: COVID-19, health policy, public health


Strengths and limitations of this study.

  • The COVID-19 Vulnerability Score (CVS), based on demographic (age and gender) and clinical (29 conditions and diseases) predictors of the COVID-19 severity, may be easily obtained from electronic health databases covering beneficiaries of the National Health Service.

  • The CVS was developed and validated on a large (more than 15 million Italian individuals) and unselected population.

  • The CVS was validated across different temporal (first and second epidemic wave) and geographical (five Italian regions) conditions.

  • Predictors were restricted to those routinely collected and available in the Italian administrative databases. Thus, education, functional status and socioeconomic information were not included.

Introduction

The pandemic spread of the SARS-CoV-2 has dramatically exceeded the diagnostic and treatment capabilities of virtually all countries around the world. This has fuelled a debate on the need to establish priority criteria that might identify patients with COVID-19 at greater risk of progressing to hospitalisation or a fatal event, in order to make them the preferential recipients of currently available effective treatment strategies, the goal being to reduce the number of deaths and prevent collapse of hospital facilities. The problem involves who should receive early diagnostic testing, who can be treated outside hospital among infected people, who should be given new, sometimes expensive and necessarily rationed drugs (eg, monoclonal antibodies1) and who should be selected for early vaccination. The case of vaccination is particularly delicate because demand will outstrip supply for many months ahead in low/middle-income countries.

Associations between certain chronic diseases and conditions and serious/critical/fatal clinical manifestations of the SARS-CoV-2 infection have been reported from several studies,2–4 which potentially helps to identify the multiple prognostic factors that are involved in COVID-19. However, although some factors have been accepted as ‘established’ by the scientific community, their overall predictive value has not been robustly evaluated.5 It should also be considered that basing predictions on a list of individual conditions or diseases does not take into account that comorbidities can make the global risk different from that predictable by individual contributions. Finally, some predictive scores have been developed and validated in hospital care settings,6 7 their use requiring specialised image acquisition or sophisticated laboratory examinations, which may not be readily applicable in a population context. A valuable goal would therefore be to develop a score that could reliably predict the risk of progression of COVID-19 to severe or lethal forms, using simple and easily collectable information.

Our population-based study was performed under the auspices of the Italian Health Ministry. We aimed to develop and validate a novel score predictive of severe/fatal clinical manifestations of the SARS-CoV-2 infection using the multiple source information provided by the healthcare utilisation databases of the Italian National Health Service (NHS).

Methods

Setting

This study was based on the NHS beneficiaries of five Italian regions that voluntarily joined the protocol and contributed to the data collection. The regions are located in Northern (Valle d’Aosta and Lombardy), Central (Marche), Southern (Puglia) Italy and in the Italian islands (Sicily). Overall, the data covered nearly 20.5 million people (34% of the entire Italian population) who, during 2020, experienced 712 408 cases of COVID-19, with a total of 31 957 deaths. Selected features of the participating regions are reported in online supplemental table S1.

Supplementary data

bmjopen-2021-053281supp001.pdf (77.6KB, pdf)

Data sources

All Italian citizens have equal access to healthcare services provided by the NHS. Computerised information systems on the provided services have been created within each of the 21 Italian regions and autonomous provinces, the related regional healthcare databases including (1) demographic and administrative data of residents who receive NHS assistance (the NHS beneficiaries, practically coinciding with the entire resident population); (2) hospital discharge records reporting information on the primary diagnosis, as well as on up to five coexisting conditions and procedures, coded according to the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) classification system (http://icd9.chrisendres.com/); and (3) drug prescriptions reimbursed by the NHS, coded according to the Anatomical Therapeutic Chemical (ATC) classification system (https://www.whocc.no/atc_ddd_index/). Since the start of the COVID-19 pandemic, almost all regions established, with the coordination of the National Health Institute, a population-based registry of patients with a confirmed diagnosis of infection with SARS-CoV-2, and, among these, those who were admitted to intensive care units or died. In the present study, these various types of data were interconnected by using for each citizen a single identification code in all databases. To preserve privacy, each identification code was automatically deidentified. Analyses of the regional databases were performed under the rule that the inverse process, that is, patient identification, was allowed only to the Regional Health Authority upon request from the judicial authority.

Predictors of COVID-19 severity

Taking into consideration the morbidity and mortality predictors reported in epidemiological studies,5 7–9 as well as comorbidity scores widely used worldwide or tuned to the Italian population (the Charlson Comorbidity Index10 and the Multisource Comorbidity Score (MCS), developed for the general Italian population11), we identified 61 candidate predictors. Twenty-seven candidate predictors were traced from inpatients diagnostic codes, 5 from outpatients who were prescribed drugs, and the remaining 29 from both diagnostic and therapeutic codes, depending on the availability of specific diagnostic codes and drug therapies. Four of us (FR, DM, MG and GM) independently attributed the ICD-9 and ATC codes to the individuals in whom 1 or more of the 61 candidate predictors were detectable. Discrepancies were resolved in conference. The list of candidate predictors, and the corresponding codes, are reported in online supplemental table S2.

Score development

Since among the five participating regions, Lombardy has the largest resident population (16% of the entire Italian population) and had been hit by the pandemic more than any other region during the months between March and June 2020 (in that period, 48% of the COVID-19 deaths registered in Italy occurred in Lombardy), we used the data from the first epidemic wave that hit Lombardy to develop the score.

We included all the NHS beneficiaries who on 21 February 2020 were residents in Lombardy for at least 2 years, were aged 18–79 years and did not reside in a nursing home. Multivariate logistic regression was fitted for investigating the association between gender, four age classes (18–45, 46–59, 60–69 and 70–79 years) plus the above-mentioned 61 candidate predictors, and the odds of experiencing the outcome of interest, which was the composite of hospitalisation in an intensive care unit or death with a COVID-19 diagnosis, up to 30 June 2020. Candidate predictors entered as dichotomous variables in the model, with value 1 or 0 according to whether the specific condition was or was not recorded at least once within the 781 days prior to the baseline period, that is, from 1 January 2018 until 20 February 2020. The least absolute shrinkage and selection operator (LASSO) method was applied for selecting the conditions able to predict the outcome.12 Finally, a score was assigned to each condition selected with the LASSO method by using the coefficient estimated from the model. The coefficient was converted into a score by multiplication by 10 and rounding to the nearest whole number. Scores were sequentially summed to produce a total aggregate score. The index so obtained was termed COVID-19 Vulnerability Score (CVS). To verify the extension of the association between the increasing value of the score and the increasing occurrence of severe/fatal forms of COVID-19, CVS categories of width 10 was plotted against the outcome incidence. The prevalence of the Lombardy cohort members according to CVS categories was also calculated. Restricted cubic spline with 3 df was used to represent the corresponding smoothed trends.13

Score validation and performance

To validate the model across different temporal and geographical conditions (ie, to assess the performance of CVS for different treatment options, climatic characteristics, intensity of the epidemic spread, etc), the score developed from the Lombardy cohort was applied to several validation sets selected by using the same inclusion/exclusion criteria of the original (Lombardy) one. One validation set consisted of the cohort of Lombardy NHS beneficiaries who were free from COVID-19 up to 1 July 2020, after which date a new observation period was started and continued until censorship at the outcome occurrence (intensive care admissions or deaths) or at 31 December 2020, whatever happened first. Other validation sets consisted of NHS beneficiaries from each of the other regions included in the study. For these other regional cohorts, observations started on 1 March 2020 and were censored at the outcome occurrence or at 31 December 2020, whatever happened first.

The performance of CVS was assessed through discrimination and calibration. Discrimination was evaluated by the receiver operating characteristic (ROC) curves and the corresponding underlying areas (area under the ROC curves (AUCs)).14 Calibration plots displayed observed versus predicted outcome probabilities. The Hosmer-Lemeshow goodness-of-fit test modified by Yu et al 15 was used for testing the null hypothesis of agreement between observed and predicted outcome probabilities.

Patient and public involvement

No patient was involved in setting the research question or the outcome measures, nor were patients involved in developing plans for design or implementation of the study. No patients were asked to advise on interpretation or writing up of results.

Results

COVID-19 Vulnerability Score

The 31 demographic and clinical conditions that significantly contributed to CVS are reported in table 1. As expected, older age was the major contributor to the outcome of interest, but also male gender gave a relevant contribution. Nearly 40% of NHS beneficiaries had at least one clinical condition contributing to CVS. Diabetes (especially if under insulin therapy), psychosis, coronary and peripheral vascular disease, gout, use of corticosteroids, HIV infection, malignancies and anaemias were the most relevant contributors to the outcome. However, other 19 clinical conditions (ranging across all major nosologic macrocategories) contributed to CVS.

Table 1.

Prevalence of male gender, age categories and 29 conditions/diseases contributing to the COVID-19 Vulnerability Score (CVS); for each listed contributor, the outcome incidence among the exposed people, the OR (and 90% CI) and the corresponding weight of the contribution to CVS are reported

Number (%) Number of outcome events Incidence every 10 000 OR* 90% CI* Weight†
Male gender 3 797 636 (49.6) 6849 18.0 3.07 2.95 to 3.19 11
Age ≤45 3 111 426 (40.6) 271 0.9 1.00 Reference 0
Age 46–59 2 305 062 (30.1) 1435 6.2 5.95 5.36 to 6.62 18
Age 60–69 1 222 310 (16.0) 2506 20.5 15.62 14.09 to 17.32 27
Age 70–79 1 016 704 (13.3) 4948 48.7 27.64 24.96 to 30.61 33
HIV infection 31 300 (0.4) 154 49.2 1.52 1.33 to 1.74 4
Other infectious and parasitic diseases 42 422 (0.6) 443 104.4 1.37 1.26 to 1.49 3
Malignancies 177 024 (2.3) 1073 60.6 1.42 1.35 to 1.50 4
Diabetes without insulin therapy 278 785 (3.6) 1419 50.9 1.60 1.53 to 1.68 5
Insulin therapy 101 996 (1.3) 973 95.4 2.35 2.21 to 2.49 9
Obesity 16 571 (0.2) 103 62.2 1.34 1.13 to 1.58 3
Disorders of fluid, electrolyte and acid–base balance 8576 (0.1) 135 157.4 1.29 1.11 to 1.49 3
Gout 164 428 (2.2) 1518 92.3 1.57 1.50 to 1.66 5
Coagulation defects 3603 (0.1) 36 99.9 1.41 1.07 to 1.85 3
Anaemias 613 430 (8.0) 2228 36.3 1.51 1.45 to 1.58 4
Dementia/Alzheimer 12 671 (0.2) 145 114.4 1.26 1.09 to 1.46 2
Psychosis 138 034 (1.8) 684 49.6 1.94 1.80 to 2.08 7
Depression 588 688 (7.7) 1729 29.4 1.35 1.29 to 1.42 3
Parkinson’s disease and parkinsonism 40 885 (0.5) 274 67.0 1.21 1.09 to 1.34 2
Epilepsy and recurrent seizures 122 171 (1.6) 510 41.7 1.37 1.26 to 1.48 3
Other diseases of the nervous system and sense organs 35 495 (0.5) 253 71.3 1.26 1.13 to 1.40 2
Ischaemic heart disease/angina 91 539 (1.2) 845 92.3 1.18 1.11 to 1.26 2
Heart failure 21 840 (0.3) 428 196.0 1.30 1.18 to 1.43 3
Vascular diseases 14 936 (0.2) 217 145.3 1.17 1.04 to 1.32 2
Cerebrovascular diseases 35 205 (0.5) 333 94.6 1.12 1.02 to 1.23 1
Hypertension 796 044 (10.4) 3136 39.4 1.20 1.15 to 1.25 2
Coronary and peripheral vascular disease 658 737 (8.6) 2668 40.5 1.75 1.68 to 1.82 6
Oral anticoagulant agents 144 713 (1.9) 1221 84.4 1.39 1.32 to 1.47 3
COPD/asthma 20 034 (0.3) 268 133.8 1.15 1.03 to 1.28 1
Liver cirrhosis and other liver chronic diseases 29 484 (0.4) 177 60.0 1.31 1.16 to 1.49 3
Chronic kidney disease 17 109 (0.2) 371 216.8 1.32 1.20 to 1.46 3
Diseases of the skin and subcutaneous tissues 106 747 (1.4) 353 33.1 1.10 1.00 to 1.20 1
Chronic pain 191 442 (2.5) 1007 52.6 1.28 1.21 to 1.36 2
Corticosteroids 935 246 (12.2) 2588 27.7 1.62 1.55 to 1.68 5
Individuals without any of the 29 conditions above listed 4 600 012 (60.1) 1350 2.9

The analysis was based on the cohort of 7 655 502 beneficiaries of the Lombardy Region Health Service for at least 2 years, who on 21 February 2020 were alive, aged between 18 and 79 years and did not reside in a nursing home. During the first epidemic wave (until June 2020), this cohort experienced 9160 severe (intensive care unit admitted and mechanically ventilated via intubation) and/or fatal outcomes. The average incidence rate during the first wave was therefore 12.0 cases per 10 000 people at risk.

*OR, and 90% CI, estimated by multivariable logistic regression. ORs measured the strength of the association between the presence/absence of each of the listed contributors and the outcome odds.

†Weights were obtained from the coefficients of the logistic model; the latter were converted into scores by multiplying them by 10 and rounding them to the nearest whole number.

COPD, chronic obstructive pulmonary disease.

Figure 1A shows that the probability of experiencing the outcome of interest had a clear positive trend as CVS increased, the risk being lower than 0.05% for CVS value ≤29, progressing to 2% for a CVS value between 60 and 69, and reaching a much higher value (around 4%) for CVS values ≥80. Sixty-nine per cent of NHS beneficiaries had a CVS value ≤29, almost 30% ranged from 30 and 69, and less than 1% (0.16%) exhibited a CVS value ≥70 (figure 1B).

Figure 1.

Figure 1

Relationship between categories of COVID-19 Vulnerability Score and (A) the risk of occurrence of severe/fatal forms of COVID-19, (B) its distribution among National Health Service beneficiaries. Columns indicate the observed values (of risk and prevalence, respectively). Solid and dashed lines, respectively, represent the fitted cubic spline with the corresponding 5th and 95th percentiles. The analysis was based on the cohort of 7 655 502 beneficiaries of the Lombardy Region Health Service for at least 2 years, who on 21 February 2020 were alive, aged between 18 and 79 years and did not reside in a nursing home. During the first epidemic wave (until June 2020), this cohort experienced 9160 severe (intensive care unit admitted and mechanically ventilated via intubation) and/or fatal outcomes. The average incidence rate during the first wave was therefore 12.0 cases per 10 000 people at risk.

CVS performance

Figure 2A shows that the AUC of CVS was 0.89. This area compared favourably with the AUC of the models based on scores not specifically addressing COVID-19, the AUC values being 0.60 for the Charlson Comorbidity Index and 0.77 for MCS. The 95% CIs are not indicated in the figure because, due to the very large sample size, they practically coincided with the AUC values. As shown in figure 2B, the CVS AUC values were almost superimposable between the different regions participating in the study, that is, 0.88, 0.86, 0.86, 0.85 and 0.86 for Lombardy, Valle d’Aosta, Marche, Puglia and Sicily cohorts, respectively.

Figure 2.

Figure 2

Receiver operating characteristic (ROC) curves comparing discriminant power (A) of COVID-19 Vulnerability Score (CVS), Charlson Comorbidity Index (CCI) and Multisource Comorbidity Score (MCS) from the derivation set (B) of CVS from several validation sets. Derivation set (left box) was based on the cohort of 7 655 502 beneficiaries of the Lombardy Region Health Service for at least 2 years, who on 21 February 2020 were alive, aged between 18 and 79 years and did not reside in a nursing home. During the first epidemic wave (until June 2020), this cohort experienced 9160 severe (intensive care unit admitted and mechanically ventilated via intubation) and/or fatal outcomes. Validation sets (right box) were based on: (1) 7 575 924 resident in Lombardy whom observation started on 1 July 2020 and who experienced 2822 severe/fatal outcomes within 31 December 2020; (2) 92 267, 1 110 570, 3 012 754 and 3 649 518 beneficiaries of Valle d’Aosta, Marche, Puglia and Sicily regional health services, whom observation started on 1 March 2020 and who, respectively, experienced 173, 542, 1953 and 1541 severe/fatal outcomes within 31 December 2020.

Figure 3 shows that there was a good agreement between the observed and the predicted outcome probabilities, with the calibration intercept close to the ideal value of 0 and the recalibration slope close to the ideal value of 1 (0.93). The null hypothesis of agreement between observed and predicted frequencies could not be rejected according to the modified Hosmer-Lemeshow test.

Figure 3.

Figure 3

Calibration plot of observed (X-axis) versus predicted (Y-axis) risk of severe/fatal outcomes. The analysis was based on the pooled validation sets of 15 441 033 residents from Lombardy, Valle d’Aosta, Marche, Puglia and Sicily who experienced 7031 severe/fatal outcomes from starting (1 July 2020 in Lombardy, or 1 March 2020 in the other regions) until 31 December 2020.

Discussion

Our study shows that a score based on demographic and clinical information derived from healthcare utilisation data currently used throughout Italy for the management of NHS is able to stratify NHS beneficiaries aged 18–79 years for their risk to develop severe/fatal clinical manifestations of COVID-19. The score (developed in a very large number of individuals from several Italian regions) exhibited a significantly better discriminating power than the Charlson Comorbidity Index, that is, the most widely used comorbidity score10 which has been recently validated also for predicting mortality in patients with COVID-19 hospitalised for pneumonia.16 It also outperformed a comorbidity score validated by our group for the general Italian population and also found to be better than the Charlson Comorbidity Index. This allows to conclude that the score we developed (termed COVID-19 Vulnerability Score or CVS) can reliably identify people in whom age, gender and a variety of comorbidities interact to make them more at risk of the clinically severe and fatal manifestations of SARS-CoV-2 infection. This makes CVS a potentially useful tool for establishing priority in the future vaccination programmes for the general Italian population up to 79 years of age which has so far been based in a descending fashion on age alone as well as on individually listed conditions or diseases that have shown a greater prevalence of severe or lethal COVID-19 in clinical studies. CVS may also find a useful future application to the determination of priority access to the third dose of vaccine, or to the delivery of future treatment options, such as new antiviral agents and monoclonal antibodies, if their cost will be too high to allow an extended use.

Our study identified several prognostic factors that, in addition to age and gender, predict the severity of COVID-19 and are included among the medical illnesses and dispensed drugs retrievable in the healthcare utilisation database. Consistently with a recent meta-analysis,4 diabetes (mainly when under insulin therapy), cardiovascular disease (mainly coronary and peripheral vascular disease), hypertension, malignancies, chronic respiratory and kidney diseases, dementia and obesity were all associated with the COVID-19 outcome. People with HIV,17 and those who had a history of severe clinical manifestations of an infectious disease, including tuberculosis,18 also showed a significant association with the severity of COVID-19. Additionally, and according to other studies, we found that diseases of the neurological system (eg, epilepsy, recurrent seizures19 and Parkinson disease and parkinsonism20), of the gastrointestinal tract (eg, liver cirrhosis and other liver chronic diseases21), of metabolism (eg, gout22), of the skin (eg, psoriasis23), and of the blood and blood-forming organs (eg, coagulation defects24 and anaemias25) contributed to the COVID-19-related clinical frailty. We also confirmed the involvement in a greater risk of severe or lethal forms of COVID-19 of mental disorders, such as psychosis and depression26 as well as of recent dispensations of drugs with immunosuppressive properties (eg, corticosteroids27), agents against chronic pain (eg, narcotic analgesics28) or with an anticoagulant29 action. This confirms the now established notion that alterations of the structure and function of virtually all organs and systems of the body may adversely affect resistance to COVID-19. It should be emphasised that the association between the severity of COVID-19 and the dispensed drugs we found in our study is not in contrast with the use of some of these drugs for the treatment of COVID-19, because in our analysis, previous drug therapies were searched for to track background comorbidities and not to investigate their possible direct effect on the disease. In this context, it is likely that use of corticosteroids and other immunosuppressive agents reflected the existence of autoimmune diseases, while use of anticoagulants reflected the existence of atrial fibrillation, thromboembolic states or other cardiovascular disorders, which have been shown to reduce patients’ defence against the virus.30

Our study has implications for several aspects of the public health policy against COVID-19, the most important of which is the priority criteria to adopt for the third dose of vaccine to be delivered to the Italian population by the Italian Ministry of Health. As done in the first vaccination campaign, the plan is to offer an early cost-free priority third dose to people residing in a nursing home and aged 80 years or older. This has a strong rationale because of the 24 575 severe/fatal cases of COVID-19 registered in Lombardy during 2020, 12 593 (51%) occurred in people aged 80 years and older. Furthermore, in Italy, the average age of COVID-19 fatalities during the entire pandemic period has been reported to be 82 years, which means that in octogenarians and nonagenarians, search for and use of a risk score more complex than age alone may carry a limited practical advantage. However, this is not the case for the vaccination programme to be implemented in people aged 79 years or less, in which administration of the third dose vaccine is planned after completion of the third dose vaccination in older individuals. In these people, use of CVS may offer the possibility of identifying more accurately those at a high risk of development of a severe or lethal form of COVID-19 and thus to predispose their vaccination reinforcement at an earlier time. The same advantage can be foreseen for the criteria to adopt for the delivery of future treatment strategies such as new antiviral drugs or monoclonal antibodies, if current research will prove their life-saving role. In this case, the high cost of these treatments will make priority criteria for their use absolutely necessary.

The present study has several strengths and some limitations. An important strength is that our sample of NHS beneficiaries was not only extremely large but it also reflected an unselected population. Another strength is that the Italian healthcare utilisation database allows to track services provided by the NHS with considerable accuracy because providers must document services to claim reimbursement, and incorrect reports carry legal consequences. Finally, a remarkable finding of our study is that, although built from the Lombardy data collected during the first epidemic wave (ie, before the summer 2020), CVS performed similarly well during the second epidemic wave (ie, after the summer 2020), despite differences in treatment options for inpatients and outpatients as well as hospitalisation criteria compared with the first epidemic wave. It is also remarkable that the CVS performance was virtually superimposable in all regions of Italy, despite their different social features, climatic characteristics and intensity of the epidemic spread. This suggests that the advantages of the CVS score for stratification of the risk of COVID-19 complications extend across different temporal and geographical conditions.

The limitations are that the predictors of COVID-19 complications we searched for are restricted to those routinely collected and available in the administrative databases (the same for all regions of Italy), that is, hospital admissions and drug dispensed. Thus, educational factors, functional status, socioeconomic characteristics and other extraclinical variables that can affect the prognosis of patients with COVID-19 were not included. Our scoring system also did not capture the severity of associated comorbidities, health services and treatments supplied by private providers, and misdiagnosis (due to poor accuracy in reporting diagnoses and comorbidities) and upcoding of hospital records.

Finally, our approach may have failed to identify comorbidities that, although increasing the risk of severe/fatal clinical manifestations of COVID-19 limited social contacts, thereby favouring an escape from the SARS-CoV-2 virus infection of the individuals affected. However, because the purpose of our study was to identify individuals to which offer earlier protection, patients with a disease that makes them unexposed to the infection should receive later preventive interventions (ie, treatments or vaccination). Of course, exclusion from the scoring system of diseases so debilitating or incapacitating to limit social contacts but requiring a caregiver is a major limitation of our study.

Conclusion

In summary, we developed and validated a score derived from data used for public health management, which predicts severe/fatal outcomes of COVID-19 in a large number of beneficiaries of the Italian NHS more accurately than other available scores. Our findings show that this can be achieved by combined use of demographic (age and gender) and clinical (29 conditions/diseases) predictors of the COVID-19 outcome. Because of its performance, use of this score may help health decision-makers to achieve a more accurate identification of high-risk citizens who need early preventive interventions.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Collaborators: 'Monitoring and Assessing care Pathways' (MAP) working group (Italian Health Ministry, Health Planning Department): Italian Ministry of Health, Department of Health Planning: Donata Bellentani, Simona Carbone (coordinator), Carla Ceccolini, Angela De Feo, Cristina Giordani, Rosanna Mariniello, Modesta Visca; Department of Health Prevention: Natalia Magliocchetti, Giovanna Romano; External Expert: Antonio Lora, Paola Pisanti, Rinaldo Zanini. Polytechnic University of Marche (coordinator): Flavia Carle, Marica Iommi, Edlira Skrami. University of Milano-Bicocca, Laboratory of Healthcare Research & Pharmacoepidemiology: Anna Cantarutti, Giovanni Corrao, Matteo Monzio Compagnoni, Pietro Pugni, Federico Rea. Department of Epidemiology Lazio Region: Marina Davoli, Mirko Di Martino, Adele Lallo. Aosta Valley Region: Patrizia Vittori, Giuliana Vuillermin. Campania Region: Alfonso Bernardo, Anna Frusciante. Emilia Romagna Region: Laura Belotti, Rossana De Palma. Friuli Venezia Giulia Region: Andrea Di Lenarda, Marisa Prezza. Lazio Region: Danilo Fusco, Chiara Marinacci. Lombardy Region: Olivia Leoni. Marche Region: Liana Spazzafumo, Simone Pizzi. Molise Region: Lolita Gallo. Puglia Region: Ettore Attolini, Vito Lepore. Sicily Region: Salvatore Scondotto, Giovanni De Luca. Tuscany Region: Paolo Francesconi, Carla Rizzuti. Veneto Region: Francesco Avossa, Silvia Vigna. Research and Health Foundation (Fondazione ReS-Ricerca e Salute-): Letizia Dondi, Nello Martini, Antonella Pedrini, Carlo Piccinni. National Agency for Regional Health Services: Mimma Cosentino, Maria Grazia Marvulli. ANMCO (National Association of Hospital Cardiologists) Study Center: Aldo Maggioni.

Contributors: GC conceived the idea for this manuscript. GC, FR and FC designed the study. GC and GM drafted the manuscript. FR, AA, AD, SA, MI and ME performed the data analysis. SS, VL, CT, PV, LS and RB extracted the data and authorised their utilisation. All authors assisted in the results interpretation and manuscript revision. All authors read and approved the final manuscript. Giovanni Corrao is the guarantor of the overall content of the work

Funding: This study was funded by a research grant from the Italian Health Ministry: 'Modelli per il monitoraggio e la valutazione delle cure integrate (CI) nell’ambito del Nuovo Sistema di Garanzia dell’assistenza sanitaria' project (grant number J59H06000160001).

Disclaimer: The funding source had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Competing interests: GC received research support from the European Community (EC), the Italian Agency of Drug (AIFA), the Italian Ministry of Education, University and Research (MIUR), and the Italian Health Ministry. He took part in a variety of projects that were funded by pharmaceutical companies (ie, Novartis, GSK, Roche, AMGEN and BMS). He also received honoraria as member of Advisory Board from Roche. GM received honoraria for participation as speaker/chairman in national/international meetings from Boehringer Ingelheim, Ferrer, Medtronic, Menarini, Merck Serono, Recordati and Servier.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Contributor Information

the 'Monitoring and Assessing care Pathways (MAP)' working group of the Italian Ministry of Health:

Donata Bellentani, Simona Carbone, Carla Ceccolini, Angela De Feo, Cristina Giordani, Rosanna Mariniello, Modesta Visca, Natalia Magliocchetti, Giovanna Romano, Antonio Lora, Paola Pisanti, Rinaldo Zanini, Flavia Carle, Marica Iommi, Edlira Skrami, Anna Cantarutti, Giovanni Corrao, Matteo Monzio Compagnoni, Pietro Pugni, Federico Rea, Marina Davoli, Mirko Di Martino, Adele Lallo, Patrizia Vittori, Giuliana Vuillermin, Alfonso Bernardo, Anna Frusciante, Laura Belotti, Rossana De Palma, Andrea Di Lenarda, Marisa Prezza, Danilo Fusco, Chiara Marinacci, Olivia Leoni, Liana Spazzafumo, Simone Pizzi, Lolita Gallo, Ettore Attolini, Vito Lepore, Salvatore Scondotto, Giovanni De Luca, Paolo Francesconi, Carla Rizzuti, Francesco Avossa, Silvia Vigna, Letizia Dondi, Nello Martini, Antonella Pedrini, Carlo Piccinni, Mimma Cosentino, Maria Grazia Marvulli, and Aldo Maggioni

Data availability statement

Data are available upon reasonable request. Data may be obtained from a third party and are not publicly available. The data that support the findings of this study are available from the Italian Regions, but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the Italian Regions upon reasonable request.

Ethics statements

Patient consent for publication

Not required.

Ethics approval

Under the rules of the Italian Drugs Agency (available at: http://www.agenziafarmaco.gov.it/sites/default/files/det_20marzo2008.pdf), retrospective studies using administrative databases do not require ethics committee protocol approval.

References

  • 1. Lloyd EC, Gandhi TN, Petty LA. Monoclonal antibodies for COVID-19. JAMA 2021;325:1015. 10.1001/jama.2021.1225 [DOI] [PubMed] [Google Scholar]
  • 2. Földi M, Farkas N, Kiss S, et al. Obesity is a risk factor for developing critical condition in COVID-19 patients: a systematic review and meta-analysis. Obes Rev 2020;21:e13095. 10.1111/obr.13095 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Mantovani A, Byrne CD, Zheng M-H, et al. Diabetes as a risk factor for greater COVID-19 severity and in-hospital death: a meta-analysis of observational studies. Nutr Metab Cardiovasc Dis 2020;30:1236–48. 10.1016/j.numecd.2020.05.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Lippi G, Wong J, Henry BM. Hypertension and its severity or mortality in coronavirus disease 2019 (COVID-19): a pooled analysis. Pol Arch Intern Med 2020. 10.20452/pamw.15272 [DOI] [PubMed] [Google Scholar]
  • 5. Izcovich A, Ragusa MA, Tortosa F, et al. Prognostic factors for severity and mortality in patients infected with COVID-19: a systematic review. PLoS One 2020;15:e0241955. 10.1371/journal.pone.0241955 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Liang W, Liang H, Ou L, et al. Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19. JAMA Intern Med 2020;180:1081. 10.1001/jamainternmed.2020.2033 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Wynants L, Van Calster B, Collins GS, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ 2020;369:m1328. 10.1136/bmj.m1328 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Gupta RK, Marks M, Samuels THA, et al. Systematic evaluation and external validation of 22 prognostic models among hospitalised adults with COVID-19: an observational cohort study. Eur Respir J 2020;56:2003498. 10.1183/13993003.03498-2020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Ebrahimi M, Malehi AS, Rahim F. COVID-19 patients: a systematic review and meta-analysis of laboratory findings, comorbidities, and clinical outcomes comparing medical staff versus the general population. Osong Public Health Res Perspect 2020;11:269–79. 10.24171/j.phrp.2020.11.5.02 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Charlson ME, Pompei P, Ales KL, et al. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 1987;40:373–83. 10.1016/0021-9681(87)90171-8 [DOI] [PubMed] [Google Scholar]
  • 11. Corrao G, Rea F, Di Martino M, et al. Developing and validating a novel multisource comorbidity score from administrative data: a large population-based cohort study from Italy. BMJ Open 2017;7:e019503. 10.1136/bmjopen-2017-019503 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Tibshirani R. The LASSO method for variable selection in the COX model. Stat Med 1997;16:385–95. [DOI] [PubMed] [Google Scholar]
  • 13. Gauthier J, Wu QV, Gooley TA. Cubic splines to model relationships between continuous variables and outcomes: a guide for clinicians. Bone Marrow Transplant 2020;55:675–80. 10.1038/s41409-019-0679-x [DOI] [PubMed] [Google Scholar]
  • 14. Pencina MJ, D'Agostino RB, D'Agostino RB, et al. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 2008;27:157–72. 10.1002/sim.2929 [DOI] [PubMed] [Google Scholar]
  • 15. Yu W, Xu W, Zhu L. A modified Hosmer–Lemeshow test for large data sets. Commun Stat Theory Methods 2017;46:11813–25. 10.1080/03610926.2017.1285922 [DOI] [Google Scholar]
  • 16. Christensen DM, Strange JE, Gislason G, et al. Charlson comorbidity index score and risk of severe outcome and death in Danish COVID-19 patients. J Gen Intern Med 2020;35:2801–3. 10.1007/s11606-020-05991-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Shareef MA, Bashaiwth HM, AlAkbari AO, et al. A systematic review of contemporary evidence on SARS-CoV-2 and HIV coinfection: what does it look like up to date? Avicenna J Med 2020;10:189–97. 10.4103/ajm.ajm_175_20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Liu Y, Bi L, Chen Y. Active or latent tuberculosis increases susceptibility to COVID-19 and disease severity. medRxiv 2020. 10.1101/2020.03.10.20033795 [DOI] [Google Scholar]
  • 19. Cabezudo-García P, Ciano-Petersen NL, Mena-Vázquez N, et al. Incidence and case fatality rate of COVID-19 in patients with active epilepsy. Neurology 2020;95:e1417–25. 10.1212/WNL.0000000000010033 [DOI] [PubMed] [Google Scholar]
  • 20. Vignatelli L, Zenesini C, Belotti LMB, et al. Risk of hospitalization and death for COVID-19 in people with Parkinson's disease or parkinsonism. Mov Disord 2021;36:1–10. 10.1002/mds.28408 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Bajaj JS, Garcia-Tsao G, Wong F, et al. Cirrhosis is associated with high mortality and readmissions over 90 days regardless of COVID-19: a multicenter cohort. Liver Transpl 2021;27:1343–7. 10.1002/lt.25981 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Safdarian AR, Momenzadeh K, Kahe F, et al. Death due to COVID-19 in a patient with diabetes, epilepsy, and gout comorbidities. Clin Case Rep 2020. 10.1002/ccr3.3557. [Epub ahead of print: 25 Nov 2020]. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Mahil SK, Dand N, Mason KJ, et al. Factors associated with adverse COVID-19 outcomes in patients with psoriasis-insights from a global registry-based study. J Allergy Clin Immunol 2021;147:60–71. 10.1016/j.jaci.2020.10.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Tang N, Li D, Wang X, et al. Abnormal coagulation parameters are associated with poor prognosis in patients with novel coronavirus pneumonia. J Thromb Haemost 2020;18:844–7. 10.1111/jth.14768 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Roy NBA, Telfer P, Eleftheriou P, et al. Protecting vulnerable patients with inherited anaemias from unnecessary death during the COVID-19 pandemic. Br J Haematol 2020;189:635–9. 10.1111/bjh.16687 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Druss BG. Addressing the COVID-19 pandemic in populations with serious mental illness. JAMA Psychiatry 2020;77:891–2. 10.1001/jamapsychiatry.2020.0894 [DOI] [PubMed] [Google Scholar]
  • 27. Suissa S, Patenaude V, Lapi F, et al. Inhaled corticosteroids in COPD and the risk of serious pneumonia. Thorax 2013;68:1029–36. 10.1136/thoraxjnl-2012-202872 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Wiese AD, Griffin MR, Schaffner W, et al. Long-acting opioid use and the risk of serious infections: a retrospective cohort study. Clin Infect Dis 2019;68:1862–9. 10.1093/cid/ciy809 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Kollias A, Kyriakoulis KG, Dimakakos E, et al. Thromboembolic risk and anticoagulant therapy in COVID-19 patients: emerging evidence and call for action. Br J Haematol 2020;189:846–7. 10.1111/bjh.16727 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Rentsch CT, Beckman JA, Tomlinson L. Early initiation of prophylactic anticoagulation for prevention of COVID-19 mortality: a nationwide cohort study of hospitalized patients in the United States. medRxiv 2020. 10.1101/2020.12.09.20246579 [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2021-053281supp001.pdf (77.6KB, pdf)

Reviewer comments
Author's manuscript

Data Availability Statement

Data are available upon reasonable request. Data may be obtained from a third party and are not publicly available. The data that support the findings of this study are available from the Italian Regions, but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the Italian Regions upon reasonable request.


Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES