Skip to main content
Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease logoLink to Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease
. 2017 Jul 20;6(7):e004806. doi: 10.1161/JAHA.116.004806

Simple Scoring System to Predict In‐Hospital Mortality After Surgery for Infective Endocarditis

Giuseppe Gatti 1,, Andrea Perrotti 2, Jean‐François Obadia 4, Xavier Duval 5,6, Bernard Iung 7,8, François Alla 9, Catherine Chirouze 3, Christine Selton‐Suty 10, Bruno Hoen 11, Gianfranco Sinagra 1, François Delahaye 4, Pierre Tattevin 12, Vincent Le Moing 12,13, Aniello Pappalardo 1, Sidney Chocron 2; The Association for the Study and Prevention of Infective Endocarditis Study Group–Association pour l'Étude et la Prévention de l'Endocadite Infectieuse (AEPEI), X Duval, F Alla, A Bouvet, S Briancon, E Cambau, M Celard, C Chirouze, N Danchin, T Doco‐ Lecompte, F Delahaye, J Etienne, B Iung, V Le Moing, J F Obadia, C Leport, C Poyart, M Revest, C Selton‐Suty, C Strady, P Tattevin, F Vandenesch, Y Bernard, S Chocron, C Chirouze, B Hoen, P Plesiat, I Abouliatim, C De Place, P Tattevin, M Revest, P Y Donnio, F Alla, J P Carteaux, T Doco‐Lecompte, C Lion, N Aissa, C Selton‐Suty, B Baehrel, R Jaussaud, P Nazeyrollas, C Strady, V Vernet, E Cambau, X Duval, B Iung, P Nataf, C Chidiac, M Celard, F Delahaye, J F Obadia, F Vandenesch, H Aumaître, J M Frappier, V Le Moing, E Oziol, A Sotto, C Sportouch, C Poyart, A Bouvet, F Vandenesch, M Celard, M Bes, E Abrial, C Acar, N Aissa, J F Alexandra, N Amireche, D Amrein, P Andre, M Appriou, M A Arnould, P Assayag, A Atoui, F Aziza, N Baille, N Bajolle, P Battistella, S Baumard, A Ben Ali, J Bertrand, S Bialek, M Bois Grosse, M Boixados, F Borlot, A Bouchachi, O Bouche, S Bouchemal, J L Bourdon, A Bouvet, L Brasme, F Bricaire, E Brochet, J F Bruntz, A Cady, J Cailhol, M P Caplan, B Carette, J P Carteaux, O Cartry, C Cazorla, M Celard, H Chamagne, H Champagne, G Chanques, J Chastre, B Chevalier, C Chirouze, S Chocron, F Chometon, C Christophe, A Cohen, N Colin de Verdiere, N Danchin, V Daneluzzi, L David, P De Lentdecker, F Delahaye, V Delcey, P Deleuze, E Donal, X Duval, B Deroure, V Descotes‐Genon, K Didier Petit, A Dinh, V Doat, F Duchene, F Duhoux, M Dupont, S Ederhy, O Epaulard, M Evest, J F Faucher, B Fantin, E Fauveau, T Ferry, M Fillod, T Floch, T Fraisse, J M Frapier, L Freysz, B Fumery, B Gachot, S Gallien, I Gandjbach, P Garcon, A Gaubert, J L Genoud, S Ghiglione, C Godreuil, A Grentzinger, L Groben, D Gherissi, P Guéret, A Hagege, N Hammoudi, F Heliot, P Henry, S Herson, B Hoen, P Houriez, L Hustache‐Mathieu, O Huttin, S Imbert, B Iung, S Jaureguiberry, M Kaaki, A Konate, J M Kuhn, S Kural Menasche, A Lafitte, B Lafon, F Lanternier, V Le Chenault, V Le Moing, C Lechiche, S Lefèvre‐Thibaut, A Lefort, A Leguerrier, J Lemoine, L Lepage, C Leport, C Lepouse ´, J Leroy, P Lesprit, L Letranchant, D Loisance, G Loncar, C Lorentz, P Mabo, I Magnin‐Poull, T May, A Makinson, H Man, M Mansouri, O Marxcon, J P Maroni, V Masse, F Maurier, M C Meyohas, P L Michel, C Michelet, F Mechaï, O Merceron, D Messika‐Zeitoun, Z Metref, V Meyssonnier, C Mezher, S Micheli, M Monsigny, S Mouly, B Mourvillier, O Nallet, P Nataf, P Nazeyrollas, V Noel, J F Obadia, E Oziol, T Papo, B Payet, A Pelletier, P Perez, J S Petit, F Philippart, E Piet, C Plainvert, B Popovic, J M Porte, P Pradier, R Ramadan, M Revest, J Richemond, M Rodermann, M Roncato, I Roigt, O Ruyer, M Saada, J Schwartz, C Selton‐Suty, M Simon, B Simorre, S Skalli, F Spatz, C Strady, J Sudrial, L Tartiere, A Terrier De La Chaise, M C Thiercelin, D Thomas, M Thomas, L Toko, F Tournoux, A Tristan, J L Trouillet, L Tual, A Vahanian, F Verdier, V Vernet Garnier, V Vidal, P Weyne, M Wolff, A Wynckel, N Zannad, P Y Zinzius
PMCID: PMC5586260  PMID: 28729412

Abstract

Background

Aspecific scoring systems are used to predict the risk of death postsurgery in patients with infective endocarditis (IE). The purpose of the present study was both to analyze the risk factors for in‐hospital death, which complicates surgery for IE, and to create a mortality risk score based on the results of this analysis.

Methods and Results

Outcomes of 361 consecutive patients (mean age, 59.1±15.4 years) who had undergone surgery for IE in 8 European centers of cardiac surgery were recorded prospectively, and a risk factor analysis (multivariable logistic regression) for in‐hospital death was performed. The discriminatory power of a new predictive scoring system was assessed with the receiver operating characteristic curve analysis. Score validation procedures were carried out. Fifty‐six (15.5%) patients died postsurgery. BMI >27 kg/m2 (odds ratio [OR], 1.79; P=0.049), estimated glomerular filtration rate <50 mL/min (OR, 3.52; P<0.0001), New York Heart Association class IV (OR, 2.11; P=0.024), systolic pulmonary artery pressure >55 mm Hg (OR, 1.78; P=0.032), and critical state (OR, 2.37; P=0.017) were independent predictors of in‐hospital death. A scoring system was devised to predict in‐hospital death postsurgery for IE (area under the receiver operating characteristic curve, 0.780; 95% CI, 0.734–0.822). The score performed better than 5 of 6 scoring systems for in‐hospital death after cardiac surgery that were considered.

Conclusions

A simple scoring system based on risk factors for in‐hospital death was specifically created to predict mortality risk postsurgery in patients with IE.

Keywords: cardiac valvular surgery, critical care, infective endocarditis, mortality, predictors, pulmonary hypertension, quality control, treatment outcome

Subject Categories: Risk Factors, Infectious Endocarditis, Valvular Heart Disease, Cardiovascular Surgery, Mortality/Survival

Introduction

Outcome in patients with infective endocarditis (IE) is a complex process, mediated by the immune system, and a function of interactions between patient‐related factors (eg, demographic data, risk factors for cardiovascular disease, underlying cardiac disease, and comorbidities) and the properties of the causal agent (eg, nature, virulence, and antibiotic resistance). In 25% to 30% of cases, medical treatment alone is inadequate and must be combined with surgery, which aims to control infection by debridement and removal of necrotic tissue, and to restore cardiac morphology by surgical repair and/or valve replacement. Cardiac operations in some of these critically ill patients may be challenging and yield poor early and late results, even when carefully performed. Mortality rates have been reported to range between 10% in elective patients and up to 30% in urgent surgery. Prolonged invasive ventilation, low cardiac output, acute kidney injury, sepsis, and bleeding are frequent postoperative complications.1, 2, 3 Consequently, for patients with IE, risk stratification is important not only for the surgeon for decision making, but also for counseling of the patient and comparative assessment of quality of care.

Currently, the risk of mortality postsurgery for IE is estimated using predictive scoring systems that have been derived from patient databases where most of the patients had had cardiac operations other than those for endocarditis.4, 5, 6, 7 Because of this inherent limitation, the utility of these aspecific predictive systems for patients with IE has been called into question.8, 9, 10, 11, 12, 13 In fact, specific scores to predict in‐hospital death postsurgery in patients with IE have also been devised,14, 15, 16 but with no external validation, and their impact in clinical practice is unclear.

In this context, we performed a prospective, population‐based observational study in 8 European centers of cardiac surgery. The aims of the study were both to analyze the risk factors for hospital death and create a risk score based on the results of this analysis.

Methods

Study Patients

The study population consisted of 361 patients who underwent surgery for IE: (1) 138 consecutive patients (mean age, 60.6±8.5 years; 19.6% females) who were operated on between 2000 and 2015 at the Cardiovascular Department of the University Hospital of Trieste, Trieste, Italy; (2) 223 consecutive patients (mean age, 58.2±15.6 years; 22% females) who underwent surgery in 2008 in 7 French administrative areas: greater Paris, Lorraine, Rhône‐Alpes, Franche‐Comté, Marne, Ille‐et‐Vilaine, and Languedoc‐Roussillon. The adult population in these areas (15.3 million inhabitants) covers 31.9% of the overall French population aged >18 years.11 The French centers are grouped in the Association for the study and prevention of IE (Association pour l'Étude et la Prévention de l'Endocadite Infectieuse; AEPEI). Since 2001, the members of the AEPEI (see Appendix for full list of members) are enrolling patients with IE in each of the French administrative areas in an ad‐hoc prospective registry.17 In 2008, the data collection was particularly exhaustive, comprehensive, and accurate because it coincided with an epidemiological study performed by the AEPEI to update national data regarding the epidemiology of IE in France. Only definite cases of IE, as defined by the modified Duke criteria,18 were included into the present study. For all patients, baseline characteristics, surgical and endocarditis‐related features, as well as postoperative complications were prospectively recorded in a computerized data registry. For each center, approval to conduct the study was acquired from the local ethics committee. Patients were informed about the study, but were not required to provide individual consent, in accord with French and Italian legislation.

A risk factor analysis for in‐hospital death postsurgery for IE was performed and a predictive scoring system, named the AEPEI score, was devised from the results of the analysis. External validation was performed using data from the AEPEI registry of patients with definite IE who underwent surgery between 2001 and 2015. The validation sample comprised 161 AEPEI patients for whom there were sufficient data to calculate the AEPEI score. The 223 AEPEI patients operated on in 2008 and included in the present study had been excluded preventively from the validation sample.

Definitions

Unless otherwise stated, the definitions and cut‐off values of the preoperative variables were those used for the European System for Cardiac Operative Risk Evaluation (EuroSCORE). In particular, critical state was defined as the presence of ventricular tachycardia/ventricular fibrillation or aborted sudden death, preoperative cardiac massage, preoperative ventilation before anesthetic room, preoperative inotropes or intra‐aortic balloon pump, and preoperative acute renal failure (anuria or oliguria <10 mL/h).5, 6 Myocardial infarction (MI) was defined according to the recent definition criteria of type V MI by Moussa et al.19 Acute kidney injury was defined as an increase in serum creatinine of 1.5 to 1.9 times the baseline level or serum creatinine increase ≥26.5 μmol/L within 7 days postsurgery.20 Sternal wound infections were graded according to the Centers for Disease Control and Prevention definitions of surgical site infections. In brief, superficial incisional infection involves only skin or subcutaneous tissues, deep incisional infection involves deep soft tissues (fascial and muscle layers) with or without the sternal bone, and organ/space infection involves the mediastinum (mediastinitis).21 For the purposes of this study, deep incisional infection and mediastinitis were considered to be deep sternal wound infections. Any sternal wound infection occurring within 3 months postsurgery was considered as postoperative wound infection.

Statistical Analysis

Continuous variables with normal distribution are expressed as mean±SD and those without normal distribution as median [interquartile range]. Categorical variables are expressed as number and percentage. Statistical comparison of baseline characteristics was performed using Pearson's chi‐square or Fisher's exact test for categorical variables, and Student t test or the Mann–Whitney U test for continuous variables. Backward step‐wise multivariable logistic regression analysis was used to identify independent predictors of in‐hospital mortality. All variables with a P<0.1 by univariable analysis were included in the multivariable model. For each variable, the odds ratio (OR) and the corresponding 95% CI were calculated. Each of the risk indices had the variable weighted according to its regression coefficient. Goodness of fit of the model was evaluated with the Hosmer–Lemeshow test. The discriminatory power of the model was assessed with the receiver operating characteristic (ROC) curve and the calculation of the area under the curve (AUC). The new predictive scoring system, the AEPEI score, was compared (using De Long's method) with 3 existing scoring systems for in‐hospital mortality after cardiac surgery, namely the EuroSCORE II,5 the logistic EuroSCORE,16 and the Ontario Province Risk (OPR) score,17 as well as with 3 existing scores specifically designed to predict early mortality postsurgery for IE, namely the PALSUSE score (the prosthetic valve, age ≥70, large intracardiac destruction, Staphylococcus spp, urgent surgery, sex [female], and EuroSCORE ≥10),18 the De Feo score (for native valve IE),19 and the Society of Thoracic Surgeons (STS) score for IE.20 Both internal validation, based on the 0.632 bootstrap method, and external validation were performed. In addition, a new set of statistical analyses was carried out as follows: (1) In order to verify the stability of the original 5‐variable model of the AEPEI score without the variable linked to pulmonary artery pressure, an alternate model of the AEPEI score was created by removing systolic pulmonary artery pressure (sPAP) >55 mm Hg from the original set of variables from which the score was generated. The goodness of fit and the discriminatory power of this alternate model were measured. (2) Because all the variables of the AEPEI score except BMI >27 kg/m2 were also components of the EuroSCORE II, we added BMI >27 kg/m2 to EuroSCORE II and investigated its incremental value with continuous net reclassification improvement and integrated discrimination improvement measures.22 (3) Given the ratio of events to potential predictor variables, Akaike's information criterion (AIC), which accounts for the small number of events relative to the number of covariates, was analyzed.23 Statistical analyses were performed using SPSS for Windows (version 13.0; SPSS, Inc, Chicago, IL).

Results

Italian Versus French Study Patients

There were some differences in baseline characteristics, surgical data, and endocarditis‐related features between the Italian and French patients of the study. The rates of preoperative dialysis, Canadian Cardiovascular Society (CCS) class 4, previous cardiac surgery, urgent/emergency priority, and combined coronary surgery were higher in Italian patients, whereas poor mobility, recurrent embolism, and active endocarditis were more frequent in French patients. Baseline levels of C‐reactive protein were higher in Italian patients (Tables 1, 2 through 3). Overall, the expected operative risk was higher in Italian patients than in the French series (mean EuroSCORE II, 15.9±18.7% versus 9.9±3.6%; P<0.0001). In‐hospital mortality was higher in Italian than in French patients (20.3% versus 12.6%; P=0.049); 30‐day mortality was also higher in the Italian series (18.1% versus 7.6%; P=0.0025).

Table 1.

Baseline Characteristics of Patients (n=361)a

Variable Trieste Database (n=138) AEPEI Registry (n=223) P Value
Age, y 60.6±8.5 58.2±15.6 0.15
Female sex 27 (19.6) 49 (22.0) 0.58
Hypertension 21 (15.2) 90 (40.4) <0.0001
Current smoker 11 (8) 54 (24.2) <0.0001
BMI, kg/m2 25.5±4.1 25.4±5.4 0.88
Diabetes mellitus 22 (15.9) 48 (21.5) 0.19
Diabetes mellitus on insulin 9 (6.5) 18 (8.1) 0.58
Anemiab 113 (81.9) 171 (76.6) 0.95
White blood cell, 103/mm3 12±5.9 14.9±10.5 0.0032
CRP, mg/L 193.6±81.3 140.4±85.5 <0.0001
Poor mobilityc 2 (1.4) 18 (8.1) 0.0075
Chronic lung diseasec 13 (9.4) 20 (9.0) 0.88
eGFR, mL/mind 67.7±37.3 69.4±35.4 0.67
Dialysis 13 (9.4) 2 (0.9) <0.0001
Extracardiac arteriopathyc 22 (15.9) 28 (12.6) 0.36
NYHA class IV 55 (39.9) 81 (36.3) 0.5
CCS class 4 20 (14.5) 3 (1.3) <0.0001
Recent MIc 0 1 (0.4) 1
Left ventricular ejection fraction <50%c 32 (23.2) 43 (19.3) 0.37
sPAP >55 mm Hgc 3 (2.2) 15 (12.4) 0.053
Coronary artery disease 18 (13) 25 (18.1) 0.6
Previous cardiac surgery 37 (26.8) 17 (7.6) <0.0001
Critical statec 27 (19.6) 35 (15.7) 0.34
Length of the preoperative hospital stay (days)e 6 [2–19] 13 [5–25] 0.16

CCS indicates Canadian Cardiovascular Society; CRP, C‐reactive protein; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; MI, myocardial infarction; NYHA, New York Heart Association; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure.

a

Unless otherwise stated, values are mean±SD, or number (percentage).

b

Defined as haemoglobin <12 g/dL for women and <13 g/dL for men.

c

The definitions and the cut‐off values are those used for the EuroSCORE II.5

d

The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR.

e

Median [interquartile range].

Table 2.

Surgical Features (n=361)a

Variable Trieste Database (n=138) AEPEI Registry (n=223) P Value
Reason for surgery
Refractory heart failure attributed to valvular dysfunction 32 (23.2) 59 (26.5) 0.49
Persistent infection 18 (13) 28 (12.6) 0.89
Embolism 58 (42) 106 (47.5) 0.31
Recurrent 4 (2.9) 49 (22) <0.0001
Perivalvular complicationsb 40 (29) 67 (30) 0.82
Surgical priorityc <0.0001
Elective 26 (18.8) 107 (48.0)
Urgent 90 (65.2) 94 (42.2)
Emergency 22 (15.9) 11 (4.9)
Salvage 0 11 (4.9)
Valve involvement
Aortic valve 86 (62.3) 138 (61.9) 0.93
Mitral valve 60 (43.5) 107 (48.0) 0.40
Tricuspid valve 7 (5.1) 28 (12.6) 0.02
Multivalvular 23 (16.7) 55 (24.7) 0.07
Large intracardiac destructiond 57 (41.3) 119 (52) 0.08
Weight of the interventionc
Combined CABG 25 (18.1) 13 (5.8) <0.0001
Single non‐CABG 89 (64.5) 126 (56.5) 0.13
Two procedures 46 (33.3) 82 (36.8) 0.51
Three procedures 3 (2.2) 15 (6.7) 0.053
Surgery on thoracic aorta 9 (6.5) 15 (6.7) 0.94

CABG indicates coronary artery bypass grafting; EuroSCORE, European System for Cardiac Operative Risk Evaluation.

a

Number (percentage).

b

Perivalvular leak, annular or aortic abscess, sinus of Valsalva aneurysm, aortic fistula, and prosthetic valve detachment.

c

The definitions are those used for the EuroSCORE II.5

d

Defined as extensive valve destruction, perivalvular complications, or multivalvular involvement.

Table 3.

Endocarditis‐Related Features (n=361)a

Variable Trieste Database (n=138) AEPEI Registry (n=223) P Value
Endocarditis <0.0001
Activeb 72 (52.2) 203 (91)
Treatedb 66 (47.8) 20 (9.0)
Type of endocarditis
Native valve 103 (74.6) 182 (81.6) 0.78
Prosthetic valve 27 (19.6) 41 (18.3) 0.78
Intracardiac device or other side 12 (8.7) 36 (16.1) 0.043
Causal agents 0.014
Streptococcus species 45 (32.6) 89 (39.9)
Staphylococcus aureus 23 (16.7) 49 (22)
Coagulase‐negative Staphylococci 10 (7.2) 23 (10.3)
Enterococcus species 13 (9.4) 24 (10.8)
Gram‐negative bacteria 6 (4.3) 9 (4)
Fungi 2 (1.4) 2 (0.9)
Not identified 39 (28.3) 27 (12.1)

EuroSCORE indicates European System for Cardiac Operative Risk Evaluation.

a

Number (percentage).

b

The definitions are those used for the EuroSCORE II.5

Risk Factors for Hospital Death and Multivariable Analysis Model

A total of 56 (15.5%) patients died in hospital after surgery (Table 4). Baseline characteristics and operative data of these patients and the corresponding endocarditis‐related features (Table S1) were compared with those of survivors of the in‐hospital phase postsurgery (Tables S2 through S4). Risk factor analysis for in‐hospital death postsurgery for IE was performed. A multivariable model with 16 variables was created using all the variables with a P<0.1 by univariable analysis. BMI >27 kg/m2, estimated glomerular filtration rate (eGFR) <50 mL/min, New York Heart Association (NYHA) class IV, sPAP >55 mm Hg, and critical state were found to be independent predictors of postoperative in‐hospital death (Tables 5 and 6).

Table 4.

In‐Hospital Mortality and Perioperative Complicationsa

Complication n=361
In‐hospital death 56 (15.5)
30‐day death 42 (11.6)
Stroke 9 (2.5)
Prolonged (>48 hours) invasive ventilation 482 (22.7)
Pneumonia 30 (8.3)
Atrial fibrillation, new onset 38/358b (10.6)
MI19 2 (0.6)
Immediate reoperation for acute prosthetic failure 9 (2.5)
Low cardiac outputc 32 (8.9)
Intraoperative and postoperative use of IABP 9 (2.5)
Use of ECMO 6 (1.7)
Acute kidney injury20 67 (18.6)
Renal replacement therapy 23 (6.4)
Bleeding peptic disease 4 (1.1)
Mesenteric ischemia 7 (1.9)
Acute pancreatitis 2 (0.6)
Multiorgan failure (3 or more organs) 11 (3.0)
Sepsis 22 (6.1)
Mediastinal re‐explorationd 38 (10.5)
Deep sternal wound infection21 10 (2.8)
Length of the postoperative hospital stay, days 23.9 [12.7–42.4]e

ECMO indicates extracorporeal membrane oxygenator; IABP, intra‐aortic balloon pumping; KDIGO, Kidney Disease: Improving Global Outcomes; MI, myocardial infarction.

a

Unless otherwise stated, values are number (percentage).

b

Patients with preoperative stable sinus rhythm or paroxysmal atrial fibrillation.

c

Defined as 3 consecutive cardiac index measurements <2.0 L/min per m2 despite adequate preload, afterload and inotropic support, or IABP.

d

Through resternotomy or subxifoid window.

e

Median [interquartile range].

Table 5.

Risk Factor Analysis for In‐Hospital Death After Surgery for IE (n=361)

Variable Univariable Analysisa Original Multivariable Analysisb Alternate Multivariable Analysisc
P Value OR 95% CI P Value OR 95% CI P Value
Age >70 years 0.016 1.14 0.52 to 2.53 0.74 1.18 0.55 to 2.55 0.67
BMI >27 kg/m2 d 0.039 2.15 1.06 to 4.37 0.034 1.91 0.96 to 3.81 0.065
eGFR <50 mL/mine , f <0.0001 3.62 1.78 to 7.78 <0.0001 3.19 1.59 to 6.41 <0.0001
Dialysis 0.066 1.04 0.27 to 3.96 0.96 1.47 0.41 to 5.27 0.56
NYHA class IV 0.0001 2.43 1.14 to 5.18 0.022 2.07 1.00 to 4.27 0.05
CCS class 4 0.015 1.13 0.38 to 3.3 0.83 1.19 0.41 to 3.45 0.74
Left ventricular ejection fraction, 30% to 50%f 0.036 1.37 0.65 to 2.9 0.41 1.29 0.61 to 2.72 0.51
sPAP >55 mm Hgf 0.044 3.29 1.13 to 9.53 0.028 ··· ··· ···
Coronary artery disease 0.052 1.33 0.1 to 17.9 0.83 1.46 0.11 to 18.6 0.77
Previous cardiac surgery 0.022 1.29 0.48 to 3.48 0.61 1.30 0.50 to 3.38 0.59
Critical statef <0.0001 2.52 1.11 to 5.73 0.027 2.49 1.11 to 5.78 0.026
Length of the preoperative hospital stay <10 daysd 0.061 1.12 0.52 to 2.44 0.77 1.06 0.51 to 3.39 0.87
Urgent surgical priorityf 0.006 1.62 0.76 to 3.47 0.21 1.80 0.84 to 3.83 0.13
Combined CABG 0.052 1.49 0.12 to 2.34 0.77 1.26 0.09 to 17.8 0.87
Surgery on thoracic aorta 0.075 2.44 0.69 to 8.67 0.17 2.55 0.78 to 8.31 0.12
Prosthetic valve endocarditis 0.043 1.49 0.61 to 6.34 0.38 1.45 0.61 to 3.45 0.4

CABG indicates coronary artery bypass grafting; CCS, Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; OR, odds ratio; ROC, receiver operating characteristic curve; sPAP, systolic pulmonary artery pressure.

a

All the variables that were considered for the univariable analysis are listed in Table S1.

b

All variables with a P<0.1 by univariable analysis were included in the multivariable model.

c

All variables with a P<0.1 by univariable analysis except sPAP >55 mm Hg were included in the multivariable model.

d

The best discriminative value for in‐hospital mortality by ROC analysis.

e

The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR.

f

The definitions and cut‐off values are those used for EuroSCORE II.5

Table 6.

The AEPEI Score: the Risk Factors for In‐Hospital Death (by Backward Multivariable Logistic Regression) and the Scoring (n=361)

Variable The Original Modela The Alternate Modelb
Regression Coefficient SE OR 95% CI P Value Pointsc Regression Coefficient SE OR 95% CI P Value Pointsc
BMI >27 kg/m2 d 0.58 0.34 1.79 1.02 to 3.45 0.049 1 ··· ··· ··· ··· ··· ···
eGFR <50 mL/mine , f 1.26 0.33 3.52 1.84 to 6.73 <0.0001 2.2 1.32 0.33 3.75 1.97 to 7.14 <0.0001 1.8
NYHA class IV 0.75 0.33 2.11 1.10 to 4.05 0.024 1.3 0.75 0.33 2.12 1.12 to 4.02 0.021 1
sPAP >55 mm Hgf 0.58 0.58 1.78 1.06 to 5.61 0.032 1 ··· ··· ··· ··· ··· ···
Critical statef 0.86 0.36 2.37 1.16 to 4.82 0.017 1.5 0.85 0.36 2.35 1.17 to 4.74 0.017 1.1
Constant −3.065 −1.411

eGFR indicates estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; ROC, receiver‐operating characteristic curve; sPAP, systolic pulmonary artery pressure.

a

All variables with a P<0.05 by the original multivariable analysis (Table 5) were included.

b

All variables with a P<0.05 by the alternate multivariable analysis (Table 5) were included.

c

Dividing each regression coefficient by the lowest coefficient and approximating to the first decimal place.

d

The best discriminatory value for in‐hospital mortality by ROC analysis.

e

The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR.

f

The definitions and cut‐off values are those used for EuroSCORE II.5

The AEPEI Score: Performance and Validation

By multivariable analysis (Table 5), a new scoring system, the AEPEI score, was created to predict in‐hospital mortality postsurgery for IE (Table 6). The new score includes 5 variables and consists of 7 risk classes (Table 7); its performance is summarized in Tables 8 and 9. In the study population, the AEPEI score had equivalent discriminatory power to that of the EuroSCORE II (P=0.4). It was found to be better than the logistic EuroSCORE (P=0.0026) and OPR score (P=0.065) and better than each of the 3 specific predictive systems (De Feo score, P=0.054, PALSUSE score, P=0.047, and STS risk score for IE; P=0.027), albeit without reaching statistical significance for the De Feo score (Figure 1). There was no difference in performance of the AEPEI score between the Italian and French series (P=0.37; Table 10). The logistic equation of the AEPEI final model was:

p=e(β0+βiXi)1+e(β0+βiXi)

where β0 is the constant of the logistic regression equation (ie, −3.0645) and βi the coefficient of the variable Xi. The coefficients and variable values are: for BMI, βi=0.58 and Xi=1 if BMI >27 kg/m2, or 0 if BMI ≤27 kg/m2; for eGFR, βi=1.26 and Xi=1if eGFR <50 mL/min, or 0 if eGFR ≥50 mL/min; for NYHA class IV, βi=0.75 and Xi=1 in case of NYHA class IV, or 0 if not; for sPAP, βi=0.58 and Xi=1 if sPAP ≥55 mm Hg, or 0 if sPAP <55 mm Hg; for critical state, βi=0.86 and Xi=1 if the patient is in critical state, or 0 if not (Table 6).

Table 7.

Specific Predictive Scoring Systems for In‐Hospital Mortality After Surgery for IE

Scoring System Study Population Variables (Points) Discrimination Power Expected Hospital Mortality
AEPEI score, the original modela (2016) 361 pts. (mean age, 59.1±15.4 years);
AEPEI registry (223 pts., 7 French hospitals, 2008) & Cardiovascular Department of Trieste, Italy (138 pts., 2000–2015);
Hospital mortality, 15.5%;
30‐Day mortality, 11.6%
5 variables:
BMI >27 kg/m2 (1)
eGFR <50 mL/min (2.2)
NYHA class IV (1.3)
sPAP >55 mm Hg (1)
Critical state (1.5)
AUC, 0.780 (95% CI, 0.734–0.822) Score, 0 to 1 point: expected mortality, 4.5% to 7.7%;
Score, 1.3 to 2 points: expected mortality, 9% to 12.9%;
Score, 2.2 to 2.8 points: expected mortality, 14.1% to 18.9%;
Score, 3.2 to 3.8 points: expected mortality, 22.6% to 29.4%;
Score, 4.5 to 5 points: expected mortality, 38.2% to 45.1%;
Score, 5.5 to 6 points: expected mortality, 52.5% to 59.4%;
Score, 7 points: expected mortality, 72.4%
AEPEI score, the alternate modela (2016) Idem 3 variables:
eGFR <50 mL/min (1.8)
NYHA class IV (1)
Critical state (1.1)
AUC, 0.774 (95% CI, 0.727–0.816) Score, 0 to 1 point: expected mortality, 19.6% to 34.1%;
Score, 1.1 to 1.8 points: expected mortality, 36.6% to 47.7%;
Score, 2.1 to 2.9 points: expected mortality, 55% to 68.3%;
Score, 3.9 points: expected mortality, 82%
PALSUSE score14 (2014) 437 pts. (mean age, 61.4±15.5 years);
GAMES registry (26 Spanish hospitals, 2008–2010);
Hospital mortality, 24.3%
7 variables:
Prosthetic valve (2)
Age ≥70 years (1)
Large intracardiac destruction (2)
Staphylococcus spp (2)
Urgent surgery (2)
Sex, female (2)
EuroSCORE II ≥10% (1)
AUC, 0.84 (95% CI, 0.79–0.88) Hospital mortality ranged from 0, in patients with score=0, to 45.4% in patients with score >3
De Feo score (for native valve IE)15 (2012) 440 pts. (mean age, 49±16 years);
Department of Cardiothoracic Surgery of Naples, Italy (1980–2009);
Hospital mortality, 9.1%
6 variables:
Age, 5 classes (5–13)
Renal failure (5)
NYHA class IV (9)
Preop. ventilator support (11)
Positivity of latest preop. blood cultures (5)
Perivalvular involvement (5)
AUC, 0.88 (95% CI, 0.82–0.93) Score, 0 to 5 points: expected mortality ≤4.55%;
Score, 7 to 13 points: expected mortality, 4.55% to 9.1%;
Score, 14 to 19 points: expected mortality, 9.2% to 27.3%;
Score ≥20 points: expected mortality >27.3%
STS risk score for IE16 (2011) 19 543 pts. (mean age, 55 years);
STS database (2002–2008)
30‐day mortality, 8.2%
12 variables:
Emergency, salvage status, or cardiogenic shock (17)
Preop. hemodialysis, renal failure, or creatinine level >2.0 mg/dL (12)
Preop. inotropic or balloon pump support (10)
Active (vs treated) endocarditis (10)
Multiple valve involvement (9)
Insulin‐dependent diabetes mellitus (8)
Arrhythmia (8)
Previous cardiac surgery (7)
Urgent status without cardiogenic shock (6)
Non‐insulin‐dependent diabetes mellitus (6)
Hypertension (5)
Chronic lung disease (5)
AUC, 0.758 ···

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic (ROC) curve; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; GAMES, Grupo de Apoyo al Manejo de la Endocarditis infecciosa en ESpaña; IE, infective endocarditis; NYHA, New York Heart Association; PALSUSE, Prosthetic valve, Age ≥70, Large intracardiac destruction, Staphylococcus spp, Urgent surgery, Sex [female], EuroSCORE II ≥10%; Preop., preoperative; pts., patients; sPAP, systolic pulmonary artery pressure; STS, the Society of Thoracic Surgery.

a

Table 6.

Table 8.

Performance of the AEPEI Score (2 Models) and of 6 Other Specific/Nonspecific Predictive Scoring Systems for In‐Hospital Mortality After Surgery for IE in the Original Series of Patients

System Original Series (n=361)
Goodness of Fita Discriminatory Powerb AIC Value23
Chi‐square DF P Value AUC 95% CI
Specific
AEPEI score, the original model 2.6 5 0.76 0.780 0.734 to 0.822 257.5
AEPEI score, the alternate model 3.9 3 0.27 0.774 0.727 to 0.816 266.9
PALSUSE score14 2.3 7 0.97 0.684 0.633 to 0.731 289.1
De Feo score (for native valve IE)15 2.8 6 0.9 0.722 0.654 to 0.790 296.8
STS risk score for IE16 7.9 8 0.44 0.709 0.659 to 0.756 300
Aspecific
EuroSCORE II5 9.5 8 0.3 0.751 0.704 to 0.795 132.5
Logistic EuroSCORE6 14.3 8 0.068 0.632 0.580 to 0.682 306.9
OPR score7 12.1 8 0.15 0.698 0.647 to 0.745 288.7

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AIC, Akaike's information criterion; AUC, area under the receiver operating characteristic (ROC) curve; DF, degrees of freedom; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; NYHA, New York Heart Association; OPR, Ontario Province Risk; PALSUSE, prosthetic valve, age ≥70, large intracardiac destruction, Staphylococcus spp, urgent surgery, sex (female), EuroSCORE II ≥10%; STS, the Society of Thoracic Surgeons.

a

By the Hosmer–Lemeshow test for logistic regression.

b

By ROC analysis.

Table 9.

The AEPEI Score, the Original Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=361)

Group Death Survival Total
Observed Expected Observed Expected
1 4 5.2 113 111.8 117
2 2 3.2 39 37.8 41
3 5 4.5 45 45.5 50
4 7 4.5 26 28.5 33
5 7 8.0 33 32.0 40
6 11 10.2 26 26.8 37
7 20 20.4 23 22.6 43

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

Figure 1.

Figure 1

The new predictive scoring system for in‐hospital death postsurgery for IE (the AEPEI score) vs (A) three scoring systems specifically created to predict in‐hospital (or 30‐day) mortality postsurgery for IE and (B) 3 predictive scoring systems for in‐hospital (or 30‐day) mortality after cardiac surgery. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic curve; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; OPR, Ontario Province Risk; PALSUSE, Prosthetic valve, Age ≥70, Large intracardiac destruction, Staphylococcus spp, Urgent surgery, Sex [female], EuroSCORE ≥10; STS, the Society of Thoracic Surgeons.

Table 10.

Performance of the Considered Predictive Scores in the Trieste Database and in the AEPEI Registry

System Trieste Database (n=138) AEPEI Registry (n=223)
Goodness of Fita Discriminatory Powerb Goodness of Fita Discriminatory Powerb
Chi‐square DF P Value AUC 95% CI Chi‐square DF P Value AUC 95% CI
Specific
AEPEI score, the original model 12.6 6 0.55 0.744 0.662 to 0.814 4.5 5 0.49 0.804 0.746 to 0.854
AEPEI score, the alternate model 5.03 4 0.28 0.732 0.650 to 0.804 1.5 3 0.68 0.802 0.744 to 0.852
PALSUSE score14 3.4 7 0.85 0.723 0.640 to 0.795 6.3 7 0.5 0.691 0.626 to 0.751
De Feo score (for native valve IE)15 1.6 6 0.95 0.730 0.648 to 0.802 5.2 6 0.63 0.720 0.656 to 0.778
STS risk score for IE16 3.3 8 0.92 0.706 0.623 to 0.780 3.1 8 0.93 0.740 0.677 to 0.796
Aspecific
EuroSCORE II5 4.2 8 0.84 0.763 0.683 to 0.831 5.1 8 0.65 0.772 0.711 to 0.825
Logistic EuroSCORE6 15.5 8 0.05 0.658 0.572 to 0.736 13.8 8 0.088 0.500 0.433 to 0.568
OPR score7 13.8 8 0.087 0.637 0.551 to 0.717 3.9 8 0.87 0.694 0.656 to 0.753

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic (ROC) curve; DF, degrees of freedom; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; NYHA, New York Heart Association; OPR, Ontario Province Risk; PALSUSE, prosthetic valve, age ≥70, large intracardiac destruction, Staphylococcus spp, urgent surgery, sex (female), EuroSCORE II ≥10%; STS, The Society of Thoracic Surgeons.

a

By the Hosmer–Lemeshow test for logistic regression.

b

By ROC analysis.

All the AEPEI score variables remained significant by bootstrap internal validation (Table 11). By external validation, there were no significant differences between expected and observed deaths (χ2=2.7; 5 df; P=0.75; Table 12) and the discriminatory power of the score was confirmed to be good (AUC, 0.715; 95% CI, 0.638–0.783; Figure 2).

Table 11.

Bootstrap Analysis of the Logistic Regression Model From Which the Original Model of the AEPEI Score was Generateda

Variable A Bootstrap (No. of Samples: 1000)
Bias SE 95% CI P Value
Age >70 years 0.40 −0.01 0.40 −0.41 to 1.15 0.27
BMI >27 kg/m2 b 0.72 0.02 0.38 −0.02 to 1.43 0.03
eGFR <50 mL/minc, d 1.11 0.09 0.39 0.43 to 1.99 <0.01
Dialysis 0.19 −0.13 2.03 −2.09 to 2.06 0.83
NYHA class IV 0.81 0.08 0.43 0.03 to 1.76 0.028
CCS class 4 0.27 −0.02 0.67 −1.22 to 1.54 0.63
Left ventricular ejection fraction, 30% to 50%d 0.26 0.01 0.41 −0.51 to 1.06 0.48
sPAP >55 mm Hgd −1.24 −0.21 1.10 −2.77 to −0.36 0.013
Coronary artery disease 0.33 −5.57 9.88 −20.8 to 3.25 0.502
Previous cardiac surgery 0.41 0.01 0.52 −0.60 to 1.41 0.41
Critical stated 0.97 0.06 0.51 −0.001 to 2.08 0.042
Length of the preop. hospital stay <10 daysb 0.16 −0.04 0.48 −0.78 to 1.10 0.73
Urgent surgical priorityd 0.65 0.04 0.40 −0.12 to 1.50 0.078
Combined CABG 0.28 5.59 9.89 −2.84 to 21.5 0.55
Surgery on thoracic aorta 1.11 0.05 0.76 −0.45 to 2.55 0.086
Prosthetic valve endocarditis 0.37 0.01 0.50 −0.60 to 1.29 0.44

CABG indicates coronary artery bypass grafting; CCS indicates Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; preop., preoperative; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure.

a

All variables with a P<0.1 by univariable analysis were included in the model.

b

The best discriminatory value for in‐hospital mortality by ROC analysis.

c

The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR.

d

The definitions and cut‐off values are those used for the EuroSCORE II.5

Table 12.

The AEPEI Score, the Original Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=161)

Group Death Survival Total
Observed Expected Observed Expected
1 1 0.8 21 21.2 22
2 0 0.2 3 2.8 3
3 5 5.0 76 76.0 81
4 3 1.7 10 11.3 13
5 1 2.7 14 12.3 15
6 4 4.1 12 11.9 16
7 7 6.6 4 4.4 11

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

Figure 2.

Figure 2

External validation of the AEPEI score in a validation sample of 161 patients: discriminatory power. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver‐operating characteristic curve.

The Alternative 3‐Variable AEPEI Score Model

According to the alternate multivariable model (Table 5), an alternate model of the AEPEI score was created (Table 6). This model includes 3 variables and consists of 4 risk classes (Table 7). Its discriminatory power was equivalent to that of the original 5‐variable model (P=0.49); calibration was slightly lower (Tables 8 and 13; Figure 3). There was no significant difference in the performance of the alternate model of the AEPEI score between the Italian and the French series (P=0.29; Table 10). The logistic equation of the alternate AEPEI model was:

p=e(β0+βiXi)1+e(β0+βiXi)

where β0 is the constant of the logistic regression equation (ie, −1.411) and βi the coefficient of the variable Xi. The coefficients and variable values are: for eGFR, βi=1.32 and Xi=1if eGFR <50 mL/min, or 0 if eGFR ≥50 mL/min; for NYHA class IV, βi=0.75 and Xi=1 in case of NYHA class IV, or 0 if not; for critical state, βi=0.86 and Xi=1 if the patient is in critical state, or 0 if not (Table 6).

Table 13.

The AEPEI Score, the Alternate Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=361)

Group Death Survival Total
Observed Expected Observed Expected
1 6 8.5 153 150.5 159
2 6 6.5 55 54.5 61
3 11 8.9 41 43.1 52
4 17 13.1 30 33.9 47
5 16 19.0 26 23.0 42

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

Figure 3.

Figure 3

AEPEI score discriminatory power: the original 5‐variable model vs the alternate 3‐variable model. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic curve.

The 3 variables of the alternate model of the AEPEI score remained significant by bootstrap internal validation (Table 14). By external validation, there were no significant differences between expected and observed deaths (χ2=2.1; 1 df; P=0.15; Table 15) and the discriminatory power of the score was satisfactory (AUC, 0.690; 95% CI, 0.613–0.761).

Table 14.

Bootstrap Analysis of the Logistic Regression Model From Which the Alternate Model of the AEPEI Score was Generateda

Variable A Bootstrap (No. of Samples: 1000)
Bias SE 95% CI P Value
Age >70 years 0.16 <0.001 0.47 −0.81 to 1.05 0.7
BMI >27 kg/m2 b 0.65 0.04 0.41 −0.13 to 1.55 0.08
eGFR <50 mL/minc , d 1.16 0.14 0.41 0.49 to 2.13 <0.01
Dialysis 0.38 −0.08 1.66 −1.68 to 2.18 0.66
NYHA class IV 0.73 0.06 0.41 −0.004 to 1.66 0.05
CCS class 4 0.18 −0.01 0.74 −1.40 to 1.53 0.8
Left ventricular ejection fraction, 30% to 50%d 0.25 −0.01 0.47 −0.75 to 1.14 0.54
Coronary artery disease 0.38 −6.50 10.1 −20.2 to 3.13 0.44
Previous cardiac surgery 0.26 0.01 0.57 −0.82 to 1.44 0.6
Critical stated 0.91 0.08 0.53 −0.07 to 2.07 0.05
Length of the preop. hospital stay <10 daysb 0.06 0.05 0.44 −0.76 to 0.99 0.89
Urgent surgical priorityd 0.59 −0.01 0.44 −0.25 to 1.42 0.14
Combined CABG 0.23 6.51 10.1 −2.68 to 21.1 0.53
Surgery on thoracic aorta 0.94 0.01 0.76 −0.70 to 2.41 0.13
Prosthetic valve endocarditis 0.37 <0.001 0.49 −0.66 to 1.28 0.4

CABG indicates coronary artery bypass grafting; CCS indicates Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; preop., preoperative; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure.

a

All variables with a P<0.1 by univariable analysis except sPAP >55 mm Hg were included in the model.

b

The best discriminatory value for in‐hospital mortality by ROC analysis.

c

The creatinine clearance rate, calculated according to the Cockcroft‐Gault formula, was used to estimate GFR.

d

The definitions and cut‐off values are those used for the EuroSCORE II.5

Table 15.

The AEPEI Score, the Alternate Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=161)

Group Death Survival Total
Observed Expected Observed Expected
1 10 9.0 110 111.0 120
2 1 3.1 21 18.9 22
3 10 8.9 9 10.1 19

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

The AEPEI Incremented EuroSCORE II

The variable BMI >27 kg/m2 was added to the EuroSCORE II. The integrated discrimination improvement was 0.027 (P<0.01). The continuous net reclassification improvement was 0.13 (P=0.37).

The AIC Analysis

With 56 events and 16 variables in the initial logistic regression (with multiple categories that further increase the dimension), the initial model was severely overfit (Table 5). However, according to the AIC,22 each predictive system that was considered in this study except EuroSCORE II was <0.0001 times as probable as the AEPEI score to minimize the information loss. The alternate AEPEI model was 0.0091 times as probable as the original AEPEI model to minimize the information loss (Table 8).

Discussion

Based on analysis of perioperative data from 361 patients from 8 European centers of cardiac surgery, we devised a weighted scoring system to predict in‐hospital mortality postsurgery for IE, namely the AEPEI score. The score is composed of only 5 variables and consists of 7 classes of risk. It was derived from a backward step‐wise logistic regression model that was created to find the independent predictors of in‐hospital death in this series of patients with IE. Although the variables of the model were chosen from a pool of baseline characteristics of the patients, surgical data, and endocarditis‐related features, all the variables of the AEPEI score (BMI >27 kg/m2, eGFR <50 mL/min, NYHA class IV, sPAP >55 mm Hg, and critical state) refer to the patient's preoperative state and include an anthropometric measurement, a laboratory finding, an estimate of resting dyspnea, an invasive (or ultrasound) intracardiac pressure measurement, and a well‐defined composite variable of events indicating the critical preoperative state of the patient.

The goodness of fit of the statistical model was satisfactory and the score showed a good discriminatory power. Both internal and external validation of the AEPEI score were performed. The results of the validation procedures confirmed satisfactory calibration and discriminatory power of the score. In the study population, the AEPEI score performed better than 3 specific scoring systems for in‐hospital (or 30‐day) mortality postsurgery for IE that were considered18, 19, 20 and was superior to 214, 16 of the 3 scoring systems for in‐hospital (or 30‐day) mortality after any cardiac operation that were used for comparison. These results were confirmed also according to a more‐robust approach such as the AIC.22 In addition, the AEPEI score is not intended only for native valve endocarditis, as is the De Feo score,15 and the AEPEI score includes a composite variable, that is, critical state, similar to what applies in the PALSUSE and STS risk scores for IE.18, 20 The AEPEI score was found to be equivalent to EuroSCORE II, which consists of 18 (simple and composite) variables and was modeled from a contemporary surgical cohort of 22 381 patients, including 497 (2.2%) with active IE.5 The EuroSCORE II performance in estimating perioperative risk of patients undergoing surgery for IE has been evaluated by other investigators. Some researchers think that it underestimates post–cardiac surgery mortality in these patients7; others have demonstrated poor calibration and comparatively poor discrimination of the system for emergency cardiac surgery.8 Yet, others believe that the EuroSCORE II may be a useful and appropriate tool for estimating perioperative risk, even for IE patients, and that specific endocarditis features will increase model complexity without an unequivocal improvement in predictive ability.6, 9 Consequently, there is a lack of consensus on this issue. To improve the EuroSCORE II performance in IE, we added the only variable present in the AEPEI score that is not in the EuroSCORE II (namely, BMI >27 kg/m2). Results showed that there was no added value to be derived from adding this variable to EuroSCORE II. Logistic EuroSCORE showed a poor performance in the present study, even though other researchers have reported different results.21

sPAP was the sole hemodynamic parameter that was considered for analysis, which can be evaluated by echocardiography when even a trivial tricuspid regurgitation is present. In the absence of any grade of tricuspid regurgitation, the PAP measurement requires right heart catheterization. The fact that this method is invasive and could be a port of entry for infection make some practitioners reluctant to perform it presurgery. We therefore created an alternate model of the AEPEI score by removing sPAP >55 mm Hg from the original set of variables on which the original score was based. This procedure generated a 3‐variable predictive scoring system (eGFR <50 mL/min, NYHA class IV, and critical state) that had equivalent discriminatory power, but lower goodness of fit, compared to the original AEPEI score. Unlike other predictive systems,14 no infectious agent was related to an increased in‐hospital mortality postsurgery. However, in the present experience, there was an under‐representation of potentially catastrophic organisms, such as fungi and multidrug resistant Gram‐negative bacteria. Although 3 surgical features (urgent priority, combined coronary surgery, and surgery on thoracic aorta) and 1 endocarditis‐related feature (prosthetic valve endocarditis) were found to be related (P<0.1) to in‐hospital death by univariable analysis, they were not confirmed as risk factors by multivariable analyses. Contrary to other previous risk prediction models,4, 5, 6, 7, 14, 16 the variable “prosthetic valve endocarditis” was not found to be an independent risk factor for postoperative in‐hospital death in either of the AEPEI scores. Our data do not provide any firm evidence to explain this discrepancy. No intraoperative features were associated with increased postoperative death, even when a composite variable, such as large intracardiac destruction, was considered. In our opinion, this is a strong point of the AEPEI score. Every practitioner is indeed well aware that results of combined cardiac operations in critically ill patients and the treatment of complex intracardiac lesions can be dependent on the surgeon's experience and expertise, which are both difficult to measure.

Despite the existence of some differences between the Italian and French patients of the study, such as the preoperative characteristics of patients, surgical data, and endocarditis‐related features, there was no significant difference in the discriminatory power of the AEPEI score between the 2 series of patients. Besides, the Italian series included patients operated on between 2000 and 2015. This could imply that the score works well even in populations of patients with different rates of comorbidities from other institutions, and operated on in different historical periods. Obviously, these hypotheses remain to be verified by new studies that take into consideration the impact on outcomes of the use of different surgical methods, different rates of use of surgical techniques, and different perioperative management of patients.

Overall, the performance of the predictive models considered and derived from large populations of patients from North America, that is, STS risk score for IE and OPR score, was lower than the European models. This could stress the concept that outcomes postsurgery for IE are influenced by epidemiological features both of the patient and the involved pathogen.

Study Limitations

The primary limitation of the present study was the small size of the sample. Actually, because the study patients were only 361, it is not surprising that only 5 variables were significant upon multivariable modeling. There may be indeed insufficient power to determine higher dimensional models. However, this is a problem common also to 2 other existing scoring systems that are being used to predict early mortality postsurgery for IE, namely the PALSUSE and the De Feo score,14, 16 and more generally to every predictive system of rare events occurring in patients having rare diseases. Although the present authors are aware that each score performs well in the data set in which it is fit, and the more‐interesting comparison would be of the various scores in the external validation sample, this comparison was impossible because no other score than the AEPEI could be calculated in the validation sample with the available data. Because the pathogen was not identified in about 18% of cases, there is the possibility that some microorganisms were related to increased mortality rate postsurgery, especially because some infections may have been misclassified in terms of etiology because of the frequent rate of coinfections in endocarditis. This study did not evaluate the contribution to mortality risk of potentially important factors, such as antibiotic treatment and preoperative patient preparation. The impact of different strategies of myocardial protection and techniques, such as intraoperative ultrafiltration, on the risk of death was not taken into account.

Conclusions

Nonspecific scoring systems derived from large populations of patients are being used worldwide to predict adverse events after cardiac surgery, even in patients with IE. For this difficult subset of patients, however, risk stratification is of the utmost importance not only to aid the surgeon's decision making, but also to ensure true informed consent for patients and their family, and to allow comparative assessment of quality of care. Specific and simple predictive systems, such as the AEPEI score developed and validated here, could be useful to achieve these objectives. However, further larger validation studies are necessary before introducing the AEPEI score into the clinical practice.

Appendix

The Association pour l'Etude et la Prevention de l'Endocadite Infectieuse (AEPEI) Study Group Members

Main investigators: B. Hoen and X. Duval; F. Alla, A. Bouvet, S. Briancon, E. Cambau, M. Celard, C. Chirouze, N. Danchin, T. Doco‐ Lecompte, F. Delahaye, J. Etienne, B. Iung, V. Le Moing, J. F. Obadia, C. Leport, C. Poyart, M. Revest, C. Selton‐Suty, C. Strady, P. Tattevin, and F. Vandenesch.

Coordinating investigators in the study areas: Y. Bernard, S. Chocron, C. Chirouze, B. Hoen, P. Plesiat, I. Abouliatim, C. De Place, P. Tattevin, M. Revest, P. Y. Donnio, F. Alla, J. P. Carteaux, T. Doco‐Lecompte, C. Lion, N. Aissa, C. Selton‐Suty, B. Baehrel, R. Jaussaud, P. Nazeyrollas, C. Strady, V. Vernet, E. Cambau, X. Duval, B. Iung, P. Nataf, C. Chidiac, M. Celard, F. Delahaye, J. F. Obadia, F. Vandenesch, H. Aumaître, J. M. Frappier, V. Le Moing, E. Oziol, A. Sotto, and C. Sportouch.

Centre National de Référence des Streptocoques: C. Poyart and A. Bouvet.

Centre National de Référence des Staphylocoques: F. Vandenesch, M. Celard, and M. Bes.

Investigators: P. Abassade, E. Abrial, C. Acar, N. Aissa, J. F. Alexandra, N. Amireche, D. Amrein, P. Andre, M. Appriou, M. A. Arnould, P. Assayag, A. Atoui, F. Aziza, N. Baille, N. Bajolle, P. Battistella, S. Baumard, A. Ben Ali, J. Bertrand, S. Bialek, M. Bois Grosse, M. Boixados, F. Borlot, A. Bouchachi, O. Bouche, S. Bouchemal, J. L. Bourdon, A. Bouvet, L. Brasme, F. Bricaire, E. Brochet, J. F. Bruntz, A. Cady, J. Cailhol, M. P. Caplan, B. Carette, J. P. Carteaux, O. Cartry, C. Cazorla, M. Celard, H. Chamagne, H. Champagne, G. Chanques, J. Chastre, B. Chevalier, C. Chirouze, S. Chocron, F. Chometon, C. Christophe, A. Cohen, N. Colin de Verdiere, N. Danchin, V. Daneluzzi, L. David, P. De Lentdecker, F. Delahaye, V. Delcey, P. Deleuze, E. Donal, X. Duval, B. Deroure, V. Descotes‐Genon, K. Didier Petit, A. Dinh, V. Doat, F. Duchene, F. Duhoux, M. Dupont, S. Ederhy, O. Epaulard, M. Evest, J. F. Faucher, B. Fantin, E. Fauveau, T. Ferry, M. Fillod, T. Floch, T. Fraisse, J. M. Frapier, L. Freysz, B. Fumery, B. Gachot, S. Gallien, I. Gandjbach, P. Garcon, A. Gaubert, J. L. Genoud, S. Ghiglione, C. Godreuil, A. Grentzinger, L. Groben, D. Gherissi, P. Guéret, A. Hagege, N. Hammoudi, F. Heliot, P. Henry, S. Herson, B. Hoen, P. Houriez, L. Hustache‐Mathieu, O. Huttin, S. Imbert, B. Iung, S. Jaureguiberry, M. Kaaki, A. Konate, J. M. Kuhn, S. Kural Menasche, A. Lafitte, B. Lafon, F. Lanternier, V. Le Chenault, V. Le Moing, C. Lechiche, S. Lefèvre‐Thibaut, A. Lefort, A. Leguerrier, J. Lemoine, L. Lepage, C. Leport, C. Lepouse ´, J. Leroy, P. Lesprit, L. Letranchant, D. Loisance, G. Loncar, C. Lorentz, P. Mabo, I. Magnin‐Poull, T. May, A. Makinson, H. Man, M. Mansouri, O. Marxcon, J. P. Maroni, V. Masse, F. Maurier, M. C. Meyohas, P. L. Michel, C. Michelet, F. Mechaï, O. Merceron, D. Messika‐Zeitoun, Z. Metref, V. Meyssonnier, C. Mezher, S. Micheli, M. Monsigny, S. Mouly, B. Mourvillier, O. Nallet, P. Nataf, P. Nazeyrollas, V. Noel, J. F. Obadia, E. Oziol, T. Papo, B. Payet, A. Pelletier, P. Perez, J. S. Petit, F. Philippart, E. Piet, C. Plainvert, B. Popovic, J. M. Porte, P. Pradier, R. Ramadan, M. Revest, J. Richemond, M. Rodermann, M. Roncato, I. Roigt, O. Ruyer, M. Saada, J. Schwartz, C. Selton‐Suty, M. Simon, B. Simorre, S. Skalli, F. Spatz, C. Strady, J. Sudrial, L. Tartiere, A. Terrier De La Chaise, M. C. Thiercelin, D. Thomas, M. Thomas, L. Toko, F. Tournoux, A. Tristan, J. L. Trouillet, L. Tual, A. Vahanian, F. Verdier, V. Vernet Garnier, V. Vidal, P. Weyne, M. Wolff, A. Wynckel, N. Zannad, and P. Y. Zinzius.

Sources of Funding

Dr Duval reports grants from Pfizer Inc (New York, NY) outside the submitted work.

Disclosures

None.

Supporting information

Table S1. The Variables Entered in the Analysis

Table S2. Baseline Characteristics of Patients (n=361)*

Table S3. Surgical Features (n=361)*

Table S4. Endocarditis‐Related Features (n=361)*

Acknowledgments

The present authors sincerely thank Fiona Ecarnot (EA3920, University Hospital Jean Minjoz, Besançon, France), for editorial assistance and critical revision, and Mamadou Toure, statistician and data manager at Department of Thoracic and Cardiovascular Surgery of the University Hospital Jean Minjoz of Besançon, France, for his contribution to statistical analysis of this study.

(J Am Heart Assoc. 2017;6:e004806 DOI: 10.1161/JAHA.116.004806.)28729412

References

  • 1. Cahill TJ, Prendergast BD. Infective endocarditis. Lancet. 2016;387:882–893. [DOI] [PubMed] [Google Scholar]
  • 2. Habib G, Lancellotti P, Antunes MJ, Bongiorni MG, Casalta JP, Del Zotti F, Dulgheru R, El Khoury G, Erba PA, Iung B, Miro JM, Mulder BJ, Plonska‐Gosciniak E, Price S, Roos‐Hesselink J, Snygg‐Martin U, Thuny F, Tornos Mas P, Vilacosta I, Zamorano JL; Document Reviewers , Erol Ç, Nihoyannopoulos P, Aboyans V, Agewall S, Athanassopoulos G, Aytekin S, Benzer W, Bueno H, Broekhuizen L, Carerj S, Cosyns B, De Backer J, De Bonis M, Dimopoulos K, Donal E, Drexel H, Flachskampf FA, Hall R, Halvorsen S, Hoen B, Kirchhof P, Lainscak M, Leite‐Moreira AF, Lip GY, Mestres CA, Piepoli MF, Punjabi PP, Rapezzi C, Rosenhek R, Siebens K, Tamargo J, Walker DM. 2015 ESC guidelines for the management of infective endocarditis: the Task Force for the Management of Infective Endocarditis of the European Society of Cardiology (ESC). Endorsed by: European Association for Cardio‐Thoracic Surgery (EACTS), the European Association of Nuclear Medicine (EANM). Eur Heart J. 2015;36:3075–3128. [DOI] [PubMed] [Google Scholar]
  • 3. Revilla A, López J, Vilacosta I, Villacorta E, Rollán MJ, Echevarría JR, Carrascal Y, Di Stefano S, Fulquet E, Rodríguez E, Fiz L, San Román JA. Clinical and prognostic profile of patients with infective endocarditis who need urgent surgery. Eur Heart J. 2007;28:65–71. [DOI] [PubMed] [Google Scholar]
  • 4. Ad N, Holmes SD, Patel J, Pritchard G, Shuman DJ, Halpin L. Comparison of EuroSCORE II, Original EuroSCORE, and the Society of Thoracic Surgeons Risk Score in Cardiac Surgery Patients. Ann Thorac Surg. 2016;102:573–579. [DOI] [PubMed] [Google Scholar]
  • 5. Nashef SA, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR, Lockowandt U. EuroSCORE II. Eur J Cardiothorac Surg. 2012;41:734–744. [DOI] [PubMed] [Google Scholar]
  • 6. Roques F, Michel P, Goldstone AR, Nashef SA. The logistic EuroSCORE. Eur Heart J. 2003;24:882–883. [DOI] [PubMed] [Google Scholar]
  • 7. Tu JV, Jaglal SB, Naylor CD. Multicenter validation of a risk index for mortality, intensive care unit stay, and overall hospital length of stay after cardiac surgery. Steering Committee of the Provincial Adult Cardiac Care Network of Ontario. Circulation. 1995;91:677–684. [DOI] [PubMed] [Google Scholar]
  • 8. Madeira S, Rodrigues R, Tralhão A, Santos M, Almeida C, Marques M, Ferreira J, Raposo L, Neves J, Mendes M. Assessment of perioperative mortality risk in patients with infective endocarditis undergoing cardiac surgery: performance of the EuroSCORE I and II logistic models. Interact Cardiovasc Thorac Surg. 2016;22:141–148. [DOI] [PubMed] [Google Scholar]
  • 9. Patrat‐Delon S, Rouxel A, Gacouin A, Revest M, Flécher E, Fouquet O, Le Tulzo Y, Lerolle N, Tattevin P, Tadié JM. EuroSCORE II underestimates mortality after cardiac surgery for infective endocarditis. Eur J Cardiothorac Surg. 2016;49:944–951. [DOI] [PubMed] [Google Scholar]
  • 10. Wang TK, Wang MT, Pemberton J. Risk scores and surgery for infective endocarditis: a meta‐analysis. Int J Cardiol. 2016;222:1001–1002. [DOI] [PubMed] [Google Scholar]
  • 11. Wang TK, Oh T, Voss J, Gamble G, Kang N, Pemberton J. Comparison of contemporary risk scores for predicting outcomes after surgery for active infective endocarditis. Heart Vessels. 2015;30:227–234. [DOI] [PubMed] [Google Scholar]
  • 12. Grant SW, Hickey GL, Dimarakis I, Cooper G, Jenkins DP, Uppal R, Buchan I, Bridgewater B. Performance of the EuroSCORE models in emergency cardiac surgery. Circ Cardiovasc Qual Outcomes. 2013;6:178–185. [DOI] [PubMed] [Google Scholar]
  • 13. Mestres CA, Castro MA, Bernabeu E, Josa M, Cartaná R, Pomar JL, Miró JM, Mulet J; Hospital Clínico Endocarditis Study Group . Preoperative risk stratification in infective endocarditis. Does the EuroSCORE model work? Preliminary results. Eur J Cardiothorac Surg. 2007;32:281–285. [DOI] [PubMed] [Google Scholar]
  • 14. Martínez‐Sellés M, Muñoz P, Arnáiz A, Moreno M, Gálvez J, Rodríguez‐Roda J, de Alarcón A, García Cabrera E, Fariñas MC, Miró JM, Montejo M, Moreno A, Ruiz‐Morales J, Goenaga MA, Bouza E; Spanish Collaboration on Endocarditis – Grupo de Apoyo al Manejo de la Endocarditis infecciosa en ESpaña (GAMES) . Valve surgery in active infective endocarditis: a simple score to predict in‐hospital prognosis. Int J Cardiol. 2014;175:133–137. [DOI] [PubMed] [Google Scholar]
  • 15. De Feo M, Cotrufo M, Carozza A, De Santo LS, Amendolara F, Giordano S, Della Ratta EE, Nappi G, Della Corte A. The need for a specific risk prediction system in native valve infective endocarditis surgery. Sci World J. 2012;2012:307571. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Gaca JG, Sheng S, Daneshmand MA, O'Brien S, Rankin JS, Brennan JM, Hughes GC, Glower DD, Gammie JS, Smith PK. Outcomes for endocarditis surgery in North America: a simplified risk scoring system. J Thorac Cardiovasc Surg. 2011;141:98–106.e1‐2. [DOI] [PubMed] [Google Scholar]
  • 17. Selton‐Suty C, Célard M, Le Moing V, Doco‐Lecompte T, Chirouze C, Iung B, Strady C, Revest M, Vandenesch F, Bouvet A, Delahaye F, Alla F, Duval X, Hoen B; AEPEI Study Group . Preeminence of Staphylococcus aureus in infective endocarditis: a 1‐year population‐based survey. Clin Infect Dis. 2012;54:1230–1239. [DOI] [PubMed] [Google Scholar]
  • 18. Durack DT, Lukes AS, Bright DK. New criteria for diagnosis of infective endocarditis: utilization of specific echocardiographic findings. Duke Endocarditis Service. Am J Med. 1994;96:200–209. [DOI] [PubMed] [Google Scholar]
  • 19. Moussa ID, Klein LW, Shah B, Mehran R, Mack MJ, Brilakis ES, Reilly JP, Zoghbi G, Holper E, Stone GW. Consideration of a new definition of clinically relevant myocardial infarction after coronary revascularization: an expert consensus document from the Society for Cardiovascular Angiography and Interventions (SCAI). J Am Coll Cardiol. 2013;62:1563–1570. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Kidney Disease: Improving Global Outcomes (KDIGO) Acute Kidney Injury Work Group . KDIGO Clinical Practice Guideline for Acute Kidney Injury. Kidney Int Suppl. 2012;2:1–138. [Google Scholar]
  • 21. Mangram AJ, Horan TC, Pearson ML, Silver LC, Jarvis WR. Guideline for prevention of surgical site infection, 1999. Hospital Infection Control Practices Advisory Committee. Infect Control Hosp Epidemiol. 1999;20:250–278. [DOI] [PubMed] [Google Scholar]
  • 22. Pencina MJ, D'Agostino RB, Pencina KM, Janssens AC, Greenland P. Interpreting incremental value of markers added to risk prediction models. Am J Epidemiol. 2012;176:473–481. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Akaike H. A new look at the statistical model identification. IEEE Trans Automat Contr. 1974;19:716–723. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Table S1. The Variables Entered in the Analysis

Table S2. Baseline Characteristics of Patients (n=361)*

Table S3. Surgical Features (n=361)*

Table S4. Endocarditis‐Related Features (n=361)*


Articles from Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease are provided here courtesy of Wiley

RESOURCES