Abstract
Abstract
Risk models are widely used to predict outcomes after cardiac surgery. Not only is risk modelling applied in the assessment of the relative impact of specific risk factors on surgical outcomes, but also in patient counselling, the selection of treatment options, comparison of postoperative results, and quality-improvement programmes. At least 19 risk-stratification models exist for open-heart surgery. The focus of risk models was originally on pre-operative prediction of mortality. However, major morbidity is in general more common than mortality and the ability to predict only operative mortality is not an adequate method of determining surgical outcome. Multiple intra- and postoperative variables have been excluded in the majority of models and the possible effect of their future inclusion remains to be seen. The unique patient population of sub-Saharan Africa requires a unique risk model that reflects the patient population and levels of care.
Keywords: risk-stratification models, open-heart surgery, intra- and postoperative variables, surgical outcomes
Abstract
Risk models are widely applied in the assessment of the relative impact of specific risk factors on surgical outcomes. These models enable surgeons to select the ideal treatment option for a specific patient and to counsel patients accordingly. They allow for comparison of postoperative results and assist in assessment of quality-improvement programmes.1,2
One of the original aims for the development of cardiac risk models was risk adjustment, allowing fair comparison of treatment outcomes among different institutions or surgeons.2 Risk models were then also applied in clinical decision making, advising individual patients of their peri-operative risk, quality-improvement programmes comparing year-to-year outcomes, as well as allocation of healthcare resources through the prediction of length of stay and postoperative complication rates.1,3
The first widely used risk model, the Parsonnet score, was based on a retrospective analysis of data collected during the 1980s.1,4 Risk modelling since then has been significantly influenced by advances made in diagnostic and interventional technology. The advances in interventional cardiology are believed to have adversely changed the risk profile of patients presenting for cardiac surgery. A greater number of elderly patients, those with associated illnesses, and patients presenting for re-operation are now seen.3,5
At least 19 risk-stratification models exist for open-heart surgery.4 These models are summarised in Table 1.
Table 1. A Summary Of Cardiac Surgery Risk-Stratification Models4,31 (With Permission).
Model | Region | Year of data collection | Year of publication | Number of patients (centres) | Risk variables |
Amphiascore | Netherlands | 1997-2001 | 2003 | 7 282 (1) | 8 |
Cabdeal | Finland | 1990-1991 | 1996 | 386 (1) | 7 |
Cleveland Clinic | USA | 1986-1988 | 1992 | 5 051 (1) | 13 |
EuroSCORE (additive) | Europe | 1995 | 1999 | 13 302 (128) | 17 |
EuroSCORE (logistic) | Europe | 1995 | 1999 | 13 302 (128) | 17 |
French score | France | 1993 | 1995 | 7 181 (42) | 13 |
Magovern | USA | 1991-1992 | 1996 | 1 567 (1) | 18 |
NYS | USA | 1998 | 2001 | 18 814 (33) | 14 |
NNE | USA | 1996-1998 | 1999 | 7 290 (N/A) | 8 |
Ontario | Canada | 1991-1993 | 1995 | 6 213 (9) | 6 |
Parsonnet | USA | 1982-1987 | 1989 | 3 500 (1) | 16 |
Parsonnet (modified) | France | 1992-1993 | 1997 | 6 649 (42) | 41 |
Pons | Spain | 1994 | 1997 | 1 309 (7) | 11 |
STS risk calculator* | USA | 2002–2006 | 2007 | ||
isolated CABG | 774 881 (819) | 49 | |||
valve procedures | 109 759 | 50 | |||
CABG and valve | 101 661 | 50 | |||
Toronto | Canada | 1993-1996 | 1999 | 7 491 (2) | 9 |
Toronto (modified) | Canada | 1996-1997 | 2000 | 1 904 (1) | 9 |
Tremblay | Canada | 1989-1990 | 1993 | 2 029 (1) | 8 |
Tuman | USA | N/A | 1992 | 3 156 (1) | 10 |
UK national score | UK | 1995-1996 | 1998 | 1 774 (2) | 19 |
Veterans Affairs | USA | 1987-1990 | 1993 | 12 712 (43) | 10 |
USA = United States of America, EuroSCORE = European System for Cardiac Operative Risk Evaluation, NYS = New York State, NNE = Northern New England, STS = Society of Thoracic Surgeons, CABG = coronary artery bypass graft surgery, UK = United Kingdom.
*The STS risk calculator consists of seven risk-prediction models in three main categories, namely isolated CABG, valve procedures, and combined CABG and valve procedures. Data represented for the STS risk calculator reflect the number of patients and risk variables captured in the database used for the latest models developed (version 2.61).
The focus of risk models was originally on pre-operative prediction of mortality. However, major morbidity is in general more common than mortality, and the ability to predict only operative mortality is not an adequate method of determining surgical outcome.6 Risk modelling has therefore now in some instances, for example the STS score, been expanded to also allow for the calculation of postoperative morbidity.1
The assessment of variables that may affect patient outcome, which are not necessarily related to pre-operative patient characteristics, are also often not taken into account. These variables include factors related to the skill and experience of the surgical and postoperative care teams, which in turn influence various aspects of the intra-operative and immediate postoperative period.1 Knowledge of adverse intra-operative events has been shown to enhance pre-operative risk prediction, and it is reasonable and necessary to include these variables in risk models.7
Cardiac risk models are generally comparable with regard to the pre-operative risk factors included. The most widely used models (e.g. EuroSCORE) were usually designed for various cardiac surgical procedures and cannot necessarily account for co-morbid diseases and aspects of the underlying pathophysiology/disease progression not included in the calculation of risk.1 However, over-complication of models has also received a lot of criticism from strong supporters of the concept that ‘simple models will sometimes outperform more complex models...’.8 Nevertheless, when the problem is complex, deliberate limitation of the complexity of a model may be unproductive.8
The objective of this article is to provide a review of the most common currently used risk-stratification models in cardiac surgery, with critique in general that relates to practice in sub-Saharan Africa.
Currently used models
There are a number of risk-stratification models in cardiac surgery. Three of the most widely used models, applicable to multiple cardiac procedures, include the European System for Cardiac Operative Risk Evaluation (EuroSCORE), the Society of Thoracic Surgeons (STS) algorithms, and the Parsonnet score.1 These will be briefly discussed.
The European System for Cardiac Operative Risk Evaluation
Combining the most important pre-operative risk factors, the EuroSCORE method has been shown to be a valuable measure for prediction of immediate death after adult cardiac surgery.9 It has been studied widely and is believed by many to be the gold standard.1
The clinical aim of the logistic EuroSCORE was to construct a scoring system predicting early mortality in cardiac surgical patients in Europe on the basis of objective risk factors.3 It was developed from a large European database and eventually included 13 302 patients.3 Prospective data collection took place in eight European countries between September and December of 1995.10
The EuroSCORE provides two methods for calculating predicted outcome: the additive model and the logistic model.3 Validation of the EuroSCORE took place all over the world in a variety of population settings.1,11,12 The logistic EuroSCORE uses logistic regression and the risk has to be calculated in a very complex way. The simpler additive model was derived from the full logistic model by approximating the odds ratios (OR) or modified coefficients from the logistic equation with integers, which can then be added together at the bedside to provide a useful estimate of risk in an individual patient.13,14
Although well established and validated in patient populations, the additive EuroSCORE sometimes underestimates the risk when certain combinations of risk factors co-exist.14 The logistic EuroSCORE on the other hand, has been reported by various centres to over-predict risk despite gradual worsening of the risk profiles of patients and the improvement in cardiac surgical outcomes observed.15 Although the additive model is easier to use, the logistic EuroSCORE has been reported to have a better risk-predictor ability, especially in high-risk patient groups.16,17 The logistic EuroSCORE lacks the prediction of possible morbidity and does not include any intra-operative variables.
Evidence that the EuroSCORE might be out of date led to the collection of new data to enable re-evaluation. Data collection started early in 2010. It was estimated that if enough centres participated, data collection would only take three weeks, but the longest period asked for would be three months.18
The Society of Thoracic Surgeons Algorithms
The Society of Thoracic Surgeons National Cardiac Database (STS NCD) was created in 1989 and it has become the largest clinical database of its kind. The primary aim for the development of the STS model was the support of national quality-improvement programmes. Now it is also used for research focusing on improvement of patient care and outcome.19
The STS NCD is unparalleled in terms of its size and comprehensiveness: data were collected prospectively from more than 950 participating centres in the United States.3,20 The STS NCD now also includes more than 3.6 million surgical procedures.20
STS risk models for various cardiac procedures have been developed since 1999 and have undergone periodic revisions.1,20 A wide variety of endpoints are included in some of the models calculating risk for isolated coronary artery bypass grafting, valve surgery or combined surgeries.1 Twenty-seven new STS adult cardiac surgery models for 2008 have been developed and validated.21
The predictive performance of the STS algorithms is in general comparable with other systems and remains the most widely used model in the United States.1,3 The STS NCD also does not predict possible morbidity and does not include relation to any intra-operative variables.
Parsonnet score
The Parsonnet score was first described in 1989 by Victor Parsonnet. The aim was to construct a straightforward uniform reporting system for levels of operative mortality risk in all cardiac surgical procedures, which included data that are readily available. It includes objective risk factors in order to leave little room for bias.3
Development took place in the United States and included data from 3 500 patients collected between 1982 and 1987. Retrospectively, analyses included uni- and multivariate logistic regression models. The model was prospectively tested in an additional 1 332 procedures at a single site. A second, additive model was also developed. This method was tested at two other centres and the outcomes were comparable to those of the hospitals.3
The Parsonnet score received widespread acceptance, but the predictive accuracy has been diminished as a result of advances in treatment.1 The original score was later modified in 1994 to include 30 new risk factors, according to the SUMMIT system, and is known as the ‘modified Parsonnet score’.22 Again, no morbidity or relation to intra-operative events are being predicted.
Major critique of current models
In recent years, several models have predicted a rising probability of operative mortality while the observed mortality has decreased.23 This is due to an increasing prevalence of high-risk patients, believed to be attributed to significant advances made in diagnostic and interventional cardiology.3,5 Risk models from earlier periods (or retrospectively collected data) can as a result not be used when the goal of the outcome analysis includes determination of the trend of mortality over time. Retrospective data do not only fail to take into calculation the advances in treatment, but also the evolution of the case mix. Therefore, the gold standard for data collection should be speciality-specific, prospectively maintained clinical databases that ought to contain a core set of variables that have been demonstrated to be associated with outcome.24
It is furthermore believed that risk models usually predict outcome more accurately in the setting where it was originally developed.5 Socio-economic conditions, living standards, healthcare funding, and geographic and ethnic origins affect the applicability of risk models in different regions.3 To date no sub-Saharan African country has developed a risk-stratification model applicable to the unique pathology of their native population.
Risk models have diverse clinical aims. The choice of inclusion/exclusion of risk factors as well as the number of risk factors included in the model is influenced by the clinical aim.25 Variables that may affect patient outcome but which are not necessarily related to pre-operative patient characteristics are often not taken into account. These include variables related to adverse intra-operative events as well as co-morbid diseases and aspects of the disease progression not included in the calculation of risk.1 There is no general agreement about the inclusion and exclusion of these factors.8
Risk factors associated with outcomes generally are likely to reflect concurrent, disease-specific variables whereas factors associated with increased resource utilisation reflect serious co-morbid disease.26 It has been suggested that the strength of scores should be that some kind of grouping is provided for patient cohorts.27
Models are sometimes criticised for multicollinearity. Intercorrelations between independent variables included in risk models are known as multicollinearity (e.g. obesity and diabetes mellitus). Including large numbers of independent variables increases the risk of multicollinearity and the consequent inclusion of redundant information in the model.8
Excessively complex models with too many variables will appear to have an extremely good fit in the training set, but generalise poorly to test samples and have limited predictive abilities. This is known as overfitting.18 It is recommended that instead of including all statistically significant variables, one should confine the model to the most powerful predictors or combinations of variables that are the most powerful predictors.8
Different operators will provide different interpretations to categorical risk factors, such as chronic obstructive pulmonary disease and unstable angina. Even with clearly stated definitions, a degree of personal interpretation takes place, resulting in different final risk scores.8 Wherever practical, continuous data should be used and there should be strict standardisation of definitions for the risk factors and the outcomes measured.18
Some models have been criticised for not being able to predict individual risk. Currently utilised models are derived from the studies of very large populations and although very effective at predicting population outcomes, are not necessarily suited for the prediction of risk of an individual patient.1,26 As previously stated, it is generally accepted that the number of independent variables that can be included in a multivariate logistic regression depends on the number of events: there should be a variable-to-event ratio of 1:10 .8,25 For that reason, to contemplate a 15 risk-factor model with a mortality rate of 3%, at least 5 000 cases are required to achieve adequate sample size.25 This also means that even in a unit performing 500 surgeries per annum, it would take at least 10 years to meet the required sample size.
Most of the scores are unsuitable for individual risk prediction despite the sample size. This is due to a simple methodological reason: the application of logistic regression models mathematically describes a multiphasic, more complex behaviour of a survival curve that cannot achieve enough statistical power to achieve enough statistical accuracy for individual predictions.27
Lastly, the focus of cardiac risk models was originally on pre-operative prediction of mortality, but complications and potentially preventable morbidity are also important outcomes.1,3 Ideally, a range of outcomes should be reported: mortality, morbidity, changes in functional status and quality of life, cost of care as well as patient-reported perceptions of the non-technical aspects of care.3
Discussion
Open-heart surgery is one of the most expensive surgical procedures in a hospital. The cost of surgery can vary enormously between patients with an uncomplicated recovery and those who suffer from postoperative complications.28
Risk stratification is not only essential for improvement of surgical outcomes, but also allows quality analysis and meaningful comparison of outcomes. Kolh (2006) stated that it should be an integral part of cardiac surgical practice, and quoted ‘... being as essential to the surgeon as the knowledge of anatomy and techniques’.
Clinical research and treatment strategies of cardiovascular disease as well as risk-prediction models have largely been developed in North America and Europe. However, the applicability of results derived from these investigations is unknown.29 Popular risk models have been studied extensively around the world. Of these models, the European System for Cardiac Operative Risk Evaluation (EuroSCORE) has been validated in different population settings and remains for many, the gold standard.1,12
Even though the mortality outcome predicted with the EuroSCORE seems applicable in South African practice, different stages of epidemiological transition are often at work in South Africa and changing patterns in the development of cardiovascular disease are observed in the various ethnic populations.11,30 Predictions of postoperative recovery in the South African setting are therefore less well established. Given the economic impact of interventional therapy and complications related to intervention, it is incumbent on clinicians in South Africa to ensure the optimal application of interventional therapy and resource allocation.
As a result, cardiac surgeons in South Africa face three options with regard to risk stratification: to simply use external risk scores, knowing that the identified risks and attributed weights might not correctly reflect their patient population; to adjust the weight of the risk factors on the basis of their own data; or to derive a new internal model from their own data and recalibrate it periodically.8 Despite continuous research, no perfect risk-prediction model exists and the shortcomings of the different models and criticism of the modelling processes have been comprehensively discussed.1,3,25
Variables that may affect patient outcome but which are not necessarily related to pre-operative patient characteristics, are often not taken into account. These include the skill and experience of the surgical and postoperative care team, which influences various aspects of the intra-operative and immediate postoperative period.1 For that reason, current risk-stratification models can only score the risk of care and not the quality of suitable care.
Conclusion
It is our hypothesis that the development of an integrated model that includes hitherto unutilised intra-operative risk factors as well as other known peri-operative risk factors predictive of outcome should enable more accurate risk stratification and consequently improved quality management of surgical treatment of patients with cardiovascular disease in the South African setting. Such a model would allow for improved clinical decision making, assessment of surgical performance and quality of care. Increasing efficiency through prediction of postoperative complications would ultimately facilitate decisions to operate, allocate resources and estimate costs.28
Contributor Information
Carla Prins, Email: carla.prins@integriumsa.co.za, Department of Cardiothoracic Surgery, University of the Free State, Bloemfontein, South Africa.
I De Villiers Jonker, Email: devilliers.jonker@ualberta.ca, Department of Cardiothoracic Surgery, University of the Free State, Bloemfontein, South Africa.
Francis E Smit, Department of Cardiothoracic Surgery, University of the Free State, Bloemfontein, South Africa.
Lizelle Botes, School of Health Technology, Central University of Technology, Bloemfontein, South Africa.
References
- 1.Granton J, Cheng D. Risk stratification models for cardiac surgery. Semin Cardiothorac Vasc Anesth. 2008;12(3):167–174. doi: 10.1177/1089253208323681. [DOI] [PubMed] [Google Scholar]
- 2.Shahian DM, Blackstone EH, Edwards FH, Grover FL, Grunkemeier GL, Naftel DC. et al. Cardiac Surgery Risk Models: A Positon Article. Ann Thorac Surg. 2004;78:1868–1877. doi: 10.1016/j.athoracsur.2004.05.054. [DOI] [PubMed] [Google Scholar]
- 3.Heijmans JH, Maessen JG, Roekaerts HJ. Risk stratification for adverse outcome in cardiac surgery. Eur J Anaesth. 2003;20:515–527. doi: 10.1017/s0265021503000838. [DOI] [PubMed] [Google Scholar]
- 4.Nilsson J, Algotsson L, Hoglund P, Luhrs C, Brandt J. Comparison of 19 preoperative risk stratification models on open-heart surgery. Eur Heart J. 2006;27:867–874. doi: 10.1093/eurheartj/ehi720. [DOI] [PubMed] [Google Scholar]
- 5.Kolh P. Importance of risk stratification models in cardiac surgery. Eur Heart J. 2006;27:768–769. doi: 10.1093/eurheartj/ehi792. [DOI] [PubMed] [Google Scholar]
- 6.Chong C-F, Li Y-C, Wang T-L, Chang H. Stratification of adverse outcomes by preoperative risk factors in coronary artery bypass graft patients: An artificial neural network prediction model [online]. http://pubmedcentral.nih.gov/articlerender.fcg?artid=1480326. AMIA Ann Symp Proc. 2003:160–164. Available from: [Accessed 13.03.2008] [PMC free article] [PubMed]
- 7.Stoica SC, Sharples LD, Ahmed I, Roques F, Large SR, Nashef SAM. Preoperative Risk Prediction And Intraoperative Events In Cardiac Surgery. Eur J Cardiothorac Surg. 2002;21:41–46. doi: 10.1016/s1010-7940(01)01077-6. [DOI] [PubMed] [Google Scholar]
- 8.Ranucci M, Castelvecchio S, Menicanti L, Frigiola A, Pelissero G. Risk of asessessing mortality risk in elective cardiac operations – age, creatinine, ejection fraction, and the law of parsimoy. Circulation. 2009;119:3053–3061. doi: 10.1161/CIRCULATIONAHA.108.842393. [DOI] [PubMed] [Google Scholar]
- 9.Biancari F, Kangasniemi O-P, Luukkonen J, Vuorisalo S, Satta J, Pokela R, Juvonen T. Euroscore predicts immediate and late outcome after coronary artery bypass surgery. Ann Thorac Surg. 2006;82:57–61. doi: 10.1016/j.athoracsur.2005.11.039. [DOI] [PubMed] [Google Scholar]
- 10.Roques F, Nashef SAM, Michel P, Gauducheau E, Vincentiis C, Baudet E. et al. Risk factors and outcome in European cardiac surgery: Analysis of the Euroscore multinational database of 19030 patients. Eur J Cardiothorac Surg. 1999;15:816–823. doi: 10.1016/s1010-7940(99)00106-2. [DOI] [PubMed] [Google Scholar]
- 11.Swart MJ, Joubert G. The Euroscore does well for the surgeon outside Europe (Letter to the Editor). Eur J Cardiothorac Surg. 2004;25:145. doi: 10.1016/s1010-7940(03)00655-9. [DOI] [PubMed] [Google Scholar]
- 12.Cortina Romero JM. Criteria for using risk models in cardiac surgery. Rev Esp Cardiol. 2008;61(6):567–571. [PubMed] [Google Scholar]
- 13.Jin R, Grunkemeier GL. Additive vs. logistic risk models for cardiac surgery mortality. Eur J Cardiothorac Surg. 2005;28:240–243. doi: 10.1016/j.ejcts.2005.04.008. [DOI] [PubMed] [Google Scholar]
- 14.European System For Cardiac Operative Risk Evaluation (EuroSCORE). What is EuroSCORE. http://www.euroscore.org/what_is_euroscore.htm. doi: 10.1016/s1010-7940(99)00134-7. [online]. Available from: [Accessed: 09.12.2010] [DOI] [PubMed]
- 15.Nashef SAM. The new EuroSCORE project. Kardiol Pol. 2010;68:128–129. [PubMed] [Google Scholar]
- 16.Michel P, Roques F, Nashef SAM. et al. Logistic or additive EuroSCORE for high risk patients? Eur J Cardiothorac Surg. 2003;23:684–687. doi: 10.1016/s1010-7940(03)00074-5. [DOI] [PubMed] [Google Scholar]
- 17.Zingone B, Pappalardo A, Dreas L. Logistic versus additive EuroSCORE. A comparative assessment of the two models in an independent population sample. Eur J Cardiothorac Surg. 2004;26:1134–1140. doi: 10.1016/j.ejcts.2004.09.003. [DOI] [PubMed] [Google Scholar]
- 18.European System for Cardiac Operative Risk Evaluation (EuroSCORE). New EuroSCORE 2010. http://www.euroscore.org/EuroSCORE2010.htm. doi: 10.1016/s1010-7940(99)00134-7. [online] Available from: [Accessed: 09.03.2010] [DOI] [PubMed]
- 19.Welke KF, Ferguson TB jnr, Coombs LP, Dokholyan RS, Murray CJ, Schrader MA, Peterson ED. Validity of the Society of Thoracic Surgeons national adult cardiac surgery database. Ann Thorac Surg. 2004;77(4):1137–1139. doi: 10.1016/j.athoracsur.2003.07.030. [DOI] [PubMed] [Google Scholar]
- 20.Shahian -DM, O’Brien SM, Filardo G, Ferraris VA, Haan CK, Rich JB. et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: Part 1 – coronary artery bypass grafting surgery. Ann Thorac Surg. 2009;89((1) Suppl 1):S2–S22. doi: 10.1016/j.athoracsur.2009.05.053. [DOI] [PubMed] [Google Scholar]
- 21.Shahian DM, Edwards FH. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: Introduction. Ann of Thorac Surg. 2009;88((1) Suppl 1):S1. doi: 10.1016/j.athoracsur.2009.05.054. [DOI] [PubMed] [Google Scholar]
- 22.Hattler BG, Madia -C, Johnson C, Armitage JM, Hardesty RL, Kormos RL. et al. Risk stratification using the Society of Thoracic Surgeons programme. Ann Thorac Surg. 1994;52:1348–1352. doi: 10.1016/0003-4975(94)91911-9. [DOI] [PubMed] [Google Scholar]
- 23.Ivanov J, Tu JV, Naylor CD. Ready-made, recalibrated, or remodelled? Circulation. 1999;99:2098–2104. doi: 10.1161/01.cir.99.16.2098. [DOI] [PubMed] [Google Scholar]
- 24.Shahian DM, Blackstone EH, Edwards FH, Grover FL, Grunkemeier GL, Naftel DC. et al. Cardiac surgery risk models: A positon article. Ann Thorac Surg. 2004;78:1868–1877. doi: 10.1016/j.athoracsur.2004.05.054. [DOI] [PubMed] [Google Scholar]
- 25.Omar RZ, Ambler G, Royston P, Eliahoo J, Taylor KM. Cardiac surgery risk modelling for mortality: A review of current practice and suggestion for improvement. Ann Thorac Surg. 2004;77:2232–2237. doi: 10.1016/j.athoracsur.2003.10.032. [DOI] [PubMed] [Google Scholar]
- 26.Ferraris VA, Ferraris SP. In Cohn LH, Edmunds LH. Cardiac Surgery in the Adult. New York: McGraw-Hill; 2003. Risk stratification and comorbidity. pp. 187–224. [Google Scholar]
- 27.Gummert JF, Funkat A, Osswald B, Beckmann A, Schiller W, Krian A. et al. EuroSCORE overstimates the risk of cardiac surgery: Results from the national registry of the German Society of Thoracic and Cardiovascular Surgery. Clin Res Cardiol. 2009;98:363–369. doi: 10.1007/s00392-009-0010-8. [DOI] [PubMed] [Google Scholar]
- 28.Kurki TS, Hakkinen U, Lauharanta J, Ramo J, Leijala M. Evaluation of the relationship between preoperative risk scores, postoperative and total length of stays and hospital costs in coronary bypass surgery. Eur J Cardiothorac Surg. 2001;20:1183–1187. doi: 10.1016/s1010-7940(01)00988-5. [DOI] [PubMed] [Google Scholar]
- 29.Steyn K, Sliwa K, Hawken S, Commerford P, Onen C, Damasceno A. et al. Risk factors associated with myocardial infarction in Africa. Circulation. 2005;112:3554–3561. doi: 10.1161/CIRCULATIONAHA.105.563452. [DOI] [PubMed] [Google Scholar]
- 30.Opie LH, Mayosi BM. Cardiovascular disease in sub-Saharan Africa. Circulation. 2005;112:3536–3540. doi: 10.1161/CIRCULATIONAHA.105.597765. [DOI] [PubMed] [Google Scholar]
- 31.The Society of Thoracic Surgeons (STS) STS Web Risk Calculator Descriptor v2.61. http://209.220.160.181/STSWebRiskCalc261/de.aspx. [online] Available from: [Accessed 09.12.2010]