Abstract
Background
Increasing guideline adherence in the management of acute coronary syndrome (ACS) in hospitals potentially reduces heart failure and mortality. Therefore, an expert panel identified three guideline recommendations as the most important aims for improvement in ACS care, i.e. timely invasive treatment, use of risk scoring instruments and prescription of secondary prevention medication at discharge.
Aims
This study aims to evaluate in-hospital guideline adherence in the care of patients diagnosed with ACS and to identify associated factors.
Methods
The study has a cross-sectional design. Data are collected in 13 hospitals in the Netherlands by means of retrospective chart review of patients discharged in 2012 with a diagnosis of ACS. The primary outcomes will be the percentages of patients receiving timely invasive treatment, with a documented cardiac risk score, and with a prescription of the guideline-recommended discharge medication. In addition, factors associated with guideline adherence will be studied using generalised linear (mixed) models.
Discussion
This study explores guideline adherence in Dutch hospitals in the management of patients diagnosed with ACS, using a data source universally available in hospitals. The results of this study can be informative for professionals involved in ACS care as they facilitate targeted improvement efforts.
Keywords: Study protocol, Acute coronary syndrome, Quality indicator, Time-to-treatment, Risk assessment/methods, Acute coronary syndrome/drug therapy
Background
Patients diagnosed with an acute coronary syndrome (ACS) have a high risk of dying from their condition. Mortality rates differ for the three clinical manifestations of ACS: ST-segment elevation myocardial infarction (STEMI), non-ST-segment elevation myocardial infarction (NSTEMI) and unstable angina (UA) [1]. The symptoms of ACS are usually caused by the same pathophysiological mechanism, i.e. coronary stenosis. However, the differences in severity of coronary stenosis and mortality have led to differences in the management of ACS [2, 3].
Improved management strategies for patients diagnosed with ACS have led to a decrease in mortality rates in the past years [4–6]. For patients with STEMI the strategy progressed from acute pharmacological intervention (thrombolysis) to immediate percutaneous coronary intervention (PCI) [7]. In the management of NSTEMI and UA patients, risk scoring instruments were developed and implemented to estimate patients’ future risk of major adverse cardiac events in order to weigh the risks and benefits of invasive treatment [8]. Independent of the type of ACS, prescribing secondary prevention medication further reduces morbidity and prevents additional episodes of ACS [9]. Using the aforementioned strategies increases patients’ chances of survival [10, 11] and these strategies are therefore incorporated in international cardiology guidelines [12, 13].
However, previous studies reported that not all patients are treated according to these guideline-recommended strategies [14, 15]. For example, patients with higher age, female sex, prior heart failure, renal insufficiency or coronary artery bypass graft (CABG) surgery during admission were less likely to receive guideline-recommended discharge medication [16]. Also, variation in guideline adherence between hospitals has been reported [10]. To identify room for improvement in the management of ACS, it is imperative to monitor guideline adherence and to identify associated factors.
The objective of this study is therefore to determine the degree of ACS guideline adherence in Dutch hospitals. A Dutch expert panel identified timely invasive treatment, use of cardiac risk scoring instruments and prescribing guideline-recommended discharge medication as the most important aims for improvement in ACS care. A secondary objective of this study is to explore patient and hospital characteristics associated with guideline adherence. In the present paper the design of the study will be outlined.
Research questions
To what degree are:
patients diagnosed with STEMI treated with PCI within 90 min of first (para)medical contact?
cardiac risk scoring instruments used in the management of patients diagnosed with NSTEMI/UA?
the recommended medicines for secondary prevention prescribed to patients diagnosed with ACS at discharge from the hospital?
Additionally, what patient and hospital characteristics are associated with guideline adherence?
Methods/design
Design
The study has a cross-sectional design.
Setting
In the Netherlands 30 out of the 91 hospitals offer PCI, of which 16 also provide CABG surgery.
The three guideline recommendations monitored in the present study were identified from the European Society of Cardiology guidelines by an expert panel consisting of cardiologists, an emergency department medical resident, an intensive care/cardiac care nurse and health care scientists. Adherence to these three recommendations is measured over 2012, the last year of a national quality improvement program. The program aims to decrease in-hospital mortality caused by ten high-risk patient safety threats [17], including ACS.
Selection of hospitals
The study is being conducted in 13 hospitals, selected by means of a multi-stage random sampling procedure. Initially six PCI-capable and six non-PCI-capable hospitals with a cardiology department were randomly selected from a pool of 40 randomly selected hospitals. Three PCI-capable hospitals declined participation, for which three additional PCI-capable hospitals were selected. Because the number of STEMI patients was relatively small, an additional PCI-capable hospital was selected. The hospitals are located in 7 of the 12 Dutch provinces, with bed capacities ranging between 200 and 1200 beds (Table 1).
Table 1.
Characteristics of hospitals included in the study
| Hospital ID | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 |
| Type | Gen | Gen | Gen | Teach | Teach | Gen | Teach | Teach | Teach | Acad | Teach | Teach | Acad |
| Bed capacity | 200–400 | 200–400 | 200–400 | 400–600 | 400–600 | 800–1000 | 600–800 | 600–800 | 600–800 | 600–800 | 1000–1200 | 800–1000 | 800–1000 |
| PCI | No | No | No | No | No | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| CABG | No | No | No | No | No | No | No | No | Yes | Yes | Yes | Yes | Yes |
Due to privacy reasons, bed capacity is categorised and the province per hospital is not included
Gen general hospital; teach tertiary teaching hospital; Acad academic hospital; PCI percutaneous coronary intervention; CABG coronary artery bypass graft surgery
Data collection
The data are collected by means of retrospective chart review of electronic and/or paper-based medical, nursing and catheterisation laboratory charts of patients discharged between January 1st and December 31st 2012. Monthly, potential study charts are selected from the hospital billing system using diagnosis-treatment combination codes. Charts of patients discharged with a confirmed diagnosis of ACS (indicated in the discharge letter) are considered for inclusion (Fig. 1). When the discharge diagnosis is unclear, the chart is discussed with a cardiologist or other attending physician working in the field of cardiology. Charts of patients without a discharge diagnosis of ACS, a secondary ACS (e.g. due to anaemia), elective procedures, missing or uninformative charts, and charts of patients under the age of 18 years are excluded from the study. Moreover, additional exclusion criteria were defined for each process indicator separately. For timely invasive treatment, charts of STEMI patients not going for acute PCI are excluded. For use of risk scoring instruments, charts of patients transferred from another hospital are excluded. For discharge medication, charts of patients who were transferred to another hospital, patients who died during their admission or received palliative treatment are excluded.
Fig. 1.
Flow chart of the selection of patient charts. ACS acute coronary syndrome; STEMI ST-segment elevation myocardial infarction; NSTEMI non-ST-segment elevation myocardial infarction; UA unstable angina
If the monthly number of charts exceeds the screening capacity, screening of the charts is performed in chronological order of discharge representing STEMI and NSTEMI/UA equally, and terminated when the chart abstractors are practically unable to screen additional charts.
In two hospitals the pre-selection procedure based on the hospital billing system is not possible. Therefore in one hospital the pre-selection of charts is performed by requesting all charts of patients with a suspected or confirmed diagnosis of ACS through the cardiology department’s secretariat. In the other hospital, local hospital regulations require that patients with a suspected ACS are informed about the study and asked to give informed consent before their chart can be considered for inclusion. Due to the declined invitations and deviations in inclusion procedures, data collection in 5 hospitals will comprise 9 or 10 months instead of 12 months.
Study outcomes
The study has three main outcome measures. First, the percentage of STEMI patients in which the PCI procedure started within 90 minutes from first (para)medical contact. Second, the percentage of NSTEMI or UA patients where use of a validated risk scoring instrument was documented. Finally, the percentage of ACS patients with a prescription of the recommended discharge medication, documentation of a contraindication or other reason for not receiving the recommended medication. Additionally, patient and hospital characteristics associated with guideline adherence will be identified.
Recorded variables
From all charts, the following information is abstracted: demographic and clinical information including gender, age, cardiac history, risk factors, biomarker values, electrocardiogram findings, resuscitation, heart failure, cardiogenic shock on arrival and month of discharge (Table 2).
Table 2.
Information recorded for all ACS patients
| General information | Discharge medication (yes/no) |
| Gender | Acetylsalicylic acid |
| Date of birth | Thienopyridine |
| Admission date and time | Statin |
| Symptoms | Beta blocker |
| Discharge date | Angiotensin-converting enzyme inhibitor |
| Discharge status (discharged, deceased, unknown) | |
| Contraindications (yes/no) | |
| History of cardiac disease (yes/no) | Acetylsalicylic acid |
| Coronary vascular disease | Coagulation defect |
| Peripheral vascular disease | Active peptic ulcer (ulcus pepticum) |
| (Unstable) angina pectoris | Stroke (bleeding) |
| Acute myocardial infarction | Liver failure |
| Coronary artery bypass graft surgery, year: ______ | Kidney failure |
| Percutaneous coronary intervention, year: ______ | Allergy/oversensitivity |
| Intervention/acute myocardial infarction <6 months | Treatment with anticoagulant medication |
| G6PD-deficiency | |
| Risk factors (yes/no) | Other: |
| Diabetes mellitus | Thienopyridine |
| Hypertension | Transient ischemic attack/cerebrovascular accident |
| Kidney failure | Active peptic ulcer (ulcus pepticum) |
| Chronic heart failure | Liver failure |
| Positive family history | Pathological bleeding (from ulcus pepticum or intracranial bleeding) |
| Smoker | |
| Previous smoker | Other: |
| Elevated cholesterol levels (statin use in history, hyperlipidaemia, hypercholesterolaemia) | Statin |
| Obesity (body mass index >30 kg/m2) | Liver function impairment |
| Renal impairment | |
| Coronary stenosis >50 % (in history) | Other: |
| Age >70 year | Beta blocker |
| Male sex | Sick-sinus syndrome |
| Aspirin use (<7 days) | 2nd and 3rd degree AV block (ECG) |
| Hypotension | |
| Vital functions | Cardiogenic shock |
| Cardiogenic shock (yes/no) | Sinus bradycardia |
| Heart failure (yes/no) | Unstable or untreated heart failure |
| Resuscitation (yes/no) | Pheochromocytoma |
| Blood pressure on arrival (mmHg) | Bronchial asthma (anamnesis) |
| Heart rate (beats per minute) | Severe peripheral circulation defects |
| Electrocardiogram date and time | Metabolic acidosis |
| Electrocardiogram interpretation | Pulmonary hypertension |
| Biomarker values (troponin, creatinin kinase (CK), creatinin kinase-muscle/brain (CK-MB), creatinin) | Kidney failure |
| Liver failure | |
| Cardiac rehabilitation (yes/no) | Myocardial infarction with heart frequency <45, P-Q >0.24, systolic blood pressure <100 |
| Enlistment for cardiac rehabilitation | Other: |
| Angiotensin-converting enzyme inhibitor | |
| Kidney failure | |
| Other: |
ACS acute coronary syndrome
In addition, for the timely invasive treatment indicator, the following variables are recorded: routing of the patient, type of first (para)medical contact, place of first electrocardiogram, type of treatment, and the dates and times of first (para)medical contact, first (ambulance/general practitioner) electrocardiogram and sheath insertion (start of PCI) (Table 3).
Table 3.
Additional recorded variables for STEMI patients
| General information |
| Routing out-of-hospital |
| Type of treatment (pharmacological, acute percutaneous coronary intervention, non-acute percutaneous coronary intervention, coronary artery bypass graft surgery) |
| Discipline of first (para)medical contact |
| Discipline of first electrocardiogram |
| Number of diseased vessels |
| Location of stenoses |
| Time variables |
| Symptom onset |
| First (para)medical contact |
| First electrocardiogram |
| Sheath insertion |
| First balloon inflation or thrombus aspiration |
STEMI ST-segment elevation myocardial infarction
To evaluate cardiac risk score adherence, application of a validated risk scoring instrument (e.g. GRACE [18, 19], TIMI [20], FRISC [21], HEART [22] and PURSUIT [8]), type of instrument, risk score outcome, date of application, and type of treatment are recorded (Table 4).
Table 4.
Additional recorded variables for NSTEMI and UA patients
| General information |
| Routing in-hospital |
| Catheterisation (yes/no) |
| Type of treatment (pharmacological, percutaneous coronary intervention, coronary artery bypass graft, unknown, other) |
| Risk score |
| Use of validated risk score (yes/no) |
| Date of application |
| Type of instrument(s) |
| Risk score outcome |
| Risk score outcome classification |
| Additional diagnostics |
NSTEMI Non-ST-segment elevation myocardial infarction; UA unstable angina
Finally, for discharge medication, prescription of acetylsalicylic acid, thienopyridine, statin, beta blocker and angiotensin-converting enzyme (ACE) inhibitor and contraindications or other reasons for not prescribing all or some of the medication are recorded (Table 2). Contraindications were derived from an annually updated database containing information about all medication registered in the Netherlands [23].
Abstraction of data
All data are collected on standard case report forms. Variables are defined in codebooks. Two researchers (JT & JE) developed the codebooks and case report forms based on the European Society of Cardiology guidelines. The case report forms were discussed within the research group, tested in two pilot measurements and adjusted accordingly. The data are collected by six chart abstractors who were introduced to the subject of ACS and instructed in the chart review procedures by JT and JE. Chart reviews were supervised until the quality of the chart reviews was satisfactory. The data are entered into a database using a data entry program with fixed entry fields (BLAISE version 4.7, Statistics Netherlands) and compared with the original case report form by a second researcher.
To ensure reliability of the data and to assess the quality of the codebook, a sample of charts (5–10 %) is independently screened again by one of the five other chart abstractors. The two case report forms are compared, and differences are discussed until consensus is reached. If necessary, changes are made in the original case report form. The reliability between the chart abstractors will be calculated by means of the percentage of agreement for each variable.
Statistical analyses
Missing data
Missing data patterns will be analysed by means of missing value analyses. Depending on the pattern [24], missing values will be imputed by means of a single imputation (missing completely at random) or multiple imputation procedure (missing at random) [25].
Descriptive statistics
The degree of adherence to the three process indicators will be presented by descriptive statistics. Associations of patient and hospital characteristics with guideline adherence are studied in separate analyses.
Timely invasive treatment
The time to PCI in minutes will be entered as a continuous dependent variable in a generalised linear model taking into account its distribution, as time variables are generally not normally distributed. In univariate analyses, associations of the independent variables, i.e. patient and admission characteristics, are studied. To account for clustering of patient data within hospitals, the variable ‘hospital’ and its significant interactions with any other of the predictor variables will be entered as a covariate in all univariate models [26]. This is because the hospital sample size (7 PCI-capable hospitals) is considered small for multilevel regression analysis [27]. All variables and interactions significantly (p ≤ 0.05) associated with the time to PCI will be included in the multiple generalised linear model. Furthermore, to minimise the probability of making a type II error, all non-significant variables from the univariate models will be added to the multiple generalised linear model one by one. Significant variables (p ≤ 0.05) will be added to the final model.
Use of risk scoring instruments
Associations of independent variables with the use of cardiac risk scoring instruments will be studied by means of a generalised linear mixed model (GLMM). In the analysis the binary dependent variable will be the use of a validated risk score instrument. Independent variables will be patient characteristics, hospital characteristics and month of discharge. To account for clustering of the data, the model will comprise random effects for hospitals. First, independent variables will be tested separately correcting for the random hospital effects. Second, all independent variables with a significance level below p ≤ 0.15 will be selected. Next, pairs of selected independent variables will be tested jointly.
Last, all significant (p ≤ 0.05) variables from the previous steps will be included in the final multivariable model. This final step also comprises a cautious consideration of significant (p ≤ 0.05) interaction terms.
Discharge medication
Associations of independent variables with the prescription of the recommended discharge medication will be studied by means of GLMM. In these analyses, prescription of the five guideline-recommended medicines or documentation of contraindications (yes/no) will be the binary dependent variable. The effects of the independent variables including patient, hospital and discharge characteristics will be tested in univariate analyses. All variables with a significant association (p ≤ 0.05) with the dependent variable will be included in a multivariable model. To account for the effects of collinearity, all variables not significantly related to prescription of the recommended discharge medication in the univariate models will be added to the multivariable generalised linear mixed model one by one. Interactions will be tested and added to the multivariable model in case of a significant effect. In all models, hospital will be entered as a random effect variable to account for clustering of the data. As not all medicines are indicated for all patients with ACS according to the European Society of Cardiology guidelines (e.g. ACE-inhibitors are recommended for all patients with ACS, but only indicated for those patients with a reduced cardiac function), additional models will be created to analyse the effects of patient and hospital characteristics on the prescription of ≤3 and ≥4 medicines or documentation of a contraindication.
Software
The data will be analysed in IBM SPSS Statistics (version 20 for Windows) and R (version 3.0.0 for Windows).
Ethical approval and confidentiality
The study protocol was approved by the medical ethics review committee of the VU University Medical Center. To protect patients’ and hospitals’ privacy, they are assigned a unique observation code. All data are stored on a password protected network server of the VU University Medical Center, to which only the participating researchers have access. All chart abstractors signed a confidentiality agreement and the study was registered with the Dutch Data Protection Agency.
Discussion
This paper describes the design of a study of the quality of Dutch ACS care by evaluating the degree to which hospitals adhere to three key quality indicators from (inter)national guidelines and by exploring factors associated with guideline adherence.
Previous North American studies that monitored guideline adherence have successfully identified associated factors [10, 16, 28], after which targeted quality improvement efforts could be applied. These efforts increased the likelihood that patients were treated on time with PCI [29], risk scores were documented [30] and the recommended discharge medication was prescribed [31]. Therefore the monitoring of guideline adherence as the foundation for targeted quality improvement efforts seems promising.
The three guideline recommendations evaluated in this study were selected from the European Society of Cardiology guidelines [12, 13], but are also included in other (inter)national guidelines [32–34]. The methods used in this study can be applied to evaluate the process of ACS care in other countries, especially in countries where large, national registries of guideline adherence are lacking.
Potential limitations
In designing the study, several limitations have to be taken into account. First, the documented information in the charts and variability between the chart abstractors may affect the reliability of the data. This will be reduced by using standardised case report forms, a codebook and by interim reliability checks of the data. Second, using the diagnosis in the discharge letter as inclusion criterion may not be as reliable as applying our own diagnostic criteria. However, it was considered important to take into account the interpretation of the treating physician at the time of hospitalisation of the patient. Third, the presence of researchers on site, and quarterly feedback from the national quality improvement program might influence hospitals’ performance on the outcomes. However, in a report on the evaluation of the quality improvement program the effect of this national intervention was limited [35]. Finally, the selection of hospitals and patients could not be performed completely randomly due to practical limitations. However, the hospitals included in this study were geographically spread over the country, thereby limiting the influence of potential regional variation in guideline adherence. Additionally the outcomes of this study are corrected for the influence of individual hospitals in the statistical models.
Conclusion
Evidence-based guidelines are of vital importance in safely and effectively treating patients diagnosed with ACS. The results of this study will provide insight into the degree of guideline adherence in Dutch hospitals for the management of patients with ACS and identify room for further improvement. Furthermore, patient and hospital characteristics associated with guideline adherence will be identified, which may facilitate targeted improvement strategies.
Acknowledgments
We would like to thank Julie Heeren, Suzanne Vonk, Felix van Urk and Rixt Zuidema for their support in the data collection. We would also like to thank the participating hospitals, cardiologists and quality officers for their cooperation.
Conflict of interest
None declared.
Funding
This work is supported by a grant from the Dutch Ministry of Health, Welfare and Sport.
References
- 1.Allen LA, O’Donnell CJ, Camargo CA, et al. Comparison of long-term mortality across the spectrum of acute coronary syndromes. Am Heart J. 2006;151(5):1065–1071. doi: 10.1016/j.ahj.2005.05.019. [DOI] [PubMed] [Google Scholar]
- 2.Liebson PR, Klein LW. The non-Q wave myocardial infarction revisited: 10 years later. Prog Cardiovasc Dis. 1997;39(5):399–444. doi: 10.1016/S0033-0620(97)80038-2. [DOI] [PubMed] [Google Scholar]
- 3.Canto AJ, Kiefe CI, Goldberg RJ, et al. Differences in symptom presentation and hospital mortality according to type of acute myocardial infarction. Am Heart J. 2012;163(4):572–579. doi: 10.1016/j.ahj.2012.01.020. [DOI] [PubMed] [Google Scholar]
- 4.Fox KA, Steg PG, Eagle KA, et al. Decline in rates of death and heart failure in acute coronary syndromes, 1999–2006. JAMA. 2007;297(17):1892–1900. doi: 10.1001/jama.297.17.1892. [DOI] [PubMed] [Google Scholar]
- 5.Jernberg T, Johanson P, Held C, et al. Association between adoption of evidence-based treatment and survival for patients with ST-elevation myocardial infarction. JAMA. 2011;305(16):1677–1684. doi: 10.1001/jama.2011.522. [DOI] [PubMed] [Google Scholar]
- 6.Mandelzweig L, Battler A, Boyko V, et al. The second Euro Heart Survey on acute coronary syndromes: characteristics, treatment, and outcome of patients with ACS in Europe and the Mediterranean Basin in 2004. Eur Heart J. 2006;27(19):2285–2293. doi: 10.1093/eurheartj/ehl196. [DOI] [PubMed] [Google Scholar]
- 7.Cannon CP, Gibson CM, Lambrew CT, et al. Relationship of symptom-onset-to-balloon time and door-to-balloon time with mortality in patients undergoing angioplasty for acute myocardial infarction. JAMA. 2000;283(22):2941–2947. doi: 10.1001/jama.283.22.2941. [DOI] [PubMed] [Google Scholar]
- 8.Boersma E, Pieper KS, Steyerberg EW, et al. Predictors of outcome in patients with acute coronary syndromes without persistent ST-segment elevation: results from an international trial of 9461 patients. Circulation. 2000;101(22):2557–2567. doi: 10.1161/01.CIR.101.22.2557. [DOI] [PubMed] [Google Scholar]
- 9.Braunwald E, Mark DB, Jones RH, et al. Unstable angina: diagnosis and management. Clinical practice guideline number 10, publication 94–0602. Rockville, MD: Agency for Health Care Policy and Research and the National Heart, Lung, and Blood Institute, US Public Health Service, US Department of Health and Human Services; 1994. [Google Scholar]
- 10.Peterson ED, Roe MT, Mulgund J, et al. Association between hospital process performance and outcomes among patients with acute coronary syndromes. JAMA. 2006;295(16):1912–1920. doi: 10.1001/jama.295.16.1912. [DOI] [PubMed] [Google Scholar]
- 11.Lahoud R, Howe M, Krishnan SM, et al. Effect of use of combination evidence-based medical therapy after acute coronary syndromes on long-term outcomes. Am J Cardiol. 2012;109(2):159–164. doi: 10.1016/j.amjcard.2011.08.024. [DOI] [PubMed] [Google Scholar]
- 12.Hamm CW, Bassand JP, Agewall S, et al. ESC Guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation. Eur Heart J. 2011;32(23):2999–3054. doi: 10.1093/eurheartj/ehr236. [DOI] [PubMed] [Google Scholar]
- 13.Steg PG, James SK, Atar D, et al. ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation. Eur Heart J. 2012;33(20):2569–2619. doi: 10.1093/eurheartj/ehs215. [DOI] [PubMed] [Google Scholar]
- 14.Boyer NM, Laskey WK, Cox M, et al. Trends in clinical, demographic, and biochemical characteristics of patients with acute myocardial infarction from 2003 to 2008: a report from the American Heart Association Get With The Guidelines coronary artery disease program. J Am Heart Assoc. 2012;1(4):e001206. doi: 10.1161/JAHA.112.001206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Terkelsen CJ, Sørensen JT, Maeng M, et al. System delay and mortality among patients with STEMI treated with primary percutaneous coronary intervention. JAMA. 2010;304(7):763–771. doi: 10.1001/jama.2010.1139. [DOI] [PubMed] [Google Scholar]
- 16.Yan AT, Yan RT, Tan M, et al. Optimal medical therapy at discharge in patients with acute coronary syndromes: temporal changes, characteristics, and 1-year outcome. Am Heart J. 2007;154(6):1108–1115. doi: 10.1016/j.ahj.2007.07.040. [DOI] [PubMed] [Google Scholar]
- 17.VMS veiligheidsprogramma [VMS safety management program] [Internet] 2013. Available from: www.vmszorg.nl.
- 18.Granger CB, Goldberg RJ, Dabbous O, et al. Predictors of hospital mortality in the global registry of acute coronary events. Arch Intern Med. 2003;163(19):2345–2353. doi: 10.1001/archinte.163.19.2345. [DOI] [PubMed] [Google Scholar]
- 19.Fox KA, Dabbous OH, Goldberg RJ, et al. Prediction of risk of death and myocardial infarction in the six months after presentation with acute coronary syndrome: prospective multinational observational study (GRACE) BMJ. 2006;333(7578):1091. doi: 10.1136/bmj.38985.646481.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Antman EM, Cohen M, Bernink PJLM, et al. The TIMI risk score for unstable angina/non – ST elevation MI: a method for prognostic and therapeutic decision making. JAMA. 2000;284(7):835–842. doi: 10.1001/jama.284.7.835. [DOI] [PubMed] [Google Scholar]
- 21.Lagerqvist B, Diderholm E, Lindahl B, et al. FRISC score for selection of patients for an early invasive treatment strategy in unstable coronary artery disease. Heart. 2005;91(8):1047–1052. doi: 10.1136/hrt.2003.031369. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Six A, Backus B, Kelder J. Chest pain in the emergency room: value of the HEART score. Neth Heart J. 2008;16(6):191–196. doi: 10.1007/BF03086144. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Dutch Health Insurance Counsil. Pharmacotherapeutic Compass. 2012 [updated 2012 Jan 1]. Available from: http://www.fk.cvz.nl/.
- 24.Rubin DB. Inference and missing data. Biometrika. 1976;63(3):581–592. doi: 10.1093/biomet/63.3.581. [DOI] [Google Scholar]
- 25.Van Buuren S, Groothuis-Oudshoorn K. Mice: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011;45(3):1–67. [Google Scholar]
- 26.Galbraith S, Daniel JA, Vissel B. A study of clustered data and approaches to its analysis. J Neurosci. 2010;30(32):10601–10608. doi: 10.1523/JNEUROSCI.0362-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Maas CJM, Hox JJ. Sufficient sample sizes for multilevel modeling. Methodology. 2005;1(3):86–92. [Google Scholar]
- 28.Bradley EH, Herrin J, Wang Y, et al. Strategies for reducing the door-to-balloon time in acute myocardial infarction. N Engl J Med. 2006;355(22):2308–2320. doi: 10.1056/NEJMsa063117. [DOI] [PubMed] [Google Scholar]
- 29.Bradley EH, Nallamothu BK, Herrin J, et al. National efforts to improve door-to-balloon time: results from the Door-to-Balloon Alliance. J Am Coll Cardiol. 2009;54(25):2423–2429. doi: 10.1016/j.jacc.2009.11.003. [DOI] [PubMed] [Google Scholar]
- 30.Cannon CP, Hoekstra JW, Larson DM, et al. A report of quality improvement in the care of patients with acute coronary syndromes. Crit Pathw Cardiol. 2011;10(1):29–34. doi: 10.1097/HPC.0b013e318204eb8b. [DOI] [PubMed] [Google Scholar]
- 31.Peterson GM, Thompson A, Pulver LK, et al. Management of acute coronary syndromes at hospital discharge: do targeted educational interventions improve practice quality? J Healthc Qual. 2012;34(1):26–34. doi: 10.1111/j.1945-1474.2011.00137.x. [DOI] [PubMed] [Google Scholar]
- 32.O’Gara PT, Kushner FG, Ascheim DD, et al. 2013 ACCF/AHA guideline for the management of ST-elevation myocardial infarction. Circulation. 2013;127(4):529–555. doi: 10.1161/CIR.0b013e3182742c84. [DOI] [PubMed] [Google Scholar]
- 33.Jneid H, Anderson JL, Wright RS, et al. 2012 ACCF/AHA focused update of the guideline for the management of patients with unstable angina/non–ST-elevation myocardial infarction (updating the 2007 guideline and replacing the 2011 focused update) Circulation. 2012;126(7):875–910. doi: 10.1161/CIR.0b013e318256f1e0. [DOI] [PubMed] [Google Scholar]
- 34.Chew DP, Aroney CN, Aylward PE, et al. 2011 addendum to the National Heart Foundation of Australia/Cardiac Society of Australia and New Zealand guidelines for the management of acute coronary syndromes (ACS) 2006. Heart Lung Circ. 2011;20(8):487–502. doi: 10.1016/j.hlc.2011.03.008. [DOI] [PubMed] [Google Scholar]
- 35.De Blok C, Koster E, Schilp J, et al. Implementatie VMS veiligheidsprogramma [Implementation of the Dutch national patient safety program] Utrecht: NIVEL and EMGO+Institute; 2013. [Google Scholar]