Abstract
Background
Long hours are associated with increased risk of coronary heart disease. Adding information on long hours to traditional risk factors could potentially help improve risk prediction.
Objective
To examine whether information on long working hours improves the ability of the Framingham risk model to predict coronary heart disease in a low-risk employed population.
Design
Prospective cohort study; baseline medical examination (1991-1993) and coronary heart disease follow-up to 2004.
Settings
Civil service departments in London (the Whitehall II study).
Participants
7095 adults (2109 women) aged 39 to 62, working full time, and free of coronary heart disease at baseline.
Measurements
Working hours and the Framingham risk score were measured at baseline. Coronary death and non-fatal myocardial infarction were ascertained from three sources: medical screenings every 5 years, hospital data and register linkage.
Results
192 persons had incident coronary heart disease during a median 12.3 year follow-up. After adjustment for the Framingham score, participants working ≥11 hours per day had a 1.67-fold (95% CI: 1.10-2.55) increased risk of coronary heart disease relative to those working 7-8 hours. The addition of working hours to the Framingham score led to a net reclassification improvement of 4.7% (p=0.034), resulting from a better identification of individuals who later developed coronary heart disease (sensitivity gain).
Limitations
The findings may not be generalizable to populations with a larger proportion of high-risk individuals. Furthermore, the predictive utility of working hours was not validated in an independent cohort.
Conclusion
Information on working hours may improve prediction of coronary heart disease risk based on the Framingham risk score in low-risk working populations.
Primary Funding Source
Medical Research Council, British Heart Foundation, BUPA Foundation, UK; National Heart, Lung and Blood Institute and National Institute on Aging, NIH, US.
Keywords: Coronary heart disease, prevention, primary prevention, public health, risk assessment, risk factors
Introduction
In clinical practice, stratifying people in terms of their 10-year risk for coronary heart disease facilitates decisions regarding risk management and treatment (1, 2). Guidelines recommend using formal risk prediction algorithms, most commonly the Framingham risk score, which incorporates data on routinely measured conventional risk factors, such as lipid levels, blood pressure, and smoking (3, 4). Recently, management of emerging psychosocial risk factors, such as stress at work, has also been recommended (5). One such stressor, long working hours, has been shown to be associated with increased risk of coronary heart disease (6-13). In this report from the British Whitehall II study, we examine whether incorporating information on working hours in the Framingham risk score improves prediction of 10-year risk of coronary heart disease in this low risk working population.
Methods
Population and study design
The Whitehall II study is a prospective cohort study of British civil servants established in 1985 to identify characteristics of the work environment and health-related behaviours that link socioeconomic position to pathophysiological changes and clinical disease (14). As a characteristic of the work environment, the potential of long working hours to improve the prediction of coronary heart disease risk is an extension to this original study question.
Working hours were measured by questionnaire during the Phase 3 screening (August 1991 - May 1993). Being the first time working hours were measured, Phase 3 forms the baseline for the analyses reported here. We excluded participants with prevalent coronary heart disease, part-time employees and those with missing data on working hours at baseline (a flow chart of sample selection is in the Appendix, available at www.annals.org). The final sample comprised 7095 participants (4986 men, 2109 women) aged 39 to 62 years, free of prevalent coronary heart disease. We followed these study members for incident coronary heart disease or death until Phase 7 (October 2002 - September 2004). The University College London ethics committee reviewed and approved the study, and written informed consent was obtained from each participant.
Assessment of Framingham risk factors
We used standard operating protocols to measure the Framingham risk factors at the Phase 3 sreening (August 1991 - May 1993): age, gender, total cholesterol, high-density lipoprotein (HDL) cholesterol, systolic blood pressure, and smoking habit (14). Venous blood was taken in the fasting state or at least 5 hours after a light, fat-free breakfast. Serum for lipid analyses was refrigerated at −4°C and assayed within 72 hours. Cholesterol was measured with the use of a Cobas Fara centrifugal analyzer (Roche Diagnostics System, Nutley, NJ). HDL-cholesterol was measured by precipitating non-HDL cholesterol with dextran sulfate-magnesium chloride using a centrifuge and measuring cholesterol in the supernatant. We measured systolic blood pressure twice in the sitting position after 5 minutes rest with a Hawksley random-zero sphygmomanometer (Lynjay Services Ltd., Worthing, UK). The average of the two readings was taken to be the measured systolic blood pressure. Information on antihypertensive medication, lipid-lowering drugs, anti-platelet agents and current smoking was requested at the Phase 3 screening.
Measurement of working hours
We determined working hours at Phase 3 with the following question: “On an average weekday, approximately how many hours do you spend on the following activities (if applicable): Work (daytime and work brought home)?” Response options ranged from 1 to 12 hours. Based on a pre-specified classification (12), we recoded responses for those working full-time using the following categories of daily working hours: 7-8 (“normal working hours”), 9 (“1 hour of overtime work a day”), 10 (“2 hours of overtime work”) or ≥11 (“3+ hours of overtime work”).
Ascertainment of incident coronary heart disease
The outcome used in this study was incident hard endpoint coronary heart disease; first non-fatal myocardial infarction or coronary heart disease death, by Phase 7 (October 2002 - September 2004). Non-fatal myocardial infarction identified at baseline (Phase 3) to exclude prevalent disease and at Phases 5 (April 1997 - January 1999) and 7 to identify incident disease was defined following MONICA criteria (16) and ascertained using data from 5-yearly Whitehall II medical examinations, and hospital records of acute electrocardiograms (ECGs) and cardiac enzymes. To ascertain coronary heart disease death, participants were flagged by the British National Health Service (NHS) Central Registry, who notified us of the date and cause of deaths. These were classified as coronary if either codes 410–414 (ICD-9 (International Classification of Diseases, 9th edition)) or codes I20–I25 (ICD-10) were present on the death certificate. Besides those with a history of myocardial infarction at Phase 3, we excluded participants with a history of angina, identified via questionnaire (17) and corroborated against medical records, by abnormalities in a resting electrocardiogram (ECG), an exercise ECG, or a coronary angiogram. Median incident coronary heart disease follow-up was 12.2 years, close to 10-years recommended in the most recent review of work stress and cardiovascular disease (15). While the number of events this afforded was not large, 192 cases, longer follow-up periods tend to increase within-subject variation in work-related exposures (such as working hours) potentially reducing the precision of the prediction (15).
Statistical analysis
Participants were followed until incident hard endpoint coronary heart disease, last study phase, or death, whichever came first. We used multivariate imputation (18) to impute values for 396 individuals who had missing data on one or more of the risk factors in the Framingham risk score. We used Weibull regression analysis to examine the association between working hours and incident coronary heart disease. This is a parametric form of the proportional hazards model and takes into account the differing length of follow-up of the study participants. In addition, the model allows the risk of coronary heart disease over a fixed period of time (t) to be calculated as: r(t) = 1 – exp(-exp((log(t) - Xβ) / σ) where X is the vector of risk factors, β is the vector of coefficients, and σ the estimated scale parameter. This model has previously been used in the Framingham study to describe risk profiles and the effects of risk factors on coronary outcomes using the Framingham risk score (19).
Based on current recommendations (20-23), we classified participants into three risk categories: 0-<5.0%(low risk), 5.0 to <10% (low-intermediate risk) and ≥10% (intermediate to high risk). Due to small numbers, we were unable to distinguish a high risk category (≥20% risk). We calculated the predicted 10-year risk of coronary heart disease from a Weibull model that included working hours and the Framingham risk score and compared it to the predicted risk from a model which included only the Framingham score.
We tabulated incident coronary heart disease events and person years by risk category for the two models (Framingham risk alone and Framingham risk along with information on working hours) and calculated the incidence rate and the rate ratios. Approximate 95% confidence intervals were calculated by multiplying and dividing the rate ratios by an error factor calculated as 1.96*exp(sqrt(1/d0 + 1/ d1)) where d0 and d1 are the number of coronary heart disease events in the two groups being compared (24). We examined the discrimination of the two models using C-statistics (25) and Harrell's C-index (26-28), although these indices are not seen to be sensitive for detecting differences between models (29, 30). We used the net reclassification improvement (NRI) measure (31, 32) to assess the extent to which adding information on long working hours reassigned individuals to risk categories that better reflected their disease outcome. Approximate 95% confidence intervals for the NRI were computed using the same variance terms as used in the test of significance (33). In sensitivity analyses, we examined the NRI separately after excluding non-white participants, diabetic participants and those on antihypertensive, lipid lowering medication or anti-platelet agents.
Goodness of fit and calibration of the two models was assessed by comparing the observed and expected number of coronary events by deciles of predicted risk in a manner similar to the modified Hosmer-Lemeshow chi-square statistic where a value under 20 indicates acceptable calibration (34). We also assessed the risk reclassification calibration (21) by comparing the observed and predicted number of events and their risks in the cross-classification table of predicted risks from the two models, without and with the working hours' variables. The goodness of fit of each model in this cross-classification was assessed using the Hosmer-Lemeshow statistic on cells containing at least twenty individuals (21). The small number of events did not allow us to separate the derivation and the validation cohort. In order to assess the possible bias introduced by this limitation, we also compared results with estimates drawn from 2000 bootstrap simulations (35) as previously described by Cook and Ridker (21) with 95% confidence intervals estimated using the percentile method. All analyses were performed with SAS, version 9.1 for Windows (SAS Institute Inc, Cary, NC, USA)
Role of the Funding Source
The Whitehall II study has been funded by Medical Research Council; British Heart Foundation; Wellcome Trust; Health and Safety Executive; Department of Health; Agency for Health Care Policy Research, UK; John D and Catherine T MacArthur Foundation Research Networks on Successful Midlife Development and Socio-economic Status and Health; National Heart, Lung and Blood Institute and National Institute on Aging, NIH, US; Academy of Finland, Finland; EU New OSH ERA Research Programme and European Science Foundation. The funding sources had no role in study's design, data collection, analysis, interpretation, or the decision to submit the paper for publication. The first and last authors had full access to all the data in the study and had final responsibility for the decision to submit for publication.
Results
In terms of coronary heart disease incidence, the characteristics of the 7095 participants included in the analysis did not differ from the 1437 participants excluded. However, those included in the analysis were somewhat younger (49.0 vs. 53.6 years), more likely to be men (70.3% vs. 60.1%) and of white ethnicity (91.1% vs. 87.2%). That these differences were statistically significant (all p<0.001) is largely due to the high study numbers; absolute differences in characteristics were generally small. (Appendix eTable1, available at www.annals.org).
In Table 1 we present the characteristics of the 7095 participants. Mean risk factor levels ranged from low (e.g., systolic blood pressure 120.2 mm Hg, smoking prevalence 13.9%) to moderately elevated (e.g., total cholesterol 6.45 mmol/L). A total of 192 incident hard coronary heart disease events occurred during the median follow-up period of 12.3 (IQR 11.5-12.7) years. 171 participants were censored before the end of follow-up because of death from causes other than coronary heart disease (10 strokes, 17 other cardiovascular deaths, 97 cancers, 7 respiratory diseases, 36 other causes of deaths, 4 unknown causes). The total follow-up was 80,411 person-years and the crude event rate for coronary heart disease was 23.9 per 10,000 person-years.
Table 1. Characteristics of study participants, Whitehall II, UK, 1991-2004.
Characteristic* | N | |
---|---|---|
Age, y | 7095 | 48.8±5.7 |
Sex, % | ||
Male | 4986 | 70.3 |
Female | 2109 | 29.7 |
Ethnic group, % | ||
White | 6465 | 91.1 |
Non-white | 630 | 8.9 |
Total cholesterol, mmol/L (mg/dL) | 6802 | 6.45 (249.7)±1.15 (44.5) |
High-density lipoprotein cholesterol, mmol/L (mg/dL) | 6779 | 1.43 (55.3)±0.41 (15.8) |
Systolic blood pressure, mm Hg | 6830 | 120.2±13.4 |
Antihypertensive treatment, % | ||
No | 6670 | 94.4 |
Yes | 394 | 5.6 |
Diabetes, % | ||
No | 6896 | 97.2 |
Yes | 199 | 2.8 |
Smoking, % | ||
No | 6108 | 86.1 |
Yes | 985 | 13.9 |
Working hours per day, % | ||
7-8 | 3832 | 54.0 |
9 | 1469 | 20.7 |
10 | 1058 | 14.9 |
≥11 | 736 | 10.4 |
Mean follow-up, y | 7095 | 11.1±2.7 |
Incident coronary heart disease at follow-up | ||
None | 6903 | 97.3 |
Non-fatal myocardial infarction | 163 | 2.3 |
Coronary death | 29 | 0.4 |
Statistics are mean±SD for continuous variables or percent for categorical variables unless otherwise stated.
54.0% of the participants worked 7-8 hours per day and 10.4% worked 11 hours or more (table 1). After adjustment for the Framingham risk score, the hazard ratios (95% CIs) for a coronary event among those working 9, 10 and ≥11 hours were 0.90 (0.60 to 1.35), 1.45 (0.99 to 2.12) and 1.67 (1.10 to 2.55) compared to men and women working 7-8 hours.
Crude event rate ratios using the Framingham score alone and by incorporating long working hours suggested a strong graded association between these two risk prediction tools and incident hard endpoint coronary heart disease, the hazard ratios for an incident coronary event in the high (≥10%) versus low (<5%) risk groups being 3.91 (1.92 to 7.96) and 5.39 (2.92 to 9.96), respectively (Appendix eTable2, available at www.annals.org). Adjustment for long working hours increased the magnitude of the association of the Framingham risk score with incident coronary heart disease, but only by 2.6%.
The C-statistics for the two risk models (the Framingham score alone and one incorporating working hours) did not change 0.714 (95% CI: 0.650 to 0.777) for both models. The Harrell's C-indices were 0.635 (95% CI: 0.494 to 0.767) and 0.619 (95% CI: 0.477 to 0.752). Adding long working hours to the risk algorithm improved calibration as indicated by Hosmer-Lemeshow chi-square statistics [17.33 (df=8, p=0.027) vs 12.91 (df=8, p=0.119)]. This was also the case when estimates were compared to the median estimate of 2000 bootstrapping simulations [24.71 (df=8, p=0.002) vs 20.99 (df=8, p=0.007)].
Table 2 shows the reclassification of individuals between predicted risk categories after complementing the Framingham risk score with information on long working hours. In 4 cells of the cross-classification the predicted risk was closer to the observed risk using the model including working hours (see “Predicted risk†” in table 2). In 1 cell the two models provide equally accurate prediction and in 2 cells the predicted risk was more accurate for the Framingham score alone. The reclassification calibration statistic indicated a better fit for the model including working hours, χ2=6.45 (p=0.092), compared to χ2=10.72 (p=0.013) using the Framingham score alone.
Table 2. Comparison of observed coronary heart disease risk with predicted risk calculated using Framingham risk score alone and in combination with working hours according to strata of predicted risk from the two models.
CHD risk by Framingham alone | CHD risk by Framingham and working hours | Total | |||
---|---|---|---|---|---|
<5.0% | 5.0% - 9.9% | ≥10.0% | |||
<5.0% | N | 6412 | 142 | 0 | 6554 |
% reclassified | - | 2.2 | - | 2.2% | |
N of cases | 139 | 11 | 0 | ||
Person years at risk | 73,164.7 | 1,531.1 | 0 | ||
Observed risk | 1.9% | 6.9% | - | ||
Predicted risk (Framingham alone vs. Framingham + work hours) | 1.8% vs 1.8% | 4.3% vs 6.1% | - | ||
5.0-9.9% | N | 86 | 330 | 20 | 436 |
% reclassified | 19.7 | - | 4.6 | 24.3% | |
N of cases | 4 | 27 | 3 | ||
Person years at risk | 961.0 | 3,515.1 | 220.4 | ||
Observed risk | 4.1% | 7.4% | 12.7% | ||
Predicted risk (Framingham alone vs. Framingham + work hours) | 5.2% vs 4.7% | 7.1% vs 6.9% | 8.3% vs 11.7% | ||
≥10% | N | 0 | 17 | 88 | 105 |
% reclassified | - | 16.2 | - | 16.2% | |
N of cases | 0 | 0 | 8 | ||
Person years at risk | - | 181.8 | 836.7 | ||
Observed risk | - | 0.0% | 9.1% | ||
Predicted risk (Framingham alone vs Framingham + work hours) | - | 10.6% vs 9.7% | 16.8% vs 16.9% | ||
Total | N | 6498 | 489 | 108 | 7095 |
Table 3 shows the reclassification stratified by incident coronary heart disease status at follow-up. The net reclassification improvement (NRI) after adding working hours to the Framingham score was 5.2% among the 192 incident cases and -0.5% in non-cases. Thus, the reclassification improvement was 4.7% (95% CI: 0.3 to 9.1), p=0.034. The mean reclassification improvement did not change when the mean of 2000 bootstrapped values was calculated. We repeated this analysis after exclusion of non-white and diabetic participants and those treated with antihypertensive therapy, lipid-lowering drugs or anti-platelet agents (Appendix eTable3, available at www.annals.org). These analyses did not materially change the result.
Table 3. Reclassification of the predicted 10-year risk of incident coronary heart disease for a risk score based on both the Framingham risk score and long working hours compared to the Framingham risk score alone.
Status at follow-up examination | CHD risk by Framingham alone | CHD risk by Framingham and working hours | Reclassified | Net correctly reclassified (%) | |||
---|---|---|---|---|---|---|---|
<5.0% | 5.0 - 9.9% | ≥10.0% | Increased risk | Decreased risk | |||
Incident case (N=192) | |||||||
<5.0% | 139 | 11 | 0 | 14 | 4 | 5.2% | |
5.0-9.9% | 4 | 27 | 3 | ||||
≥10.0% | 0 | 0 | 8 | ||||
Non-case (N=6903) | |||||||
<5.0% | 6280 | 124 | 0 | 137 | 102 | -0.5% | |
5.0-9.9% | 85 | 304 | 13 | ||||
≥10.0% | 0 | 17 | 80 | ||||
| |||||||
Net Reclassification Improvement (95% CI) | Observed | 4.7% (0.3, 9.1) p=0.034 | |||||
Bootstrap | 4.7% (0.8, 8.8) |
Discussion
In a cohort of nearly 7100 men and women apparently free of coronary heart disease, we show long working hours to predict incident hard endpoint coronary heart disease and contribute to coronary heart disease risk prediction, over and above the Framingham score. The net reclassification improvement was 4.7%. This was achieved by the more accurate classification of individuals who experienced coronary heart disease to a higher risk group (sensitivity gain) rather than by improving detection of those unlikely to develop the disease. Our findings show the potential predictive utility of long working hours in identifying individuals at increased 10-year risk of coronary heart disease in a low-risk employed population.
We searched the MEDLINE database (accessed November 2010) and identified 5 case-control studies (7-11) and 4 cohort studies (12, 13, 36, 37) that have previously examined the association between long working hours and cardiovascular endpoints. Six studies reported a statistically significant positive association in that a higher risk of acute myocardial infarctions or coronary deaths was observed among those doing overtime in diverse working populations in Sweden, the Netherlands, the United Kingdom and Japan (7-12). Conversely, two Japanese studies provided no firm evidence of an association (36, 37), and a 30-year follow-up of Danish men found employees working long hours to be at increased risk of death from ischemic heart disease, but only if they additionally had poor physical fitness (13). Our study from a British cohort adds to the existing evidence by showing that information on long working hours may have the potential to help clinicians more accurately to determine CHD risk for patients.
In this low-risk working population, a C-statistic of 0.71 for risk prediction based on the Framingham score plus working hours is comparable to those found in other studies attempting to improve risk prediction. Examples are the Women's Health Initiative that added 18 biomarkers to the Framingham score (C=0.73)(38), the Atherosclerosis Risk in Communities (ARIC) study that added ultrasound scans of carotid intima-media thickness and plaques (C=0.76)(22) and the Multi-Ethnic Study of Atherosclerosis that added coronary artery calcium scores (C=0.81)(39) to the Framingham risk score. Overall these statistics indicate moderate discrimination; thus a clinician estimating the 10-year coronary heart disease risk of a given patient may prefer to take into account further information not included in these scores (40, 41).
Cost-effectiveness is an additional aspect of the evaluation of potential new risk markers (20). A potential advantage of working hours as a risk marker is that its ascertainment in a clinical interview is simple, quick and virtually cost-free (20). Furthermore, no safety or acceptability issues are attached to the assessment of working hours.
There are a few caveats to the results reported here. First, our study was not sufficiently powered to allow the partition of data into estimation and validation datasets. Thus, the predictive utility of working hours could not be validated in a dataset independent of the derivation dataset. However, the bootstrapped estimate of the net reclassification index suggests that our estimate is not overoptimistic. Second, we did not account for changes in the risk factors or medications during the follow-up – an approach that is standard in attempts to create or improve risk prediction algorithms. Third, our cohort was comprised primarily of low risk individuals and did not include blue-collar workers. Thus, the findings may not be generalizable to higher-risk groups in the general population.
Given that working long hours are common and have increased in many developed countries in recent years (42, 43), our study potentially has important implications. However, further testing is needed to confirm the added value of information on long working hours for clinical decision making. First, additional studies need to examine whether the improvement in coronary heart disease prediction is limited to specific populations or is observable across different cohorts, particularly in groups with a risk ≥20% risk. Second, future studies should assess whether incorporating information on working hours in the risk prediction algorithm improves the management of patients compared with current standard care. Ideally, this would be undertaken by a clinical trial comparing the two models. Third, it is important to clarify whether long working hours are a marker of coronary heart disease risk or are also a causal risk factor. In the first case, information on working hours could contribute to risk prediction but not preventive treatment. In the second case, clinical benefits avoiding long working hours would need to be shown.
Supplementary Material
Acknowledgments
Mika Kivimaki, G. David Batty, Mark Hamer, Michael G. Marmot, Jane E. Ferrie and Martin J. Shipley, the Department of Epidemiology and Public Health, UCL, 1-19 Torrington Place, WC1E London, the United Kingdom; Jussi Vahtera University of Turku and Turku University Hospital, Lemminkäisenkatu 14-18 B, FI-20520 Turku, Finland; Marianna Virtanen Finnish Institute of Occupational Health and University of Helsinki, Topeliuksenkatu 41 aA, FI-00250 Helsinki, Finland; and Archana Singh-Manoux, INSERM, Paris, France.
Sources of Funding: Medical Research Council; British Heart Foundation; Wellcome Trust; Health and Safety Executive; Department of Health; Agency for Health Care Policy Research, UK; John D and Catherine T MacArthur Foundation Research Networks on Successful Midlife Development and Socio-economic Status and Health; National Heart, Lung and Blood Institute and National Institute on Aging, NIH, US; Academy of Finland, Finland; EU New OSH ERA Research Programme and European Science Foundation. MK and JV are supported by the Academy of Finland. GDB is a Wellcome Trust Fellow. GDB is a Wellcome Trust Fellow. MM is a MRC professor. MJS is supported by the British Heart Foundation, AS-M is supported by a “European Young Investigator Award” from the European Science Foundation, and JEF is supported by the Medical Research Council, UK.
Footnotes
Conflict(s) of Interest/Disclosure(s) Statement: The authors have no conflicts of interest to declare.
Sample Reproducible Research Statements: Protocol: Not available (design of the Whitehall II study at www.ucl.ac.uk/whitehallLL/study-phases).
Statistical code: Not available.
Data: Available on application (the Whitehall II data sharing policy at www.ucl.ac.uk/whitehallLL/data-sharing).
References
- 1.Wilson PW, D'Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circ. 1998;97(18):1837–47. doi: 10.1161/01.cir.97.18.1837. [DOI] [PubMed] [Google Scholar]
- 2.D'Agostino RB, Sr, Grundy S, Sullivan LM, Wilson P. Validation of the Framingham coronary heart disease prediction scores: results of a multiple ethnic groups investigation. JAMA. 2001;286(2):180–7. doi: 10.1001/jama.286.2.180. [DOI] [PubMed] [Google Scholar]
- 3.Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) final report. Circ. 2002;106(25):3143–421. [PubMed] [Google Scholar]
- 4.Grundy SM, Cleeman JI, Merz CN, et al. Implications of recent clinical trials for the National Cholesterol Education Program Adult Treatment Panel III guidelines. Circ. 2004;110(2):227–39. doi: 10.1161/01.CIR.0000133317.49796.0E. [DOI] [PubMed] [Google Scholar]
- 5.Graham I, Atar D, Borch-Johnsen K, et al. European guidelines on cardiovascular disease prevention in clinical practice: full text. Fourth Joint Task Force of the European Society of Cardiology and other societies on cardiovascular disease prevention in clinical practice (constituted by representatives of nine societies and by invited experts) Eur J Cardiovasc Prev Rehabil. 2007;14 2:S1–113. doi: 10.1097/01.hjr.0000277983.23934.c9. [DOI] [PubMed] [Google Scholar]
- 6.Buell P, Breslow L. Mortality from coronary heart disease in California men who work long hours. J Chron Dis. 1960;11:615–626. doi: 10.1016/0021-9681(60)90060-6. [DOI] [PubMed] [Google Scholar]
- 7.Theorell T, Rahe RH. Behavior and life satisfaction characteristics of Swedish subjects with myocardial infarction. J Chron Dis. 1972;25:139–147. doi: 10.1016/0021-9681(72)90170-1. [DOI] [PubMed] [Google Scholar]
- 8.Falger PR, Schouten EG. Exhaustion, psychological stressors in the work environment, and acute myocardial infarction in adult men. J Psychosom Res. 1992;36:777–86. doi: 10.1016/0022-3999(92)90136-p. [DOI] [PubMed] [Google Scholar]
- 9.Sokejima S, Kagamimori S. Working hours as a risk factor for acute myocardial infarction in Japan: case-control study. BMJ. 1998;317:775–80. doi: 10.1136/bmj.317.7161.775. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Liu Y, Tanaka H. Overtime work, insufficient sleep, and risk of non-fatal acute myocardial infarction in Japanese men. Occup Environ Med. 2002;59:447–51. doi: 10.1136/oem.59.7.447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Fukuoka Y, Dracup K, Sivarajan Froelicher E, Ohno M, Hirayama H, Shiina H, et al. Do Japanese workers who experience acute myocardial infarction believe their prolonged working hours are a cause? Int J Cardiol. 2005;100:29–35. doi: 10.1016/j.ijcard.2004.04.003. [DOI] [PubMed] [Google Scholar]
- 12.Virtanen M, Ferrie JE, Singh-Manoux A, et al. Overtime work and incident coronary heart disease: the Whitehall II prospective cohort study. Eur Heart J. 2010;31:1737–44. doi: 10.1093/eurheartj/ehq124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Holtermann A, Mortensen OS, Burr H, Søgaard K, Gyntelberg F, Suadicani P. Long work hours and physical fitness: 30-year risk of ischaemic heart disease and all-cause mortality among middle-aged Caucasian men. Heart. 2010;96:1638–44. doi: 10.1136/hrt.2010.197145. [DOI] [PubMed] [Google Scholar]
- 14.Marmot MG, Davey Smith G, Stansfeld S, et al. Health inequalities among British civil servants: the Whitehall II study. Lancet. 1991;337:1387–93. doi: 10.1016/0140-6736(91)93068-k. [DOI] [PubMed] [Google Scholar]
- 15.Eller NH, Netterstrom B, Gyntelberg F, Kristensen TS, Nielsen F, Steptoe A, Theorell T. Work-related psychosocial factors and the development of ischemic heart disease: a systematic review. Cardio Rev. 2009;17:83–97. doi: 10.1097/CRD.0b013e318198c8e9. [DOI] [PubMed] [Google Scholar]
- 16.Tunstall-Pedoe H, Kuulasmaa K, Amouyel P, Arveiler D, Rajakangas AM, Pajak A. Myocardial infarction and coronary deaths in the World Health Organization MONICA Project. Registration procedures, event rates, and case-fatality rates in 38 populations from 21 countries in four continents. Circ. 1994;90:583–612. doi: 10.1161/01.cir.90.1.583. [DOI] [PubMed] [Google Scholar]
- 17.Rose GA, Blackburn H, Gillum RF, Prineas RJ. Cardiovascular Survey Methods. Geneva: WHO; 1982. [Google Scholar]
- 18.Shafer JL. Analysis of Incomplete Multivariate Data. New York: Chapman and Hall; 1997. [Google Scholar]
- 19.Anderson KM, Wilson PW, Odell PM, Kannel WB. An updated coronary risk profile. A statement for health professionals. Circ. 1991;83:356–62. doi: 10.1161/01.cir.83.1.356. [DOI] [PubMed] [Google Scholar]
- 20.Hlatky MA, Greenland P, Arnett DK, Ballantyne CM, Criqui MH, Elkind MS, Go AS, Harrell FE, Jr, Hong Y, Howard BV, Howard VJ, Hsue PY, Kramer CM, McConnell JP, Normand SL, O'Donnell CJ, Smith SC, Jr, Wilson PW American Heart Association Expert Panel on Subclinical Atherosclerotic Diseases and Emerging Risk Factors and the Stroke Council. Criteria for evaluation of novel markers of cardiovascular risk: a scientific statement from the American Heart Association. Circ. 2009;119:2408–16. doi: 10.1161/CIRCULATIONAHA.109.192278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Cook NR, Ridker PM. Advances in measuring the effect of individual predictors of cardiovascular risk: the role of reclassification measures. Ann Intern Med. 2009;150:795–802. doi: 10.7326/0003-4819-150-11-200906020-00007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Nambi V, Chambless L, Folsom AR, He M, Hu Y, Mosley T, Volcik K, Boerwinkle E, Ballantyne CM. Carotid intima-media thickness and presence or absence of plaque improves prediction of coronary heart disease risk: the ARIC (Atherosclerosis Risk in Communities) study. J Am Coll Cardiol. 2010;55:1600–7. doi: 10.1016/j.jacc.2009.11.075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Pignone M, Alberts MJ, Colwell JA, Cushman M, Inzucchi SE, Mukherjee D, Rosenson RS, Williams CD, Wilson PW, Kirkman MS. Aspirin for Primary Prevention of Cardiovascular Events in People with Diabetes: A position statement of the American Diabetes Association, a scientific statement of the American Heart Association, and an expert consensus document of the American College of Cardiology Foundation. Diabetes Care. 2010;33:1395–1402. doi: 10.2337/dc10-0555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Breslow NE, Day NE. Statistical methods in cancer research: Volume 1 - The Analysis of Case-Control Studies. Lyon: International Agency for Research on Cancer; 1980. [PubMed] [Google Scholar]
- 25.Mannan H, Stevenson C. SAS macros for point and interval estimation of area under the receiver operating characteristic curve for non-proportional and proportional hazards Weibull models. J Evaluation Clin Pract. 2010;16:756–770. doi: 10.1111/j.1365-2753.2009.01190.x. [DOI] [PubMed] [Google Scholar]
- 26.Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating the field of medical tests. JAMA. 1982;247:2543–46. [PubMed] [Google Scholar]
- 27.Pencina MJ, D'Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med. 2004;23:2109–23. doi: 10.1002/sim.1802. [DOI] [PubMed] [Google Scholar]
- 28.Liu L, Forman S, Barton B. Fitting Cox model using PROC PHREG and beyond in SAS; Paper 236-2009. SAS Global Forum. 2009:1–10. [Google Scholar]
- 29.Harrell FE, Lee KL, Mark DB. Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15:361–387. doi: 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4. [DOI] [PubMed] [Google Scholar]
- 30.Cook NR. Assessing the incremental role of novel and emerging risk factors. Curr Cardio Risk Rep. 2010;4:112–9. doi: 10.1007/s12170-010-0084-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Pencina MJ, D'Agostino RB, Sr, D'Agostino RB, Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–172. doi: 10.1002/sim.2929. [DOI] [PubMed] [Google Scholar]
- 32.Steyerberg EW, Pencina MJ. Reclassification calculations for persons with incomplete follow-up. Ann Intern Med. 2010;152:195. doi: 10.7326/0003-4819-152-3-201002020-00019. [DOI] [PubMed] [Google Scholar]
- 33.Armitage P. Statistical methods in medical research. Blackwell Scientific Publications; Oxford: 1977. [Google Scholar]
- 34.Hosmer DWJ, Lemeshow S. Applied Logistic Regression. New York: J Wiley; 1989. [Google Scholar]
- 35.SAS institute Inc. SAS OnlineDoc: jackknife and bootstrap analyses. [accessed December 8, 2010]; http://support.sas.com/kb/24/982.html.
- 36.Tarumi K, Hagihara A, Morimoto K. A prospective observation of onsets of health defects associated with working hours. Ind Health. 2003;41(2):101–8. doi: 10.2486/indhealth.41.101. [DOI] [PubMed] [Google Scholar]
- 37.Uchiyama S, Kurasawa T, Sekizawa T, Nakatsuka H. Job strain and risk of cardiovascular events in treated hypertensive Japanese workers: hypertension follow-up group study. J Occup Health. 2005;47:102–11. doi: 10.1539/joh.47.102. [DOI] [PubMed] [Google Scholar]
- 38.Kim HC, Greenland P, Rossouw JE, Manson JA, Cochrane BB, Lasser NL, Limacher MC, Lloyd-Jones DM, Margolis KL, Robinson JG. Multimarker prediction of coronary heart disease risk: The Women's Health Initiative. J Am Coll Cardiol. 2010;55:2080–2091. doi: 10.1016/j.jacc.2009.12.047. [DOI] [PubMed] [Google Scholar]
- 39.Polonsky TS, McClelland RL, Jorgensen NW, Bild DE, Burke GL, Guerci AD, Greenland P. Coronary artery calcium score and risk classification for coronary heart disease prediction. JAMA. 2010;303:1610–16. doi: 10.1001/jama.2010.461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Helfand M, Buckley DI, Freeman M, et al. Emerging risk factors for coronary heart disease: a summary of systematic reviews conducted for the U.S. Preventive Services Task Force. Ann Intern Med. 2009;151(7):496–507. doi: 10.7326/0003-4819-151-7-200910060-00010. [DOI] [PubMed] [Google Scholar]
- 41.Woodward M, Brindle P, Tunstall-Pedoe H SIGN-group-on-risk-estimation. Adding social deprivation and family history to cardiovascular risk assessment: the ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC) Heart. 2007;93(2):172–176. doi: 10.1136/hrt.2006.108167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Caruso CC, Hitchcock EM, Dick RB, Russo JM, Schmit JM. Overtime and extended work shifts: Recent findings on illnesses, injuries, and health behaviors. Cincinnati: National Institute for Occupational Safety and Health; 2004. [Google Scholar]
- 43.OECD Employment Outlook. Recent Labour Market Developments and Prospects Special Focus on: Clocking in (and out): Several Facets of Working Time. OECD; 2004. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.