Skip to main content
Journal of the Royal Society of Medicine logoLink to Journal of the Royal Society of Medicine
letter
. 2012 Feb;105(2):53–54. doi: 10.1258/jrsm.2011.110311

Misplaced criticism of breast screening research

Stephen Duffy 1,
PMCID: PMC3284302  PMID: 22357979

Dear Sir,

The paper by Gøtzsche and Jørgensen1 contains a number of inaccuracies and omissions in its criticism of my work and that of my colleagues.2 Firstly, Gøtzsche and Jørgensen take exception to the quoted 50% improvement in breast cancer survival in screen-detected cancers. They omit to mention that the approximate 50% improvement is after correction for lead time and length bias – before correction, the figure was a 70% improvement.3,4

Secondly, they claim that the 28% reduction in breast cancer mortality in England in the screened ages compared to other ages did not occur. They are mistaken. Table 1 shows breast cancer mortality by epoch in ages 50–69 and in all other age groups. While mortality rose by 2% in the latest period compared to the earliest for all other age groups, it fell by 27% in the age group 50–69. The relative risk of breast cancer mortality is therefore:

graphic file with name JRSM-11-0311UM1.jpg

Table 1.

Breast cancer mortality in England by age group and epoch

Age Group (years) Quantity Period
1974–88 1989–94 1995–2004
50–69 Breast cancer deaths 77,805 28,391 38,201
Person-years (thousands) 79,604 30,013 53,430
Mortality/100,000 97.7 94.6 71.5
Change from 1974–88 −3% −27%
All other ages Breast cancer deaths 98,943 47,507 71,159
Person-years (thousands) 281,254 117591 197954
Mortality/100,000 35.2 40.4 35.9
Change from 1974–88 +15% +2%

That, is a 28% reduction compared to other age groups. In the published analysis, the estimate was age-adjusted, but I give the crude analysis here so that readers can see where the estimate comes from.

Gøtzsche and Jørgensen's criticisms are particularly error-prone on the subject of over-diagnosis. It might be illuminating to contrast our approach2 with that of Jørgensen and Gøtzsche.5 Both teams attempted to estimate overdiagnosis by calculation of expected incidence of breast cancer in the screening epoch based on trends observed in the pre-screening epoch. However, the methods differed at each stage, as follows:

  1. Data Sources: Duffy et al. used data on numbers of cases and populations at risk in England from Cancer Registry data.2 Jørgensen and Gøtzsche estimated rates for England and Wales from a published graph.

  2. Changes in Incidence Independent of Screening: Duffy et al. took full account of these changes by correcting for the 7% increase above expected values at ages below the target age group for screening.2 Jørgensen and Gøtzsche failed to do so.5

  3. Method of analysis: Duffy et al. used poisson regression, as is the correct procedure for rate data.2,6 Jørgensen and Gøtzsche used linear regression, which is incorrect.5

  4. Data selection: Duffy et al. used all pre-screening and screening epoch data available.2 Jørgensen and Gøtzsche excluded the three years of highest incidence in the pre-screening period, and only included the year of highest incidence in their screening epoch data, 1999.5 This inflated their estimate of overdiagnosis.

  5. Adjustment for lead time: Duffy et al. subtracted the deficit in incidence above the screening age from the excess observed in screening ages.2 Jørgensen and Gøtzsche failed to do so.5 To be fair, they claimed not to observe a deficit. This is partly because in 1999 too few women above the screening age range had been screened in the past, but also because of their failure to fully adjust for changes in incidence independent of screening, as noted in point 2 above.

  6. Ductal Carcinoma in situ (DCIS): In the absence of data, Duffy et al. restricted estimation to invasive disease, although in the same paper, they estimated overdiagnosis including DCIS in a randomized trial.2 Like Duffy et al, Jørgensen and Gøtzsche had no data on DCIS in the UK, so they assumed a result which was not observed.5

From the above, it can be seen that our modest estimate of overdiagnosis has more reliability than the implausibly high estimate of Jørgensen and Gøtzsche. Gøtzsche and Jørgensen make a number of further errors in defence of their estimate, including: failure to acknowledge that in the 1990's in the age range for screening, a full paper (not an abstract as stated by Gøtzsche and Jørgensen),7 has shown that around 40% of tumours were screen-detected; citation of figures from 2006 to justify their estimate for 1999; and misinterpretation of those figures from 2006, as pointed out previously.8

More importantly, one should not lose sight of the benefit of the NHS Breast Screening Programme and the fact that the only randomized trial with more than 25 years of follow-up, shows that the quoted benefit of one breast cancer death prevented for every 400 women screened is accurate and may even underestimate the benefit.9

References

  • 1.Gotzsche PC, Jorgensen KJ. The breast screening programme and misinforming the public. J R Soc Med 2011;104:361–9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Duffy SW, Tabar L, Olsen AH, Vitak B, Allgood PC, Chen TH, et al. Absolute numbers of lives saved and overdiagnosis in breast cancer screening, from a randomized trial and from the Breast Screening Programme in England. J Med Screen 2010;17:25–30 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Lawrence G, Wallis M, Allgood P, Nagtegaal ID, Warwick J, Cafferty FH, et al. Population estimates of survival in women with screen-detected and symptomatic breast cancer taking account of lead time and length bias. Breast Cancer Res Treat 2009;116:179–85 [DOI] [PubMed] [Google Scholar]
  • 4.Duffy SW, Nagtegaal ID, Wallis M, Cafferty FH, Houssami N, Warwick J, et al. Correcting for lead time and length bias in estimating the effect of screen detection on cancer survival. Am J Epidemiol 2008;168:98–104 [DOI] [PubMed] [Google Scholar]
  • 5.Jorgensen KJ, Gotzsche PC. Overdiagnosis in publicly organised mammography screening programmes: systematic review of incidence trends. BMJ 2009;339:b2587 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Breslow NE, Day NE Statistical methods in cancer research. Volume II–The design and analysis of cohort studies. IARC Sci Publ 1987:1–406 [PubMed] [Google Scholar]
  • 7.Lawrence G, O'Sullivan E, Kearins O, Tappenden N, Martin K, Wallis M. Screening histories of invasive breast cancers diagnosed 1989–2006 in the West Midlands, UK: variation with time and impact on 10-year survival. J Med Screen 2009;16:186–92 [DOI] [PubMed] [Google Scholar]
  • 8.Duffy SW, Tabar L, Olsen AH, Vitak B, Allgood PC, Chen TH, et al. Cancer mortality in the 50–69 year age group before and after screening. Journal of Medical Screening 2010;17:159–60 [Google Scholar]
  • 9.Tabar L, Vitak B, Chen THH, Yen AMF, Cohen A, Tot T, et al. Swedish Two-County Trial: Impact of Mammographic Screening on Breast Cancer Mortality during 3 Decades. Radiology 2011;260:658–63 [DOI] [PubMed] [Google Scholar]

Articles from Journal of the Royal Society of Medicine are provided here courtesy of Royal Society of Medicine Press

RESOURCES