Abstract
Objective
To analyze the diagnostic accuracy and trend in screening mammography in Korea.
Materials and Methods
We retrospectively linked the information from hospitals participating in the Alliance of Breast Cancer Screening in Korea (ABCS-K) and the database of the National Cancer Screening Program. We calculated performance indicators, including the recall rate, cancer detection rate (CDR), positive predictive value (PPV), sensitivity, specificity, false-positive rate (FPR), and interval cancer rate (ICR). Changes in the performance indicators were calculated as the annual percent change with 95% confidence interval (CI).
Results
We enrolled 128756 cases from 10 hospitals from 2005 to 2010. The recall rate was 19.1% with a downward trend over time (-12.1% per year; 95% CI, -15.9 to -8.2). The CDR was 2.69 per 1000 examinations, without a significant trend. The PPV was 1.4% with an upward trend (20.8% per year; 95% CI, 15.2 to 26.7). The sensitivity was 86.5% without a significant trend, whereas the specificity was 81.1% with an upward trend (3.3% per year; 95% CI, 2.1 to 4.5). The FPR was 18.9% with a downward trend (-12.4% per year; 95% CI, -16.2 to -8.4). The ICR was 0.5 per 1000 negative examinations without a significant trend. There were institutional variations in the diagnostic accuracy and trend except for the CDR, sensitivity, and ICR.
Conclusion
The sensitivity and CDR of screening mammography in the ABCS-K from 2005 to 2010 were compatible with those for Western women. The recall rate, PPV and specificity, however, were suboptimal, although they showed significant improvements over this period. A further analysis is required to explain institutional variations.
Keywords: Breast, Breast neoplasms, Mammography, Mass screening
INTRODUCTION
Breast cancer is the second most common malignancy among Korean women next to thyroid cancer, and the age-standardized incidence of breast cancer is 65.7 per 100000 women, accounting for 14.8% of female malignancies in 2012 (1).
Since 1999, the National Cancer Screening Program (NCSP) in Korea has recommended biannual screening mammograms for women aged 40 years and older (2). Since 2005, the target population who received free-of-charge screening service included not only medical aid recipients but also the National Health Insurance (NHI) beneficiaries in the lower half of the income stratum. The other half can also receive screening services with 10% payment of the cost. Therefore, the rates of breast cancer screening in Korea showed a significant increase from 2004 to 2012, with an annual increase of 4.5%, and the current screening rates are approaching 70.0% (3). However, the cost-effectiveness of the NCSP for breast cancer was suboptimal compared with the gross domestic product, although the report was from the early period of the NCSP, namely from 2002 to 2003 (4).
To the best of our knowledge, there have been only two reports concerning the diagnostic accuracy of mammography in the NCSP; one described the results from an early period (2002–2006) of the NCSP, but was not published, while the other described the results from a single institution for a 1-year of period (2006) (5). Although there could be various factors affecting diagnostic accuracy, including readers, equipment, examinees, and heath care systems, we must first know where we are, that is, what is the overall performance of mammography in the NCSP. Thus, we analyzed and reported the diagnostic accuracy and trend in screening mammography in Korea for the first time. The analysis of various factors affecting diagnostic accuracy in mammography screening will be the subject of separate reports.
MATERIALS AND METHODS
This study was conducted with the approval of the Institutional Review Board (IRB) of all participating hospitals, and informed consent was waived for each examinee.
We organized the Alliance for Breast Cancer Screening in Korea (ABCS-K) with the support of a government research fund. The ABCS-K comprised 11 institutions: 10 university-orgaffiliated hospitals representative of each province of Korea and one institute as a statistical coordinating center (Fig. 1). The major objectives of the ABCS-K were: to enhance understanding of mammography screening practices in Korea using further assessment of the NCSP; to foster collaborative research among alliance participants in order to examine unsolved issues in providing screening services and subsequent diagnostic work-up; and to provide a foundation for conducting prospective research to improve our understanding of breast cancer in Korean women.
Fig. 1. Participating institutions of Alliance for Breast Cancer Screening in Korea.
Alliance comprises 11 institutions: one as statistical coordinating center (A) and 10 participating in NCSP (B-K). NCSP = National Cancer Screening Program
Since 2002, the results of the NCSP for breast cancer have been collected in a database located at the NHI Service (NHIS). Using this database, the NHIS and National Cancer Center have evaluated (but not announced) the performance of the NCSP. The NCSP database includes series of screening facilities that participate in the NCSP, the results of mammography in the NCSP and cancer outcomes. However, there is no information concerning the radiologists involved or types of mammography equipment used (film/screen, computed radiography, and digital) in the NCSP database. With approval from the IRB of each participating institution, we linked the hospital information on mammography screening performed from January 2005 to December 2010 with the NCSP database and constructed a research database. Mammograms with incomplete identification numbers, a previous diagnosis of cancer, and interstitial mammoplasty were excluded in the research database.
The American College of Radiology Breast Imaging-Reporting and Data System (ACR BI-RADS) categories 1 and 2 were considered negative results, whereas categories 0, 4, and 5 were considered positive results (6). If an original report of screening mammography was not consistent with the BI-RADS, a breast radiologist at the same hospital assessed the BI-RADS categories according to the context of the original report. We included cancer diagnoses from the NCSP database until December 2011 to account for the 12-month period after screening. Breast cancers included invasive cancer (International Classification of Disease, 10th revision [ICD-10] code C50) and carcinoma in situ (ICD-10 code D05).
We calculated the performance indicators of mammography screening as a whole and by individual institution according to the year. The performance indicators included the recall rate, cancer detection rate (CDR), positive predictive value (PPV), sensitivity, specificity, false-positive rate (FPR), and interval cancer rate (ICR). The recall rate was calculated as the percentage of women screened who were recalled for further evaluation. The CDR was calculated as the number of breast cancer cases detected per 1000 examinations. The interval cancer was defined as a histology-proven, invasive or in situ cancer within 1 year after the negative screening; additionally, the ICR was calculated as the number of interval cancers per 1000 negative examinations.
Changes in the performance indicators were calculated as an annual percent change (APC), with 95% confidence interval (CI). The APC is used to measure the trend or change in the proportions or rates over time. It was estimated by fitting a least-squares regression line using calendar-years as a regression variable (7). All statistical analyses were conducted using SAS software, version 9.2 (SAS Institute, Cary, NC, USA).
RESULTS
The baseline raw data of the ABCS-K from the 10 participating hospitals from 2005 to 2010 comprised 130537 mammograms. Of these, 1121 mammograms with incomplete identification numbers, 557 mammograms from women with a previous diagnosis of breast cancer, and 104 mammograms showing interstitial mammoplasty were excluded. Therefore, 128756 mammograms were included as the cancer-free cohort in the research database of this study (Table 1, Fig. 2). The age distribution of the enrolled cases was as follows: 40–49 years, n = 45449 (35.3%); 50–59 years, n = 47356 (36.8%); 60–69 years, n = 28331 (22.0%); 70 years and older, n = 7620 (5.9%) (Supplementary Table 1 in the online-only Data Supplement).
Table 1. Numbers of Enrolled Cases by Hospitals and Years in Alliance for Breast Cancer Screening in Korea (ABCS-K).
| No. of Hosp. | Raw Data | Excluded Cases | Enrolled Cases | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Incomplete ID | Prevalent Cancer Cases | IMP | Calendar Year | Total (%) | |||||||
| 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | ||||||
| 1 | 28718 | 99 | 88 | 9 | 3605 | 4039 | 4056 | 5371 | 6331 | 5120 | 28522 (22.2) |
| 2 | 23021 | 407 | 68 | 5 | 2811 | 3254 | 3215 | 4032 | 4805 | 4424 | 22541 (17.5) |
| 3 | 14883 | 138 | 70 | 0 | 718 | 1127 | 1159 | 3181 | 4290 | 4200 | 14675 (11.4) |
| 4 | 5028 | 16 | 48 | 4 | 369 | 660 | 947 | 987 | 1338 | 659 | 4960 (3.9) |
| 5 | 9818 | 41 | 54 | 0 | 1178 | 1400 | 1187 | 1757 | 2171 | 2030 | 9723 (7.6) |
| 6 | 14360 | 151 | 65 | 38 | 1293 | 1945 | 2551 | 2913 | 2891 | 2513 | 14106 (11.0) |
| 7 | 9843 | 27 | 58 | 22 | 394 | 768 | 1333 | 2155 | 2652 | 2434 | 9736 (7.6) |
| 8 | 12149 | 124 | 33 | 4 | 1582 | 1533 | 1881 | 1883 | 2184 | 2925 | 11988 (9.3) |
| 9 | 6772 | 37 | 29 | 13 | 133 | 1209 | 1180 | 1440 | 1292 | 1439 | 6693 (5.2) |
| 10 | 5945 | 81 | 44 | 8 | 794 | 1089 | 947 | 1078 | 1059 | 845 | 5812 (4.5) |
| Total | 130537 | 1121 | 557 | 104 | 2877 | 17024 | 18456 | 24797 | 29013 | 26589 | 128756 (100.0) |
ID = identification number of hospital, IMP = interstitial mammoplasty, No. of Hosp. = serial number of hospitals participating in ABCS-K
Fig. 2. Study population of Alliance for Breast Cancer Screening in Korea.
CAD = computer-aided detection, ID = identification number of hospital, MMG = mammography, NCSP = National Cancer Screening Program
There were 400 breast cancer cases, including 322 invasive and 78 in situ cancers, registered in the database of the NHIS within 1 year after screening (Supplementary Table 2 in the online-only Data Supplement). Among them, 346 were true positive and 54 were false negative.
The diagnostic accuracy and trend of screening mammography by the ABCS-K were as follows (Table 2): the average recall rate of the 10 participating hospitals over 6 years was 19.1% and showed a downward trend over time (-12.1% per year; 95% CI, -15.9 to -8.2); the CDR per 1000 examinations was 2.7 but did not show any statistically significant trend; the PPV was 1.4% and showed an upward trend (20.8% per year; 95% CI, 15.2 to 26.7); the sensitivity was 86.5% and showed no significant trend, whereas the specificity was 81.1%, with an upward trend (3.3% per year; 95% CI, 2.1 to 4.5). The FPR was 18.9% and showed a downward trend (-12.4% per year; 95% CI, -16.2 to -8.4); finally, the ICR was 0.05% per 1000 negative examinations and showed no significant trend.
Table 2. Diagnostic Accuracy and Trend of Screening Mammography in Alliance for Breast Cancer Screening in Korea.
| 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | Total | APC | 95% CI | |
|---|---|---|---|---|---|---|---|---|---|
| Recall rate (%) | 25.8 | 25.7 | 22.1 | 17.9 | 15.2 | 14.9 | 19.1 | -12.1 | -15.9 to -8.2 |
| CDR per 1000 examinations | 2.2 | 2.8 | 2.3 | 2.7 | 2.7 | 3.1 | 2.7 | 5.3 | -0.6 to 11.7 |
| PPV (%) | 0.8 | 1.1 | 1.1 | 1.5 | 1.8 | 2.1 | 1.4 | 20.8 | 15.2 to 26.7 |
| Sensitivity (%) | 77.8 | 90.4 | 93.5 | 86.1 | 91.9 | 80.2 | 86.5 | 0.3 | -5.1 to 6.1 |
| Specificity (%) | 74.4 | 74.5 | 78.1 | 82.4 | 85.0 | 85.4 | 81.1 | 3.3 | 2.1 to 4.5 |
| FPR (%) | 25.6 | 25.5 | 21.9 | 17.6 | 15.0 | 14.6 | 18.9 | -12.4 | -16.2 to -8.4 |
| ICR per 1000 negative women | 0.8 | 0.4 | 0.2 | 0.5 | 0.3 | 0.9 | 0.5 | 1.9 | -33.5 to 56.0 |
APC = annual percent change, CDR = cancer detection rate, CI = confidence interval of the APC, FPR = false-positive rate, ICR = interval cancer rate, PPV = positive predictive value
There were institutional variations in the diagnostic accuracy and trend in the ABCS-K. The average recall rates of hospital numbers 1 and 8 showed a statistically significant downward trend, whereas those of hospital numbers 3, 9, and 10 showed an upward trend, and those of others did not show any significant trend (Table 3). The PPV of hospital number 1 showed an upward trend but that of others did not show any significant trend (Table 4). The specificity of hospital numbers 1 and 8 showed an upward trend, whereas that of hospital numbers 3, 9, and 10 showed a downward trend, and that of others did not show any significant trend (Table 5). The FPR showed a reversed pattern with the specificity; that of hospital numbers 1 and 8 showed a downward trend, whereas that of hospital numbers 3, 9, and 10 showed an upward trend, and that of others showed no significant trend (Table 6). By contrast, the CDR, sensitivity, and ICR showed no significant institutional variation or trend.
Table 3. Recall Rate and Trend of Screening Mammography by Hospitals Participating in Alliance for Breast Cancer Screening in Korea.
| No. of Hospital | Total | 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | APC | 95% CI |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 24.5 | 59.1 | 46.2 | 33.2 | 16.6 | 5.9 | 7.4 | -38.9 | -50.4 to -24.8 |
| 2 | 26.6 | 3.3 | 37.5 | 32.1 | 29.2 | 28.0 | 25.5 | 30.3 | -26.3 to 130.3 |
| 3 | 14.3 | 7.0 | 11.7 | 14.1 | 13.0 | 14.4 | 17.2 | 15.5 | 3.1 to 29.3 |
| 4 | 14.5 | 17.3 | 16.7 | 13.0 | 12.0 | 15.5 | 14.3 | -3.5 | -12.2 to 6.0 |
| 5 | 10.8 | 10.3 | 10.4 | 12.6 | 13.4 | 11.1 | 7.7 | -3.4 | -15.7 to 10.7 |
| 6 | 14.9 | 10.7 | 8.4 | 10.2 | 17.2 | 22.3 | 15.6 | 16.5 | -2.3 to 38.9 |
| 7 | 8.9 | 14.5 | 11.8 | 14.8 | 7.8 | 5.7 | 8.4 | -14.7 | -28.6 to 1.9 |
| 8 | 15.1 | 36.9 | 20.6 | 14.8 | 10.7 | 10.9 | 6.6 | -26.6 | -34.3 to -18.1 |
| 9 | 26.7 | 6.0 | 13.7 | 26.3 | 32.4 | 28.3 | 32.7 | 36.4 | 6.0 to 75.5 |
| 10 | 20.0 | 9.4 | 14.8 | 23.5 | 23.3 | 22.5 | 25.1 | 19.2 | 2.5 to 38.7 |
APC = annual percent change, CI = confidence interval of the APC
Table 4. Positive Predictive Value and Trend of Screening Mammography by Hospitals Participating in Alliance for Breast Cancer Screening in Korea.
| No. of Hospital | Total | 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | APC | 95% CI |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 1.4 | 0.3 | 1.0 | 0.5 | 2.0 | 5.1 | 7.6 | 69.1 | 22.1 to 134.3 |
| 2 | 0.8 | 4.3 | 0.7 | 0.9 | 0.7 | 0.9 | 0.5 | -4.5 | -36.4 to 43.4 |
| 3 | 1.6 | 4.0 | 1.5 | 0.6 | 1.7 | 1.9 | 1.4 | 0.3 | -21.2 to 27.6 |
| 4 | 1.3 | 3.1 | 0.9 | 0.0 | 0.8 | 1.4 | 2.1 | 23.5 | -21.7 to 94.6 |
| 5 | 1.9 | 3.3 | 2.1 | 2.7 | 0.8 | 2.1 | 1.3 | -6.6 | -57.9 to 107.0 |
| 6 | 1.8 | 1.4 | 2.4 | 1.5 | 1.8 | 1.1 | 2.8 | -2.7 | -53.0 to 101.2 |
| 7 | 2.0 | 3.5 | 1.1 | 2.0 | 3.0 | 1.3 | 1.5 | 4.9 | -51.5 to 126.9 |
| 8 | 1.7 | 0.9 | 0.6 | 1.1 | 2.5 | 3.8 | 3.6 | 60.9 | -4.8 to 172.0 |
| 9 | 2.0 | 0.0 | 1.8 | 1.6 | 2.4 | 1.6 | 2.1 | 1.3 | -26.0 to 38.5 |
| 10 | 1.5 | 1.3 | 1.9 | 2.7 | 0.8 | 1.7 | 0.5 | -22.3 | -66.1 to 78.4 |
APC = annual percent change, CI = confidence interval of the APC
Table 5. Specificity and Trend of Screening Mammography by Hospitals Participating in Alliance for Breast Cancer Screening in Korea.
| No. of Hospital | Total | 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | APC | 95% CI |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 75.8 | 40.9 | 54.1 | 67.0 | 83.7 | 94.4 | 93.1 | 18.7 | 10.8 to 27.2 |
| 2 | 73.5 | 96.8 | 62.6 | 68.1 | 70.9 | 72.1 | 74.6 | -2.4 | -12.1 to 8.4 |
| 3 | 85.9 | 93.3 | 88.4 | 86.0 | 87.2 | 85.8 | 83.0 | -1.9 | -3.1 to -0.6 |
| 4 | 85.7 | 83.1 | 83.5 | 87.0 | 88.1 | 84.6 | 86.0 | 0.6 | -0.8 to 2.1 |
| 5 | 89.4 | 90.0 | 89.8 | 87.7 | 86.7 | 89.1 | 92.4 | 0.3 | -1.3 to 1.9 |
| 6 | 85.3 | 89.5 | 91.8 | 89.9 | 83.1 | 77.8 | 84.8 | -2.4 | -5.4 to 0.7 |
| 7 | 91.2 | 86.0 | 88.3 | 85.5 | 92.4 | 94.4 | 91.7 | 1.7 | -0.2 to 3.6 |
| 8 | 85.1 | 63.3 | 79.5 | 85.3 | 89.6 | 89.4 | 93.7 | 7.0 | 1.8 to 12.4 |
| 9 | 73.7 | 94.0 | 86.5 | 74.0 | 68.1 | 72.0 | 67.7 | -6.3 | -10.2 to -2.2 |
| 10 | 80.3 | 90.7 | 85.5 | 76.9 | 76.8 | 77.8 | 75.0 | -3.5 | -6.0 to -0.8 |
APC = annual percent change, CI = confidence interval of the APC
Table 6. False Positive Rate and Trend of Screening Mammography by Hospitals Participating in Alliance for Breast Cancer Screening in Korea.
| No. of Hospital | Total | 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | APC | 95% CI |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 24.2 | 59.1 | 45.9 | 33.0 | 16.3 | 5.6 | 6.9 | -39.8 | -51.2 to -25.7 |
| 2 | 26.5 | 3.2 | 37.4 | 31.9 | 29.1 | 27.9 | 25.4 | 30.8 | -26.5 to 132.6 |
| 3 | 14.1 | 6.7 | 11.6 | 14.0 | 12.8 | 14.2 | 17.0 | 15.9 | 2.7 to 30.9 |
| 4 | 14.3 | 16.9 | 16.5 | 13.0 | 11.9 | 15.4 | 14.0 | -3.5 | -11.8 to 5.7 |
| 5 | 10.6 | 10.0 | 10.2 | 12.3 | 13.3 | 10.9 | 7.6 | -3.1 | -15.6 to 11.3 |
| 6 | 14.7 | 10.5 | 8.2 | 10.1 | 16.9 | 22.2 | 15.2 | 16.5 | -2.6 to 39.4 |
| 7 | 8.8 | 14.0 | 11.7 | 14.5 | 7.6 | 5.6 | 8.3 | -14.5 | -28.5 to 2.2 |
| 8 | 14.9 | 36.7 | 20.5 | 14.7 | 10.4 | 10.6 | 6.3 | -27.3 | -34.8 to -18.9 |
| 9 | 26.3 | 6.0 | 13.5 | 26.0 | 31.9 | 28.0 | 32.3 | 36.2 | 6.1 to 74.7 |
| 10 | 19.7 | 9.3 | 14.5 | 23.1 | 23.2 | 22.2 | 25.0 | 19.5 | 2.9 to 38.7 |
APC = annual percent change, CI = confidence interval of the APC
DISCUSSION
In this study, the recall rate (19.1%), PPV (1.4%), specificity (81.1%) and FPR (18.9%) of screening mammography in the ABCS-K showed significant improvements from 2005 to 2010. However, the sensitivity (86.5%), CDR (2.69 per 1000 examinations), and ICR (0.5 per 1000 negative examinations) showed no significant trend.
The improved recall rate, PPV, specificity, and FPR in this study indicate that screening mammography is improving with regard to quality–that is, the efficiency of screening. This improvement has been due, in part, to the accumulated experience of readers and skill development of the technicians, and to changes of mammography equipment or to a combination of these factors. However, the unchanged CDR, sensitivity, and ICR indicate that mammography screening is stationary with regard to quantity–that is, the detection of cancer. However, these parameters can also be improved if the overall quality of the mammography screening is improved (8,9,10).
The diagnostic accuracy of the ABCS-K from 2005 to 2010 was superior to that of the NCSP from 2002 to 2006 in terms of the sensitivity, CDR, and PPV, whereas it was inferior in terms of the recall rate and specificity (Table 7). The differences between the groups can be mostly explained by the different characteristics of the participating facilities–those of the ABCS-K were university-affiliated hospitals, whereas those of the NCSP included all types of medical practices. Thus, there are many differences among the groups, including the characteristics of the readers and technicians and types of mammography equipment used, as well as the status of quality control (11). The inferior recall rate and specificity of the ABCS-K can be also explained by the different characteristics of the participating facilities. Many facilities had a large screening volume, showing recall rates of approximately 0%, and contributing to the low overall recall rate of the NCSP (Supplementary Fig. 1 in the online-only Data Supplement). By contrast, the institutional recall rates in the ABCS-K ranged from 8.9 to 26.7%. On the other hand, the PPV of the ABCS-K should be further improved, although it has shown some improvement compared with that of the early NCSP. It could be improved if the recall rate is further improved.
Table 7. Comparison of Diagnostic Accuracy of ABCS-K with That of NCSP 2002–2006, ACR BI-RADS and BCSC.
| ABCS-K 2005-2010 | NCSP 2002-2006* | Desirable Goal of BI-RADS† | Benchmarks of BCSC‡ | |
|---|---|---|---|---|
| Recall rate (%) | 19.1 | 7.0 | < 10 | 10.6 |
| CDR per 1000 examinations | 2.69 | 0.64 | 2-10 | 4.7 |
| PPV (%) | 1.4 | 0.64 | 5-10 | 4.4 |
| Sensitivity (%) | 86.5 | 34.8 | > 85 | 79.0 |
| Specificity (%) | 81.1 | 89.1 | > 90 | 89.8 |
*Not published data, †Desirable goal of the ACR BI-RADS 4th ed. (6), ‡BCSC (12). ABCS-K = Alliance for Breast Cancer Screening in Korea, ACR BI-RADS = American College of Radiology Breast Imaging-Reporting and Data System, BCSC = Breast Cancer Screening Consortium, CDR = cancer detection rate, NCSP = National Cancer Screening Program, PPV = positive predictive value
Compared with the desirable goal of the ACR BI-RADS and benchmarks of the Breast Cancer Screening Consortium, the sensitivity and CDR of the ABCS-K were consistent, whereas the others were suboptimal (Table 7) (6,12). The overlying reason for this, and the most important observation of this study, involves the trade-offs between the sensitivity and recall rate. The sensitivity of the ABCS-K appeared promising; however, it was achieved at the cost of recall rate. Furthermore, low PPV and specificity and high FPR can be explained by the high recall rate.
The high recall rate of the ABCS-K has been affected by examinee-related factors such as the proportion of women with dense breast tissue. High breast density is one of the strongest predictors of failure in mammography screening (13). Additionally, the proportion of dense breast tissue in mammography is high in Korean women compared with that of Western women (80.0% vs. 46.0%, respectively) (14). Therefore, the sensitivity should be lower in Korean women than in Western women in the case of a reasonable recall rate. A recent Japanese study was compatible with this rationale and showed poor sensitivity in dense breast tissue (15). However, the sensitivity of our study was comparable to that of Western women owing to a high recall rate. The high recall rate seems to overcome the limitations of high breast density, although it infringes on the cost-effectiveness of screening. The other factors affecting diagnostic accuracy, including the characteristics of the readers and examinees, as well as types of mammography equipment used, will be reported in a future series.
There were marked institutional variations in this study. Hospital numbers 1 and 8 showed desirable trends such as improvements in the recall rate, PPV (number 1), specificity, and FPR. However, the hospital numbers 3, 9, and 10 showed undesirable trends such as a deterioration in these parameters, and others showed no significant trend. These variations could have been affected by the characteristics and reading volumes of the readers, types of mammography equipment used, and characteristics and behaviors of the examinees. The effect of these factors will be reported in a future series.
This study has some limitations. First, the screening volumes of the participating hospitals were variable, and the volumes of the two hospitals accounted for approximately 40% of all cases. It could have influenced the overall results. However, the screening volumes of the participating facilities in the NCSP were also variable (Supplementary Fig. 1, Supplementary Table 3 in the online-only Data Supplement); thus, it can be considered to represent the real world. Second, all of the participating hospitals were university-affiliated, which may not be representative because the participating facilities of the NCSP included clinics (57.0%), hospitals (28.5%) and general or university-affiliated hospitals (14.5%) (Supplementary Table 3 in the online-only Data Supplement). However, it was impossible for more facilities in the NCSP to participate in this study because of limited human resources and research funding. Finally, our study could not address the present status of mammography screening because the study period was 2005–2010, and the effects of the quality control programs of the NCSP, initiated since 2010 could not be reflected (16,17). The period 2005–2010, however, showed the best choice because the NCSP database with cancer outcomes was available up to 2011 and the target population of the NCSP before 2005 was relatively small. Additionally, some time lag is inevitable in the research of population-based screening. Nevertheless, the significance of this report as the first multi-center study concerning screening mammography in Korea is warranted. Additionally, it can act as a basis for future prospective studies on breast cancer screening in Korea.
In conclusion, the sensitivity and CDR of screening mammography in the ABCS-K from 2005 to 2010 were comparable with those for Western women. By contrast, the recall rate, PPV, and specificity were suboptimal, although they showed significant improvements over this period. There were marked institutional variations in the recall rate, PPV, specificity, and FPR. Further analysis is required to explain these institutional variations.
Acknowledgments
All of authors thank Seunghoon Song, Deokrim Ryu, Hye-Mi Jo, and Bomyee Lee for data collection and management.
Footnotes
This study was supported by a grant from the National R&D Program for Cancer Control, Ministry of Health & Welfare, Republic of Korea (1420220).
Supplementary Materials
The online-only Data Supplement is available with this article at http://dx.doi.org/10.3348/kjr.2016.17.4.489.
Age Distributions of Enrolled Cases
Numbers of Breast Cancer Patients Registered in Database of NHIS within 1 Year after Screening
Numbers of Screening Facilities and Participants of NCSP for Breast Cancer According to Type of Medical Practices, 2005–2010 (Data from National Cancer Center, 2012)
Recall rates of participating facilities according to screening volume in NCSP, 2008 (data from National Cancer Center, 2012)
References
- 1.Jung KW, Won YJ, Kong HJ, Oh CM, Cho H, Lee DH, et al. Cancer statistics in Korea: incidence, mortality, survival, and prevalence in 2012. Cancer Res Treat. 2015;47:127–141. doi: 10.4143/crt.2015.060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Kim Y, Jun JK, Choi KS, Lee HY, Park EC. Overview of the National Cancer screening programme and the cancer screening status in Korea. Asian Pac J Cancer Prev. 2011;12:725–730. [PubMed] [Google Scholar]
- 3.Suh M, Choi KS, Lee YY, Jun JK. Trends in cancer screening rates among Korean men and women: results from the Korean National Cancer screening survey, 2004-2012. Cancer Res Treat. 2013;45:86–94. doi: 10.4143/crt.2013.45.2.86. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Kang MH, Park EC, Choi KS, Suh M, Jun JK, Cho E. The National Cancer Screening Program for breast cancer in the Republic of Korea: is it cost-effective? Asian Pac J Cancer Prev. 2013;14:2059–2065. doi: 10.7314/apjcp.2013.14.3.2059. [DOI] [PubMed] [Google Scholar]
- 5.Choi NM, Lee AL, Lee HK, Yi BH, Cha JG. Mammogrphic screening provided by the National Health Insurance Corporation: a 1 year audit in a secondary medical institution. J Korean Soc Radiol. 2009;60:51–55. [Google Scholar]
- 6.D'Orsi CJ, Bassett LW, Berg WA, Feig SA, Jackson VP, Kopan DB, et al. BI-RADS: mammography. In: D'Orsi CJ, Mendelson EB, Ikeda DM, editors. BI-RADS® breast imaging and reporting data system: breast imaging atlas. 4th ed. Reston: American College of Radiology; 2003. [Google Scholar]
- 7.Kim HJ, Fay MP, Feuer EJ, Midthune DN. Permutation tests for joinpoint regression with applications to cancer rates. Stat Med. 2000;19:335–351. doi: 10.1002/(sici)1097-0258(20000215)19:3<335::aid-sim336>3.0.co;2-z. [DOI] [PubMed] [Google Scholar]
- 8.Ahn HS, Kim SM, Jang M, Yun BL, Kim B, Ko ES, et al. A new full-field digital mammography system with and without the use of an advanced post-processing algorithm: comparison of image quality and diagnostic performance. Korean J Radiol. 2014;15:305–312. doi: 10.3348/kjr.2014.15.3.305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Ko SY, Kim EK, Kim MJ, Moon HJ. Mammographic density estimation with automated volumetric breast density measurement. Korean J Radiol. 2014;15:313–321. doi: 10.3348/kjr.2014.15.3.313. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Kim SA, Chang JM, Cho N, Yi A, Moon WK. Characterization of breast lesions: comparison of digital breast tomosynthesis and ultrasonography. Korean J Radiol. 2015;16:229–238. doi: 10.3348/kjr.2015.16.2.229. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lee EH, Jung SE. Current status of radiologists' part-time services in mammography. J Korean Soc Breast Screen. 2012;9:142–147. [Google Scholar]
- 12.Sickles EA, D'Orsi CJ. ACR BI-RADS® follow-up and outcome monitoring. In: D'Orsi CJ, Sickles EA, Mendelson EB, Morris EA, editors. ACR BI-RADS® atlas breast imaging reporting and data system. Reston, VA: American College of Radiology; 2013. [Google Scholar]
- 13.Mandelson MT, Oestreicher N, Porter PL, White D, Finder CA, Taplin SH, et al. Breast density as a predictor of mammographic detection: comparison of interval- and screen-detected cancers. J Natl Cancer Inst. 2000;92:1081–1087. doi: 10.1093/jnci/92.13.1081. [DOI] [PubMed] [Google Scholar]
- 14.Stomper PC, D'Souza DJ, DiNitto PA, Arredondo MA. Analysis of parenchymal density on mammograms in 1353 women 25-79 years old. AJR Am J Roentgenol. 1996;167:1261–1265. doi: 10.2214/ajr.167.5.8911192. [DOI] [PubMed] [Google Scholar]
- 15.Suzuki A, Kuriyama S, Kawai M, Amari M, Takeda M, Ishida T, et al. Age-specific interval breast cancers in Japan: estimation of the proper sensitivity of screening using a population-based cancer registry. Cancer Sci. 2008;99:2264–2267. doi: 10.1111/j.1349-7006.2008.00926.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Lee EH, Jun JK, Kim YM, Bae K, Hwang KW, Choi BB, et al. Mammography boot camp to improve a quality of national cancer screening program in Korea: a report about a test run in 2012. J Korean Soc Breast Screen. 2013;10:162–168. [Google Scholar]
- 17.Lee EH, Jun JK, Jung SE, Kim YM, Choi N. The efficacy of mammography boot camp to improve the performance of radiologists. Korean J Radiol. 2014;15:578–585. doi: 10.3348/kjr.2014.15.5.578. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Age Distributions of Enrolled Cases
Numbers of Breast Cancer Patients Registered in Database of NHIS within 1 Year after Screening
Numbers of Screening Facilities and Participants of NCSP for Breast Cancer According to Type of Medical Practices, 2005–2010 (Data from National Cancer Center, 2012)
Recall rates of participating facilities according to screening volume in NCSP, 2008 (data from National Cancer Center, 2012)