Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 May 15.
Published in final edited form as: JAMA Surg. 2020 Aug 1;155(8):759–770. doi: 10.1001/jamasurg.2020.0322

Deimplementation of the Choosing Wisely Recommendations for Low-Value Breast Cancer Surgery

A Systematic Review

Ton Wang 1, Alison S Baskin 1, Lesly A Dossett 1
PMCID: PMC10185302  NIHMSID: NIHMS1897589  PMID: 32492121

Abstract

IMPORTANCE

Overtreatment of early-stage breast cancer results in increased morbidity and cost without improving survival. Major surgical organizations participating in the Choosing Wisely campaign identified 4 breast cancer operations as low value: (1) axillary lymph node dissection for limited nodal disease in patients receiving lumpectomy and radiation, (2) re-excision for close but negative lumpectomy margins for invasive cancer, (3) contralateral prophylactic mastectomy in patients at average risk with unilateral cancer, and (4) sentinel lymph node biopsy in women 70 years or older with hormone receptor–positive cancer.

OBJECTIVE

To evaluate the extent to which these procedures have been deimplemented, determine the implications of decreased use, and recognize possible barriers and facilitators to deimplementation.

EVIDENCE REVIEW

A systematic review of published literature on use trends in breast surgery was performed in accordance with PRISMA guidelines. The Ovid, Embase, Cumulative Index to Nursing and Allied Health Literature, and Cochrane databases were searched for original research with relevance to the Choosing Wisely recommendations of interest. Eligible studies were examined for data about use, and any patient-level, clinician-level, or system-level factors associated with use.

FINDINGS

Concordant with recommendations, national rates of axillary lymph node dissection for patients with limited nodal disease have decreased by approximately 50% (from 44% in 2011 to 30% to 34% in 2012 and 25% to 28% in 2013), and national rates of lumpectomy margin re-excision have decreased by nearly 40% (from 16% to 34% before to 14% to 18% after publication of a consensus statement). Conversely, national rates of contralateral prophylactic mastectomy continue to rise each year, accounting for up to 30% of all mastectomies for breast cancer (range in all mastectomy cases: 2010–2012, 28%−30%; 1998, <2%), and rates of sentinel lymph node biopsy in women 70 years or older with low-risk breast cancer are persistently greater than 80% (range, 80%−88%). Factors associated with high rates of contralateral prophylactic mastectomy use are younger age, white race, increased socioeconomic status, and the availability of breast reconstruction; limited data exist on factors associated with high rates of sentinel lymph node biopsy in women 70 years or older. Successful deimplementation of axillary lymph node dissection and lumpectomy margin re-excision were associated with decreased costs and improved patient-centered outcomes.

CONCLUSIONS AND RELEVANCE

This review demonstrates variable deimplementation of 4 low-value surgical procedures in patients with breast cancer. Addressing specific patient-level, clinician-level, and system-level barriers to deimplementation is necessary to encourage shared decision-making and reduce overtreatment.


Low-value care represents a specific segment of health care waste associated with the delivery of services without a clinically meaningful benefit. The estimated cost associated with unnecessary medical tests, treatments, and procedures is more than $200 billion annually in the US.1 In addition to the financial consequences, overtreatment can lead to significant physical, psychological, and social harm to individual patients.2 Asaresult, a national spot-light has emerged on eliminating overtreatment and low-value care.

Choosing Wisely is a national campaign founded in 2012 by the American Board of Internal Medicine Foundation to address overtreatment.3 Seventeen surgical societies have participated in the campaign, generating more than 110 recommendations to avoid low-value care in surgery. Nearly all these recommendations target low-value perioperative care, such as tests or medications.4 A no-table exception is in the field of breast surgery, in which multiple operations were identified as low value. Based on data from randomized clinical trials and meta-analyses, the American College of Surgeons, the Society for Surgical Oncology (SSO), and the American Society for Breast Surgeons together identified 4 surgical targets for the deimplementation of low-value breast cancer care: (1) axillary lymph node dissection (ALND) for limited nodal disease in patients receiving lumpectomy and radiation, (2) re-excision for close but negative margins for invasive cancer, (3) contralateral prophylactic mastectomy (CPM) in patients at average risk with unilateral cancer, and (4) sentinel lymph node biopsy (SLNB) in women 70 years or older with hormone receptor–positive cancer.5

Despite substantial evidence supporting these recommendations and overall enthusiasm for reducing low-value cancer care, deimplementation rates and determinants are poorly understood.The objective of this study is to evaluate national trends in deimplementation across Choosing Wisely recommendations to identify potential targets for reducing the use of low-value procedures. Additional aims of this study are to determine the implications of decreased use and recognize possible barriers and facilitators to deimplementation.

Methods

Study Overview

We conducted a systematic review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) schema. The study protocol was registered with PROSPERO prior to initiating the review (CRD42019127077).

Data Sources and Searches

We performed literature searches in the Ovid, Embase, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Cochrane databases in March 2019. Each search combined Medical Subject (MeSH) headings with keyword variations to identify studies on breast surgery recommendations and practice patterns. Search terms and a selection flowchart are provided in the eAppendix in the Supplement. No restrictions were applied to the searches. After excluding duplicates, articles were combined into a single file for review in Endnote X8 (Clarivate Analytics).

Study Selection

We screened titles for relevance to the 4 Choosing Wisely recommendations. Studies were limited to original research in English evaluating1ormoreoftherecommendationsintheUS.Becauseour study aimed to assess deimplementation rates, studies were excluded if they contained no data regarding procedure use trends. One reviewer (T.W.) assessed abstracts to ensure alignment with inclusion and exclusion criteria. Two reviewers (T.W. and A.B.) then independently reviewed the full-text articles to verify eligibility. After discussing discrepancies and reaching consensus, the final set of eligible articles for data abstraction was identified. We performed a hand search of the references from eligible articles to identify any additional relevant studies.

Data Extraction and Analysis

We captured detailed data from all studies, including study design, patient cohort, main variables, results, and conclusions. Data were extracted independently and in duplicate, and a third methodologist (L.A.D.) resolved disagreements. We searched the data for results and conclusions on procedure use rates, determinants of deimplementation, and implications of deimplementation. For each study, the quality of the evidence was rated from 1 to 5, based on the Oxford Centre for Evidence-Based Medicine rating system.

Results

Fifty-seven articles were included in this systematic review. Four-teen articles619 reported on the recommendation to avoid ALND for limited nodal disease (Table 1), 10 articles2029 discussed the recommendation to avoid re-excision for close but negative margins for invasive cancer (Table 2), 27 articles3035 evaluated the recommendation to avoid CPM in patients with unilateral cancer (Table 3), and 6articles3034studied the recommendation to avoid SLNB in women 70 years or older with hormone receptor–positive, invasive breast cancer (Table 4). The determinants associated with persistent procedure use for each recommendation are summarized in Table 5.

Table 1.

Findings on Avoiding Routinely Excising All the Lymph Nodes Under the Arm in Patients Undergoing a Lumpectomy for Breast Cancer

Source Study period Data source Level of evidence Cohort Excluded patients ALND before vs after Z00011, No./total No. (%)
Caudle et al,6 2012 2009–2011 Institutional 3 Patients with clinical stage T1–2N0M0 invasive breast cancer who received BCT Patients who received chemotherapy or converted to mastectomy 53 of 62 Patients (85%) vs 10 of 42 patients (24%) who were SLN positive. In the first 6 mo after discussion of the Z0011 results, 7 of 25 patients (28%) who were SLN positive underwent ALND vs 3 of 17 (18%) in the subsequent 6 mo
Fillion et al,7 2016 2007–2013 Institutional 3 Included patients with clinical stage T1–2N0M0 invasive breast cancer, ≤2 positive nodes, and who received BCS and radiation Patients who received neoadjuvant systemic therapy, underwent bilateral procedures, or required reconstructive procedures 52 of 67 Patients (78%) vs 7 of 34 patients (21%) who were SLN positive; 75% of patients who were SLN positive in 2010, 26% in 2011, and 16% in 2012 and 2013
Gabriel et al,8 2015 2007–2014 Institutional 3 All patients who received AlNd. Being Z0011 eligible was defined as patients with clinical stage T1-T2N0 invasive breast cancer and ≤2 positive nodes who received BCS and radiation Z0011-ineligible defined as patients who received neoadjuvant chemotherapy followed by breast conservation or were found to have extranodal extension of the SLNB Overall rate of ALND: 5.37 cases/mo before Z0011 (279 of 804 cases) vs 5.62 cases/mo after Z0011 (191 of 558 cases). The compliance rate after Z0011 was approximately 90% (53 of 59 cases); ALND rates did not change
Jorns et al,9 2016 18 mo prior to and after Z0011 study publication Institutional 3 Patients who underwent SLNB, had a preoperative core biopsy diagnosis of ductal carcinoma in situ or invasive carcinoma, and were clinically node negative None 17 of 24 Patients (70.8%) vs 13 of 34 patients (38.2%) who were SLN positive
Le et al,10 2016 2009–2013 Institutional 3 Patients with ≤T2 invasive breast cancer, ≤2 positive nodes, and no gross extranodal disease who received BCT Patients who received neoadjuvant systemic therapy 34 of 45 Patients (75.6%) vs 1 of 46 patients (2.2%) who were SLN positive
Robinson et al,11 2014 2003–2013 Institutional 3 Patients with T1-T2 invasive breast cancer with a clinically negative axilla who received BCT None Completion in 84% vs 63% of patients who were SLN positive; numerators and denominators not reported
Subhedar et al,12 2015 2006–2013 Institutional 3 All patients who received BCT and SLNB Patients who had a SLNB but no nodes identified on pathologic examination 379 of 2372 Patients (16.0%) vs 68 of 2841 patients (2.4%)
Weiss et al,13 2017 2015–2016 Institutional 3 Patients with clinical T1–2N0 invasive breast cancer, tumor ≤5 cm, ≤2 positive nodes, who received BCS and SLNB Patients who received neoadjuvant chemotherapy or endocrine therapy, converted to mastectomy, or had nodal metastasis on fine-needle aspiration Of patients who were SLN positive, 4 of 48 patients (8%) in 2015–2016 vs 24% (numerator and denominator not reported) in the first year after publication of the trial data
Wright et al,14 2015 28 mo prior to and 28 mo after Z0011 study publication Institutional 3 Patients with invasive breast cancer, tumor ≤5 cm, clinically negative axilla, and ≤2 positive nodes who received BCS and radiation Patients who received neoadjuvant therapy, had only isolated tumor cells identified in the SLN, or underwent preoperative axillary ultrasonographic examination with fine-needle aspiration 92 of 110 Patients (84%) vs 29 of 70 patients (41%) who were SLN positive; in 14-mo increments, the rate decreased from 90% (53 patients) to 77% (39 patients) to 51% (20 patients) to 29% (9 patients) in those meeting Z0011 criteria
Howard et al,15 2016 2004–2013 NCDB and SEER 3 Patients with tumor ≤5 cm, invasive breast cancer, and ≤2 positive nodes who received BCS and radiation Patients who received neoadjuvant chemotherapy (NCDB) 57.4% to 64.3% of Patients who were SLN positive before Z0011 (NCDB) vs 29.6% in 2012 (NCDB) and 24.7% in 2013 (SEER); numerators and denominators not reported
Mann et al,16 2017 2012–2013 NCDB 3 Patients with clinical T1-T2N0M0 invasive breast cancer and ≤2 positive nodes who received BCS and radiation Patients who received neoadjuvant systemic therapy or had matted nodes or gross extranodal disease 34.2% of Patients who were SLN positive in 2012 vs 27.9% in 2013; numerators and denominators not reported
Nocera et al,17 2018 2007–2014 ACS-NSQIP 3 Patients with invasive breast cancer None 3787 of 10 710 Patients (35.4%) diagnosed with IBC in 2007 vs 4576 of 21 166 patients (21.6%) in 2014
Rosenberger et al,18 2019 2004–2014 NCDB 3 Patients with clinical stage I, II, or III invasive breast cancer who received BCS or mastectomy Patients with an unknown number of lymph nodes retrieved 32% of Patients who received BCS or mastectomy for invasive breast cancer in 2004 vs 16% in 2014; numerators and denominators not reported
Yao et al,19 2015 1998–2011 NCDB 3 Patients with clinical stage T1–2N0M0 invasive breast cancer, negative resection margins, and ≤2 positive nodes who received BCS and radiation Patients who received neoadjuvant chemotherapy In patients who were SLN positive, the proportion of patients receiving SLNB only increased from 6.1% in 1998, 23.0% in 2009, and 56.0% in 2011; numerators and denominators not reported

Abbreviations: ACS-NSQIP, American College of Surgeons National Surgical Quality Improvement Program; ALND, axillary lymph node dissection; BCS, breast-conserving surgery; BCT, breast-conserving treatment; IBC, invasive breast cancer; NCDB, National Cancer Data Base; SEER, Surveillance, Epidemiology, and End Results; SLN, sentinel lymph nodes.

Table 2.

Findings on Avoiding Routinely Reoperating on Patients With Invasive Cancer if the Cancer is Close to the Edge of the Excised Lumpectomy Tissue

Source Study period Data source Level of evidence Cohort Excluded individuals Re-excision BCS or conversion to mastectomy before vs after guideline publication, No./total No. (%)
Bhutiani et al,20 2018 1998–2016 Institutional 3 Patients with stage I or II invasive breast cancer who received BCT Patients who received neoadjuvant chemotherapy or were diagnosed by excisional biopsy 46 of 126 Patients (37%) vs 10 of 111 patients (9%)
Chung et al,21 2015 2011–2014 Institutiona1 3 Patients with invasive breast cancer who received BCS and radiation None 115 of 597 Patients (19%) vs 32 of 248 patients (13%)
Heelen-Gladden et al,22 2017 2010–2016 Institutional 3 Patients with invasive breast cancer with or without ductal carcinoma in situ who received BCS None 42 of 395 Patients (10.6%) vs 29 of 286 patients (10.1%)
Patten et al,23 2017 2011–2015 Institutional 3 Patients with stage I or II invasive breast cancer who received BCS and radiation None 82 of 402 Patients (20.4%) vs 90 of 552 patients (16.3%)
Rosenberger et al,24 2016 2013–2014 Institutional 3 Patients with stage I or II invasive breast cancer who received BCS and radiation Patients who received neoadjuvant chemotherapy, had bilateral invasive breast cancers, or had a personal history of breast cancer 108 of 504 Patients (21.4%) vs 106 of 701 patients (15.1%)
Van den Bruele et al,25 2018 2009–2017 Institutional 3 Patients with invasive breast carcinoma who received BCS Patients who were diagnosed on excisional biopsy 23 of 116 Patients (20%) vs 13 of 85 patients (15%), which decreased further to 10 of 85 patients (12%) with addition of intraoperative specimen ink
Kaczmarski et al,26 2019 2012–2018 Medicare 3 Patients with breast cancer who received BCT Patients without a diagnosis of breast cancer within 6 mo before or after initial surgery, with a history of surgery for breast cancer, who were cared for by multiple surgeons, or who were enrolled in Medicare parts A and B for fewer than 6 mo before BCT 23 363 of 105 838 Patients (22.1%) vs 31 949 of 185 227 patients (17.2%)
Kantor et al,27 2019 2004–2015 NCDB 3 Patients with stage I or II invasive breast cancer who received BCS Patients who received neoadjuvant therapy, were diagnosed on excisional biopsy, or had positive margins at definitive operation 16.1% of Patients in 2004, 18.7% of patients in 2011, 17.2% of patients in 2013, and 14% of patients in 2015 underwent re-excision BCS, unilateral mastectomy, or bilateral mastectomy; numerators and denominators not reported
Morrow et al,28 2017 2013–2015 SEER 3 Patients with stage I or II invasive breast cancer who received BCS Patients with a history of breast cancer or bilateral disease 34% vs 18%; Numerators and denominators not reported
Schulman et al,29 2016 2013–2015 ASBrS Mastery of Breast Surgery Database 3 Patients with invasive breast cancer who received BCS Patients diagnosed on excisional biopsy 2482 of 13 297 Patients (20.2%) vs 1851 of 12 805 patients (16.5%)

Abbreviations: ASBrS, American Society for Breast Surgeons; BCS, breast-conserving surgery; BCT, breast-conserving treatment; NCDB, National Cancer Data Base; SEER, Surveillance, Epidemiology, and End Results.

Table 3.

Findings on Avoiding Routinely Performing a Double Mastectomy in Patients Who Have a Single Breast With Cancer

Article Study period Data source Level of evidence Cohort Excluded individuals Patients with CPM, No./total No.(%)
Chung et al,36 2012 1995–2008 Institutional 3 Patients with unilateral stage 0 to III breast cancer who received a mastectomy Patients with a previous mastectomy 8 of 93 Patients (19.4%) with mastectomies in 1995–1999 vs 86 of 133 patients (64.7%) in 2005–2008
Damle et al,37 2010 2002–2009 Institutional 3 Patients with unilateral stage 0 to IV breast cancer who received surgical treatment Patients who had had a mastectomy for a prior breast cancer 2 of 31 Patients (6%) with mastectomies in 2002 vs 25 of 68 patients (37%) in 2009
Hoskin et al,38 2016 2009–2014 Institutional 3 Patients with unilateral stage 0 to III breast cancer who received surgical treatment Patients with a prior history of breast cancer 48% of Mastectomies in 2009 vs 58% in 2014; numerators and denominators not reported
Jerome-D’Emilia et al,39 2019 2004–2014 Institutional 3 Patients ages 40 to 80 y old with unilateral stage 0 to III breast cancer who received surgical treatment Patients with a prior history of breast cancer, inflammatory breast cancer, unstaged tumors, or multifocal disease and those diagnosed in a nursing home, on autopsy, or death certificate 5 of 113 Patients (4.4%) with all procedures (12.2% [5 of 41] of mastectomies) in 2004 vs 54 of 190 patients (28.4%) with all procedures (69.2% [54 of 78] with mastectomies) in 2014
Jones et al,40 2009 1998–2007 Institutional 3 Patients with unilateral stage 0 to IV breast cancer who received a mastectomy None 12 of 184 Patients (6.5%) with mastectomies in 1999 to 28 of 174 patients (16.1%) in 2007
King et al,41 2011 1997–2005 Institutional 3 Patients with unilateral stage 0 to III breast cancer who received a mastectomy Patients with a prior history of breast cancer or metastatic disease or who had received neoadjuvant chemotherapy From 6.7% of 225 mastectomies in 1997 to 24.2% of 491 mastectomies in 2005
Pinell-White et al,42 2015 2002–2012 Institutional 3 Patients with unilateral stage 0 to IV breast cancer who received a mastectomy Patients who had a previous mastectomy <25% of Mastectomies in 2002 vs 66% in 2012; numerators and denominators not reported
Sabel et al,43 2016 2000–2012 Institutional 3 Patients with unilateral stage I, II, or III breast cancer who received surgical treatment Patients with a prior history of breast cancer 4% of All procedures in 2000 vs 19% in 2011; numerators and denominators not reported
Stucky et al,44 2010 2000–2008 Institutional 3 Patients with unilateral invasive breast cancer who received surgical treatment None 0% of All procedures in 2000 vs 20% in 2008; numerators and denominators not reported
Suggs et al,45 2017 2006–2015 Institutional 3 Patients with unilateral stage T0–2N0–1M0 breast cancer who received surgical treatment None 2.7% of All procedures (9.3% of mastectomies) in 2006–2010 vs 12.3% of all procedures (33.6% of mastectomies) in 2011–2015; numerators and denominators not reported
Yi et al,46 2010 2000–2006 Institutional 3 Patients with unilateral stage 0 to III breast cancer who received surgical treatment None Significant increase from 6.8% of all procedures (15.5% of mastectomies) in 2000 to 14.0% (29.8% of mastectomies) in 2006; numerators and denominators not reported
Clerville et al,47 2018 2005–2013 Single-state cancer registry 3 Patients with stage 0 to IV breast cancer who received surgical treatment Patients diagnosed on autopsy or death certificate From 4.21% of all procedures in 2005 to 9.63% in 2013; numerators and denominators not reported
Jerome-D’Emilia et al,48 2019 2004–2014 Single-state cancer registry 3 Patients aged 40 to 80 y with unilateral stage 0 to III breast cancer who received surgical treatment Patients with a prior history of breast cancer, inflammatory breast cancer, unstaged tumors, or multifocal disease and those diagnosed in a nursing home, on autopsy, or death certificate 171 of 4600 Patients (3.7%) with all procedures (171 of 1527 [11.2%] with mastectomies) in 2004 vs 529 of 4891 patients (10.8%) with all procedures (529 of 1607 [32.9%] with mastectomies) in 2014
Kurian et al,49 2014 1998–2011 Single-state cancer registry 3 Patients with unilateral stage 0 to III breast cancer who received mastectomy or BCS with radiation Patients diagnosed on autopsy or a death certificate, tumor size >5 cm or unknown size, a microscopic or diffuse tumor, Paget disease, inflammatory carcinoma, or unknown lymph node involvement From 2.0% of all procedures in 1998 to 12.3% in 2011; numerators and denominators not reported
McLaughlin et al,50 2009 1995–2005 Single-state cancer registry 3 Patients with breast cancer who received surgical treatment None 1.9% of All procedures in 1995–1996 (5.6% of mastectomies) to 4.2% (14.1% of mastectomies); numerators and denominators not reported
Yakoub et al,51 2015 1996–2009 Single-state cancer registry 3 Patients with unilateral invasive breast cancer who received surgical treatment None 36 of 1640 Patients (2%) with all procedures in 1996 vs 163 of 2034 patients (8%) in 2009
Agarwal et al,52 2015 2000–2010 SEER 3 Patients with unilateral stage I to III breast cancer who received a mastectomy Patients with recurrent breast cancer 1024 of 13 296 Patients (7.7%) with mastectomies in 2000 vs 4358 of 15 401 (28.3%) in 2010
Albornoz et al,53 2015 1998–2011 NCDB 3 Patients with unilateral stage 0 to II breast cancer who received surgical treatment None 6862 of 125 789 Patients (5.4%) with all procedures (6862 of 45 345 [15.1%] with mastectomies) in 2005 vs 17 090 of 144 016 patients (11.8%) with all procedures (17 090 of 58 018 [29.5%] with mastectomies) in 2011
Cemal et al,54 2012 1998–2008 Nationwide Inpatient Sample Database 3 Patients with breast cancer or at increased risk of breast cancer who received a mastectomy; patients undergoing bilateral mastectomies with a cancer diagnosis were assumed to have CPMs if they had unilateral cancer None From 3.9% of mastectomies in 1998 to 20.7% in 2008; numerators and denominators not reported
Grimmer et al,55 2015 1998–2011 NCDB 3 Patients with unilateral stage 0 to II breast cancer Patients who received neoadjuvant therapy or were diagnosed on excisional biopsy From 1.9% of all breast cancer patients in 1998 to 10.2% in 2011; numerators and denominators not reported
Kummerow et al,56 2014 1998–2011 NCDB 3 Patients with unilateral stage T0–2N0–2M0 breast cancer who received surgical treatment Patients who were diagnosed but not treated at the reporting hospital From 5.4% of mastectomies in 1998 to 29.7% in 2011; numerators and denominators not reported
Nash et al,57 2017 2004–2012 North American Association of Central Cancer Registries Database 3 Patients with unilateral invasive breast cancer who received surgical treatment Patients with distant disease 20 037 of 391 393 Patients (5.1%) with all procedures (20 037 of 158 516 [12.6%] with mastectomies) in 2004–2006 vs 49 592 of 416 030 patients (11.9%) with all procedures (49 592 of 174 917 [28.4%] with mastectomies) in 2010–2012
Pesce et al,58 2014 2003–2010 NCDB 3 Patients with stage 0 to II breast cancer who received surgical treatment Patients who received neoadjuvant treatment or were diagnosed on excisional biopsy From 4.1% of all procedures (12.7% of mastectomies) in 2003 to 9.7% of all procedures (28.9% of mastectomies) in 2010; numerators and denominators not reported
Tuttle et al,59 2007 1998–2003 SEER 3 Included patients with unilateral stage I to III breast cancer who received surgical treatment Patients who received a radical or extended radical mastectomy; had unstaged tumors, multifocal disease, grade IV tumors; or were diagnosed in a nursing home, on autopsy, or death certificate From 1.8% of all procedures (4.2% of mastectomies) in 1998 to 4.5% of all procedures (11.0% of mastectomies) in 2003; numerators and denominators not reported
Vaz-Luis et al,60 2016 2000–2009 National Comprehensive Cancer Network 2 Patients with unilateral stage I breast cancer who received surgical treatment Patients who received neoadjuvant treatment, had unknown hormone receptor and human epidermal receptor 2 status, or were not treated with definitive surgery From 13% of mastectomies in 2000 to 30% in 2009; numerators and denominators not reported
Wong et al,61 2017 1998–2012 SEER 3 Patients with unilateral stage I to III breast cancer who received surgical treatment Patients who had previous primary malignant conditions, underwent radical or extended radical mastectomy, or had an unknown vital status or cause of death From 3.9% of all procedures in 2002 to 12.7% in 2012; numerators and denominators not reported
Yao et al,62 2010 1998–2007 NCDB 3 Patients with unilateral stage 0 to III breast cancer who received surgical treatment Patients with multiple primary breast cancers diagnosed within a year of one another 395 of 105 864 Patients (0.4%) with all procedures in 1998 to 5835 of 123 551 patients (4.7%) in 2007

Abbreviations: BCS, breast-conserving surgery; BCT, breast-conserving treatment; CPM, contralateral prophylactic mastectomy; NCDB, National Cancer Data Base; SEER, Surveillance, Epidemiology, and End Results.

Table 4.

Findings on Avoiding Routine Use of Sentinel Node Biopsy in Clinically Node Negative Women 70 Years or Older With Hormone Receptor–Positive Invasive Breast Cancer

Source Study period Data source Level of evidence Cohort Excluded individuals Patients receiving axillary surgery, No./total No. (%)
Ferrigni et al,30 2019 2005–2014 Institutional 3 Patients ≥80 y old with stage I, II, or III invasive breast cancer Patients who had a previous diagnosis of ductal carcinoma in situ or invasive breast cancer 94/124 (76%)
Mamtani et al,31 2016 2001–2010 Institutional 3 Patients 80–89 y old who were referred for surgical evaluation of stage I or II invasive breast cancer Patients who received neoadjuvant chemotherapy, had bilateral breast cancers, or had a previous diagnosis of breast cancer 81/178 (46.3%)
Chagpar et al,32 2017 2004–2013 NCDB 3 Patients 70–90 y old with clinically lymph node-negative, hormone receptor-positive invasive breast cancers None 154 504/193 728 (79.8%)
Chagpar et al,33 2017 2004–2012 NCDB and SEER 3 Patients ≥70 y old with clinically lymph node-negative, hormone receptor-positive breast cancer Patients with tumor size ≥20 cm NCDB: 126 638/157 942 (80.2%); over time, the proportion of patients who did not have lymph node evaluation decreased; in 2004, 29.2% had no lymph node evaluation compared with 18.7% in 2012. SEER: 79.8%
Dominici et al,34 2017 2012–2013 NCDB 3 Patients >65 y old with stage I or II invasive breast cancer without clinically node-positive disease who received BCS or mastectomy Patients with non-Medicaid or non-Medicare government insurance, missing/unknown tumor size or node status, preoperative radiation, or no surgery within 12 mo of diagnosis 35 679/40 851 Patients (87.3%) >70 y old and 8920/12 308 patients (72.5%) >80 y old. For patients ≥70 y old with clinically node-negative, stage I or II hormone receptor-positive disease, 88.0% underwent axillary surgery
Kantor et al,35 2016 2004–2012 NCDB 3 Patients ≥80 y old with estrogen receptor-positive breast cancer with 2 or less lifetime cancer diagnoses Patients who had in situ disease, metastatic disease, or received adjuvant or neoadjuvant chemotherapy 65 250/95 357 (69%)

Abbreviations: BCS, breast-conserving surgery; BCT, breast-conserving treatment; NCDB, National Cancer Data Base; SEER, Surveillance, Epidemiology, and End Results.

Table 5.

Determinants Associated With Increased Procedure Use

Procedure Factor
Patient Tumor Clinician Facility
Axillary lymph node dissection Younger age, black race, and Hispanic ethnicity Larger size, lobular histology, higher grade, estrogen receptor/progesterone receptor negative, larger volume of metastasis, and >1 positive node Surgeon-level variation Low breast cancer volume, nonacademic facility, and geographic region
Margin re-excision Younger age, black race, rural area, and private insurance Close margin for ductal carcinoma in situ, higher-stage disease, lobular histology, and human epidermal growth factor receptor 2 subtype Surgeon-level variability, <100% breast surgery practice, and low volume of patients with breast cancer Site not approved by the Society for Surgical Oncology and geographic region
Contralateral prophylactic mastectomy Younger age, white race, socioeconomic status, marital status, family history, and preoperative magnetic resonance imaging Smaller tumors; lower-grade tumors, lower stage tumors, negative nodes, lobular histology None Teaching hospitals, hospitals with increased surgical volume, and availability of breast reconstruction
Sentinel lymph node biopsy in patients ≥70 y Younger age, fewer comorbidities, and private insurance Mastectomy receipt None Increased surgical volume

Avoiding Routine Excision of All Lymph Nodes Beneath the Arm in Patients Having Lumpectomy for Breast Cancer

The recommendation to avoid routine excision of all axillary lymph nodes in patients undergoing lumpectomy is based on the American College of Surgeons Oncology Group Z0011 trial,63 which found that ALND does not improve survival or recurrence rates in patients with small tumors with 1 or 2 positive lymph nodes who receive breast-conserving surgery and radiation. The trial results were first presented in 2010 and published in early 2011.

Procedure Use Rates

All but 1 study8 reported a significant decrease in ALND rates over time.619 Nine studies614 evaluated single-institution data and demonstrated great variation in ALND use. Overall, 71% to 85% of eligible patients with positive sentinel lymph nodes (SLNs) received an ALND before Z0011, compared with 2% to 63% after. The most significant reduction in use by a single institution resulted in a decrease in ALND rates for patients who had positive SLNs and were Z0011 eligible from 34 of 45 patients (75.6%) in the years 2009 to 2011 to 1 of 46 patients (2.2%) in 2011 to 2013.10 By comparison, 2 centers observed persistent ALND rates of greater than 38%.9,11 Continued deimplementation for more than 5 years after the Z0011 trial was noted; at one institution, the ALND rate for eligible patients decreased from 8 of 48 (24%) in 2011 to 8% (numerator and denominator not reported) in 2015 to 2016.13 Five studies1519 evaluated national trends and found that ALND rates for patients eligible for Z0011 ranged from 57% to 77% prior to the Z0011 trial compared with 25% to 44% afterwards. Mirroring institutional trends, these rates decreased over several years; national rates of ALND were 44% in 2011, 30% to 34% in 2012, and 25% to 28% in 2013.15,16,19

Determinants of Deimplementation

Several studies reported patient-level, tumor-level, and facility-level factors associated with ALND use. Patient demographics associated with increased use of ALND included younger age10,16,18,19 and black or Hispanic race.16,18,19 Patients eligible for Z0011 with high-risk tumor features, including lobular or mixed histology,6,14,19 larger tumor size,6,10,18 higher grade,14,18,19 larger volume of nodal metastasis,7,19 presence of extranodal extension,7,13,14 negative hormone receptor status,10,14,19 and more than 1 positive SLN13,16,19 were more likely to receive ALND. Treatment at low-volume and nonacademic or research hospitals was associated with increased use of ALND,16,18 and facilities located in New England had lower rates of ALND.16,19 One study14 noted significant variation within a single health system in surgeon-level adoption of Z0011 results.

Implications of Deimplementation

Several studies reported a significant decrease in frozen-section analysis of SLNs, leading to decreased operative time and cost.6,7,9,13,14 There also appears to be potential outcomes on adjuvant therapy, with 1 study6 showing an increase in the delivery of high-tangent breast radiation fields to target the axilla in patients with positive SLNs who omit ALND and another study7 showing a decrease in the use of adjuvant chemotherapy after Z0011. In terms of patient morbidity, Howard et al15 estimated that approximately 1700 women diagnosed with breast cancer in the US in 2012 did not undergo ALND as a result of the Z0011 trial. Based on typical complication rates, this reduction translated to an estimated 87 fewer wound infections, 139 fewer axillary seromas, 520 fewer cases of axillary paresthesia, and 225 fewer lymphedema cases nationwide.15 Finally, from an education and training perspective, multiple studies noted that the Z0011 trial decreased resident participation in ALNDs.8,17,18

Avoiding Routine Reoperations on Patients With Invasive Cancer if the Cancer Is Close to the Edge of the Excised Lumpectomy Tissue

This recommendation is based on the 2014 Society of Surgical Oncology and American Society for Radiation Oncology (SSO/ASTRO) consensus statement endorsing a margin termed no tumor on ink for patients with stage I and II invasive cancer undergoing lumpectomy with whole-breast irradiation.64 This guideline states that if the tumor extends close to the edge of the specimen but not to the inked margin, re-excision is not necessary.

Procedure Use Rates

All but 1 study22 noted a decrease in reoperation rates (including re-excision and conversion to mastectomy) after 2014.2029 Six institutional studies demonstrated overall decreased reoperation rates after lumpectomy from 11% to 37% prior to release of the consensus statement to 9% to 16% afterwards.2025 Two studies20,21 evaluated reoperation rates in patients who had no tumor on ink and found a decrease from 22% (23 of 103 patients) to 5% (5 of 105 patients) and from 30% (35 of 115 patients) to 22% (7 of 32 patients) after the SSO/ASTRO recommendations. Four studies2629 evaluated national trends, demonstrating overall reoperation rates after lumpectomy significantly decreased from 16% to 34% before to 14% to 18% after publication of the consensus statement.

Determinants of Deimplementation

Four studies2124 found that patients with invasive breast cancer and concurrent noninvasive disease (ductal carcinoma in situ [DCIS]) were likely to experience re-excision for a close margin for the DCIS component. While the presence of DCIS at the margin was a factor significantly associated with re-excision, 1 study24 did note a trend toward fewer re-excisions after the release of recommendations for cases in which the margin was negative for invasive cancer but close for DCIS. Although there were limited findings on tumor factors associated with increased reoperation, 1 study27 found that patients with higher-stage disease, lobular histology, and human epidermal growth factor receptor 2-positive subtype had the highest rates of reoperation. Few patient factors were consistently found to contribute toward unnecessary re-excisions, although isolated studies noted increased rates of re-excisions in patients of black race and from rural areas,26 with private insurance,27 residing in the North-east region of the US,26 and at younger ages.23,26,27 Physician-level and facility-level factors associated with increased reoperation rates included a breast surgery practice that was less than 100%, practice at a non-SSO–approved teaching site, and low patient volume and breast-conserving surgery volume.26,28,29 Two studies noted that the recommendation did directly affect clinician practice patterns, resulting in decreased national surgeon-level reoperation variability after 2014.26,29

Implications of Deimplementation

Three articles20,23,24 commented on improved patient-centered outcomes in the post–SSO/ASTRO guideline era, with decreased or rare conversion to mastectomy after lumpectomy and improved breast satisfaction scores. Morrow et al28 found an increase in the absolute rate of lumpectomy and decline in the rate of unilateral and bilateral mastectomies (from 34% to 18%), suggesting that decreasing unnecessary surgery after initial lumpectomy may reduce the number of women who opt for bilateral mastectomies to treat small, unilateral breast cancers. From a financial perspective, analyses estimate a 17% to 25% cost savings by reducing reoperations; a national 3% reduction in re-excision rates would save more than $116 million dollars annually.20,25

Avoiding Routinely Performing a Double Mastectomy in Patients Who Have a Single Breast With Cancer

This recommendation has been supported in various forms since the SSO position statement on CPM in 1993.65 The recent 2016 recommendation by American Society for Breast Surgeons is the most strongly worded version to date.66

Procedure Use Rates

All 27 studies3662 demonstrated rates of CPM rising each year. Eleven studies3646 evaluated trends at a single institution and noted wide variability in CPM use, and in all studies, the highest CPM rate was observed during the last year of the study period. From 2011 to 2014, the CPM rate ranged from 34% to 69% of all mastectomy cases and from 12% to 28% of all breast cancer procedures.38,39,42,43,45 Five articles4751 evaluated data from single-state cancer registries and demonstrated similar trends in CPM rates, with increases from approximately 2% of all breast cancer procedures in 1995 through 1998 to 10% to 12% in 2011 to 2014. Eleven articles5262 evaluated national trends in CPM. Nationally, CPM rates from 2010 to 2012 ranged from 10% to 13% of all breast cancer procedures and from 28% to 30% of all mastectomy cases, an increase from less than 2% of all cases in 1998.5262

Determinants of Deimplementation

Overall, studies were congruent in identifying factors associated with higher CPM rates across institutional, state, and national levels. Nearly every article3746,48,49,5155,5759,61 identified younger age as a factor associated with CPM. Additional patient factors associated with CPM included white race,37,39,4143,46,4855,57,59,61,62 increased socioeconomic status or private insurance,39,4852,54,55,57,62 marital status,38,45,46 and a family history of breast cancer.36,37,41,42,44,46

Patients with smaller, lower-grade tumors and decreased stage or node-negative disease were more likely to undergo CPM compared with those with unilateral mastectomy.38,40–42,48,52,57,59 Nine studies38,39,46,49,53,57,59,61,62 found increased CPM rates in patients with lobular histology, although 3 studies4244 did not find any association between histology and CPM receipt. Chemotherapy receipt was associated with increased CPM rates.38,48,51 The outcome of tumor hormone status3941,44,46,49,55,59 and multifocal or multicentric disease on CPM rates were inconsistent across studies, with some44,46 finding that these factors increased CPM rates while others38,41 found that they decreased or had no association with CPM rates.

For facility-level factors, women treated at teaching hospitals and hospitals with increased surgical volume and patients undergoing preoperative magnetic resonance imaging were more likely to undergo CPM.36,41,42,4446,51,54,55,60,62 Breast reconstruction was a also a factor significantly associated with CPM, and women who chose immediate breast reconstruction were more than twice as likely to undergo CPM than those who did not, regardless of any other patient-level or tumor-level factors.3639,4144,46,48,52,53

Avoiding Routine Use of SLNB in Women 70 Years or Older Who Have Clinically Node-Negative Hormone Receptor–Positive Invasive Breast Cancer

This recommendation was released in 2016 based on the Cancer and Leukemia Group B C9343 study.67 Initial results in 2003 and updated results in 2013 demonstrated no difference in overall survival in women who received axillary evaluation compared with those who did not.67

Procedure Use Rates

Six studies were included in this systematic review; 2 were single-institution studies30,31 and 4 evaluated national data.3235 All studies noted high rates of axillary surgery in elderly individuals, ranging from 80% to 88% in patients 70 years or older and 46% to 76% in women 80 years or older.3035 The only study that provides data on trends over time noted that the rate of lymph node evaluation in patients aged 70 years or older with clinically node negative, hormone receptor–positive breast cancer increased from 71% in 2004 to 81% in 2012.33

Determinants of Deimplementation

There are limited data on factors influencing SLNB use in elderly patients. One study34 found higher odds of receiving axillary surgery in patients who were younger (odds ratios [ORs]: ages 71–75 years, 6.04 [95% CI, 0.57–0.71]; 76–80 years, 0.33 [95% CI, 0.30–0.37]; >80 years, 0.08 [95% CI, 0.07–0.08]; 65–70 years, reference), had lower levels of comorbidity (ORs: patients who had a comorbidity score of 1, 0.84 [95% CI, 0.78–0.91]; patients with a score of 2, 0.61 [95% CI, 0.53–0.79]; patients with a score of 0, reference), had private insurance (ORs: patients who had Medicaid, 0.65 [95% CI, 0.72–0.93]; Medicare, 0.81 [95% CI, 0.74–0.90]; private insurance, reference), underwent mastectomy (ORs: patients who received mastectomy with no reconstruction, 3.33 [95% CI, 3.04–3.65]; mastectomy with reconstruction, 2.68 [95% CI, 2.07–3.46]; patients who underwent BCS, reference), and were treated at high-volume centers (OR: patients treated at low-volume centers, 0.82 [95% CI, 0.72–0.93]; patients treated at high-volume centers, reference). Several studies investigated the correlation between SLNB receipt and receipt of adjuvant therapy. Dominici et al34 noted that patients older than 65 years who received axillary surgery had approximately 2-folds odds of receiving chemotherapy (ORs: patients who received ALND, 2.07 [95% CI, 1.10–3.90]; SLNB, 2.29 [95% CI, 1.25–4.20]; no axillary surgery, reference) and/or radiation (ORs: patients who received ALND, 1.65 [95% CI, 1.33–2.06]; SLNB, 1.95 [95% CI, 1.61–2.37]; no axillary surgery, reference). Similarly, Chagpar et al32 found that in patients aged 70 to 90 years old, lymph node evaluation was an independent factor that correlated with receipt of chemotherapy (OR, 2.23 [95% CI, 2.06–2.50]) and radiation therapy (OR, 3.98 [95% CI, 3.83–4.14]), although it is unclear in these cases whether the decision to use SLNB is driving the subsequent use of adjuvant therapy or the desire to potentially use chemotherapy is driving the use of SLNB.

Discussion

This systematic review demonstrates that 4 Choosing Wisely breast cancer procedures have been variably deimplemented. Given that all 4 recommendations are based on high-quality evidence demonstrating a reduction in morbidity without adversely affecting survival, these data raise critical questions regarding why surgeons have stopped performing some procedures but not others and the determinants and implications of successful deimplementation.

Possible Reasons Surgeons Have Stopped Doing Some Procedures

This review confirms that ALND rates for patients eligible for Z0011 have substantially decreased. The Z0011 trial data appear to have been well disseminated among breast surgeons. In a 2011 survey of American Society for Breast Surgeons members, 97% of surgeons indicated familiarity with the trial and 57% stated they would infrequently or never perform ALND on a patient eligible for Z0011.68 Willingness to avoid ALND may be influenced by known risks of lymphedema, range of motion restriction, numbness, and chronic pain. Patients also likely play a role, because women are reluctant to undergo ALND unless they can be assured of substantial improvements in local cancer control and long-term survival.69 However, while ALND rates for eligible patients have been reduced, this review demonstrates that a subset of patients with higher-risk tumor features on the spectrum on Z0011 eligibility continue to undergo this procedure. The lack of complete deimplementation for eligible patients may reflect clinician concerns about the underrepresentation of high-risk patient groups in the Z0011 trial.

Similarly, this review indicates that there has been significant deimplementation of reoperation after lumpectomy, with current national re-excision rates less than 20%. This confirms findings from a meta-analysis that showed a decrease in reoperation rates from 22% to 14% after 2014 and has been validated by a time-trend model.70 The recommendation for establishing a negative margin under the standard of no tumor on ink also appears to be well disseminated among clinicians, with 1 survey71 demonstrating that 92% of surgeons were familiar with the recommendation and that more than 95% of clinicians would appropriately avoid re-excision according to these guidelines. This study did note discordance about whether patients with triple-negative tumors or extensive DCIS extending close to the margins should undergo re-excision, consistent with the findings of our review that DCIS at the margin was a factor significantly associated with re-excision. This suggests that surgeons remain uncertain about the applicability of the recommendation to these patients.

Possible Reasons Surgeons Have Not Stopped Doing Some Procedures

This review demonstrates that CPM rates in patients with unilateral breast cancer continue to rise despite substantial work dedicated to understanding the lack of deimplementation with a specific focus on patient decision-making. The consensus of this work is that increasing use of CPM is driven by patients, who are influenced by fear of recurrent breast cancer, peace of mind, desire for breast symmetry, and perceived improved survival.72 The strong influence of patient factors is reflected in this review, in that determinants such a sage, race, socio economic status, receipt of breast reconstruction, and family history largely explain variation in CPM use. Although patients with an extensive family history may potentially benefit from CPM, CPM has not been shown to improve outcomes in cases where a patient has a single relative who developed breast cancer.65 Despite the emphasis on patient preference, evidence does suggest a role for the clinician in influencing decision-making on CPM. A survey of more than 1500 women demonstrated that patients reporting a surge on recommendation against CPM had lower rates of CPM compared with patients who received no recommendation either for or against CPM.73 Overall, this supports the possibility that improved patient-clinician relationships and risk communication could reduce CPM.

Although the results of the Cancer and Leukemia Group B C9343 trial67were instrumental in informing there commendations to avoid SLNB and radiation therapy in older women with hormone receptor– positive cancer who undergo lumpectomy and adjuvant hormone therapy, neither has been substantially deimplemented.67,74 Few data exist on why clinicians continue to perform SLNB in older patients at high rates, but some evidence suggests that clinicians may disagree with the recommendation or use may be driven by uncertainty about whether the biopsy results would influence adjuvant chemotherapy decisions that could theoretically impact survival. A positive SLNB finding significantly correlates with receipt of adjuvant therapy, with lower overall survival for patients who do not receive a SLNB.32,33 However, there is no difference in breast cancer–specific survival, suggesting that clinicians are offering SLNB and adjuvant treatments to heal their patients.33 While these practices may reflect a desire on the part of the clinical team to offer aggressive curative intent therapies, there is little evidence that this reflects the preferences of these patients. For example, investigators at Johns Hopkins used a geriatric assessment tools to stratify patients into low-risk and high-risk groups to determine whether to recommend SLNB. More than 90% of patients with low functional status opted to forgo SLNB. Even among patients with good health status, more than 60% opted against SLNB.75 Similar trends were identified with radiation therapy, suggesting that elderly patients in shared decision-making models may actually prefer a less aggressive treatment strategy.

For all recommendations, the barriers and facilitators to deimplementation can be broadly categorized to patient-level, tumor-level, and facility-level factors. Common themes emerged, with increased use of procedures among patients of younger age, increased socioeconomic status, or private insurance and patients with perceived higher-risk tumor characteristics. While important, the outcome of hospital volume and surgeon-level variability was not consistent among guidelines; for example, larger-volume hospitals have lower rates of ALND and lumpectomy margin re-excision but higher rates of CPM and SLNB in older patients. These findings emphasize the need to address both patient and clinician motivations for the use of low-value procedures.

Limitations

There are several limitations to this systematic review. There were variations in the quality of the included studies, and all but 1 study60 were retrospective cohort studies; however, methodologic rigor was acceptable to support the conclusions noted in this review. Although the recommendation to avoid routine SLNB in women 70 years or older was based on older trial data, the guideline was released in 2016. As a result, there was limited information on trends in SLNB use or determinants of deimplementation. Additionally, the studies in this review did not systematically evaluate the determinants of deimplementation and broadly reported factors associated with procedure use. Thus, there could be other barriers or facilitators to deimplementation that are not captured here, such as the influence of multidisciplinary teams or potential lack of dissemination to clinicians of the recommendation to avoid SLNB.

Conclusions

In summary, this review demonstrates that 4 recommendations supported by the Choosing Wisely campaign have been variably effective in the deimplementation of low-value surgical care in patients with breast cancer. These findings provide some insight into why 2 recommendations have had greater success in deimplementation compared with the others. Further work should address specific clinician and patient concerns through shared decision-making to decrease the use of low-value care, medical costs, and patient morbidity.

Supplementary Material

Supplement

Key Points.

Question

Has low-value breast cancer surgery been successfully deimplemented?

Findings

Rates of axillary lymph node dissection in patients with limited nodal disease and re-excision of close but negative margins after lumpectomy have significantly decreased over time, reflecting changes in practice concordant with current evidence and recommendations; conversely, rates of contralateral prophylactic mastectomy in patients at average risk with unilateral cancer and sentinel lymph node biopsy in patients 70 years or older with hormone receptor–positive cancer remain elevated, despite recommendations against their routine use. This review identifies some of the patient-level, tumor-level, and facility-level factors that contribute to this differential deimplementation.

Meaning

Efforts toward the reduction of low-value breast cancer surgery have been variably influential; areas of incomplete deimplementation can provide insight into potential barriers at guideline, patient, clinician, and system levels contributing to the persistent use of some procedures.

Funding/Support:

Dr Dossett is supported by a grant from the Agency for Healthcare Research and Quality (5 K08 HS026030–02), and Dr Wang is supported by a grant from the National Cancer Institute (T32 CA009672).

Role of the Funder/Sponsor:

The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Footnotes

Conflict of Interest Disclosures: Dr Wang reported grants from National Institutes of Health during the conduct of the study. No other disclosures were reported.

REFERENCES

  • 1.Berwick DM, Hackbarth AD. Eliminating waste in US health care. JAMA. 2012;307(14):1513–1516. doi: 10.1001/jama.2012.362 [DOI] [PubMed] [Google Scholar]
  • 2.Katz SJ, Jagsi R, Morrow M. Reducing overtreatment of cancer with precision medicine: just what the doctor ordered. JAMA. 2018;319(11): 1091–1092. doi: 10.1001/jama.2018.0018 [DOI] [PubMed] [Google Scholar]
  • 3.Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA. 2012;307(17):1801–1802. doi: 10.1001/jama.2012.476 [DOI] [PubMed] [Google Scholar]
  • 4.Antunez AG, Telem DA, Dossett LA. Assessment of Surgical Specialty Societies’ Choosing Wisely Recommendations. JAMA Surg. Published online July 31, 2019. doi: 10.1001/jamasurg.2019.2309 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Landercasper J, Bailey L, Berry TS, et al. Measures of appropriateness and value for breast surgeons and their patients: the American Society of Breast Surgeons Choosing Wisely (®) initiative. Ann Surg Oncol. 2016;23(10):3112–3118. doi: 10.1245/s10434-016-5327-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Caudle AS, Hunt KK, Tucker SL, et al. American College of Surgeons Oncology Group (ACOSOG) Z0011: impact on surgeon practice patterns. Ann Surg Oncol. 2012;19(10):3144–3151. doi: 10.1245/s10434-012-2531-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Fillion MM, Glass KE, Hayek J, et al. Healthcare costs reduced after incorporating the results of the american college of surgeons oncology group Z0011 trial into clinical practice. Breast J. 2017;23(3):275–281. doi: 10.1111/tbj.12728 [DOI] [PubMed] [Google Scholar]
  • 8.Gabriel E, Attwood K, Young J, Cappuccino H, Kumar S. Impact of American College of Surgeons Oncology Group Z11 on surgical training at an academic cancer center. J Surg Res. 2016;201(2): 266–271. doi: 10.1016/j.jss.2015.11.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Jorns JM, Kidwell KM. Sentinel lymph node frozen-section utilization declines after publication of American College of Surgeons Oncology Group Z0011 trial results with no change in subsequent surgery for axillary lymph node dissection. Am J Clin Pathol. 2016;146(1):57–66. doi: 10.1093/ajcp/aqw078 [DOI] [PubMed] [Google Scholar]
  • 10.Le VH, Brant KN, Blackhurst DW, et al. The impact of the American College of Surgeons Oncology Group (ACOSOG) Z0011 trial: an institutional review. Breast. 2016;29:117–119. doi: 10.1016/j.breast.2016.07.014 [DOI] [PubMed] [Google Scholar]
  • 11.Robinson KA, Pockaj BA, Wasif N, Kaufman K, Gray RJ. Have the American College of Surgeons Oncology Group Z0011 trial results influenced the number of lymph nodes removed during sentinel lymph node dissection? Am J Surg. 2014;208(6): 1060–1064. doi: 10.1016/j.amjsurg.2014.08.009 [DOI] [PubMed] [Google Scholar]
  • 12.Subhedar P, Stempel M, Eaton A, Morrow M, Gemignani ML. Do the ACOSOG Z0011 criteria affect the number of sentinel lymph nodes removed? Ann Surg Oncol. 2015;22(suppl 3):S470–S475. doi: 10.1245/s10434-015-4698-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Weiss A, Mittendorf EA, DeSnyder SM, et al. Expanding implementation of ACOSOG Z0011 in surgeon practice. Clin Breast Cancer. 2018;18(4): 276–281. doi: 10.1016/j.clbc.2017.10.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Wright GP, Mater ME, Sobel HL, et al. Measuring the impact of the American College of Surgeons Oncology Group Z0011 trial on breast cancer surgery in a community health system. Am J Surg. 2015;209(2):240–245. doi: 10.1016/j.amjsurg.2014.07.001 [DOI] [PubMed] [Google Scholar]
  • 15.Howard DH, Soulos PR, Chagpar AB, Mougalian S, Killelea B, Gross CP. Contrary to conventional wisdom, physicians abandoned a breast cancer treatment after a trial concluded it was ineffective. Health Aff (Millwood). 2016;35(7): 1309–1315. doi: 10.1377/hlthaff.2015.1490 [DOI] [PubMed] [Google Scholar]
  • 16.Mann JM, Wu X, Christos P, Nagar H. The state of surgical axillary management and adjuvant radiotherapy for early-stage invasive breast cancer in the modern era. Clin Breast Cancer. 2018;18(4): e477–e493. doi: 10.1016/j.clbc.2017.09.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Nocera N, Pyfer B, De La Cruz L, Chatterjee A, Thiruchelvam P, Fisher C. NSQIP analysis of axillary lymph node dissection rates for breast cancer: implications for resident and fellow participation. Ann Surg Oncol. 2017;24(2):309–310. [DOI] [PubMed] [Google Scholar]
  • 18.Rosenberger LH, Thomas SM, Plichta JK, et al. Decreasing rates of axillary lymph node dissections over time: implications for surgical resident exposure and operative skills development. Am J Surg. 2019;218(4):786–791. doi: 10.1016/j.amjsurg.2019.07.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Yao K, Liederbach E, Pesce C, Wang CH, Winchester DJ. Impact of the American College of Surgeons Oncology Group Z0011 randomized trial on the number of axillary nodes removed for patients with early-stage breast cancer. J Am Coll Surg. 2015;221(1):71–81. doi: 10.1016/j.jamcollsurg.2015.02.035 [DOI] [PubMed] [Google Scholar]
  • 20.Bhutiani N, Mercer MK, Bachman KC, et al. Evaluating the effect of margin consensus guideline publication on operative patterns and financial impact of breast cancer operation. J Am Coll Surg. 2018;227(1):6–11. doi: 10.1016/j.jamcollsurg.2018.01.050 [DOI] [PubMed] [Google Scholar]
  • 21.Chung A, Gangi A, Amersi F, Bose S, Zhang X, Giuliano A. Impact of consensus guidelines by the Society of Surgical Oncology and the American Society for Radiation Oncology on margins for breast-conserving surgery in stages 1 and 2 invasive breast cancer. Ann Surg Oncol. 2015;22(suppl 3): S422–S427. doi: 10.1245/s10434-015-4829-0 [DOI] [PubMed] [Google Scholar]
  • 22.Heelan Gladden AA, Sams S, Gleisner A, et al. “Re-excision rates after breast conserving surgery following the 2014 SSO-ASTRO guidelines”. Am J Surg. 2017;214(6):1104–1109. doi: 10.1016/j.amjsurg.2017.08.023 [DOI] [PubMed] [Google Scholar]
  • 23.Patten CR, Walsh K, Sarantou T, et al. Changes in margin re-excision rates: experience incorporating the “no ink on tumor” guideline into practice. J Surg Oncol. 2017;116(8):1040–1045. doi: 10.1002/jso.24770 [DOI] [PubMed] [Google Scholar]
  • 24.Rosenberger LH, Mamtani A, Fuzesi S, et al. Early adoption of the SSO-ASTRO consensus guidelines on margins for breast-conserving surgery with whole-breast irradiation in stage i and ii invasive breast cancer: initial experience from Memorial Sloan Kettering Cancer Center. Ann Surg Oncol. 2016;23(10):3239–3246. doi: 10.1245/s10434-016-5397-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Van Den Bruele AB, Jasra B, Smotherman C, Crandall M, Samiian L. Cost-effectiveness of surgeon performed intraoperative specimen ink in breast conservation surgery. J Surg Res. 2018;231: 441–447. doi: 10.1016/j.jss.2018.06.045 [DOI] [PubMed] [Google Scholar]
  • 26.Kaczmarski K, Wang P, Gilmore R, et al. Surgeon re-excision rates after breast-conserving surgery: a measure of low-value care. J Am Coll Surg. 2019;228(4):504–512.e2. doi: 10.1016/j.jamcollsurg.2018.12.043 [DOI] [PubMed] [Google Scholar]
  • 27.Kantor O, Pesce C, Kopkash K, et al. Impact of the Society of Surgical Oncology-American Society for Radiation Oncology margin guidelines on breast-conserving surgery and mastectomy trends. J Am Coll Surg. 2019;229(1):104–114. doi: 10.1016/j.jamcollsurg.2019.02.051 [DOI] [PubMed] [Google Scholar]
  • 28.Morrow M, Abrahamse P, Hofer TP, et al. Trends in reoperation after initial lumpectomy for breast cancer: addressing overtreatment in surgical management. JAMA Oncol. 2017;3(10):1352–1357. doi: 10.1001/jamaoncol.2017.0774 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Schulman AM, Mirrielees JA, Leverson G, Landercasper J, Greenberg C, Wilke LG. Reexcision surgery for breast cancer: an analysis of the American Society of Breast Surgeons (ASBrS) MasterySM database following the SSO-ASTRO “no ink on tumor” guidelines. Ann Surg Oncol. 2017;24(1):52–58. doi: 10.1245/s10434-016-5516-5 [DOI] [PubMed] [Google Scholar]
  • 30.Ferrigni E, Bergom C, Yin Z, Szabo A, Kong AL. Breast cancer in women aged 80 years or older: an analysis of treatment patterns and disease outcomes. Clin Breast Cancer. 2019;19(3):157–164. doi: 10.1016/j.clbc.2019.01.007 [DOI] [PubMed] [Google Scholar]
  • 31.Mamtani A, Gonzalez JJ, Neo D, et al. Early-stage breast cancer in the octogenarian: tumor characteristics, treatment choices, and clinical outcomes. Ann Surg Oncol. 2016;23(10): 3371–3378. doi: 10.1245/s10434-016-5368-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Chagpar AB, Horowitz N, Sanft T, et al. Does lymph node status influence adjuvant therapy decision-making in women 70 years of age or older with clinically node negative hormone receptor positive breast cancer? Am J Surg. 2017;214(6): 1082–1088. doi: 10.1016/j.amjsurg.2017.07.036 [DOI] [PubMed] [Google Scholar]
  • 33.Chagpar AB, Hatzis C, Pusztai L, et al. Association of LN evaluation with survival in women aged 70 years or older with clinically node-negative hormone receptor positive breast cancer. Ann Surg Oncol. 2017;24(10):3073–3081. doi: 10.1245/s10434-017-5936-x [DOI] [PubMed] [Google Scholar]
  • 34.Dominici LS, Sineshaw HM, Jemal A, Lin CC, King TA, Freedman RA. Patterns of axillary evaluation in older patients with breast cancer and associations with adjuvant therapy receipt. Breast Cancer Res Treat. 2018;167(2):555–566. doi: 10.1007/s10549-017-4528-6 [DOI] [PubMed] [Google Scholar]
  • 35.Kantor O, Pesce C, Liederbach E, Wang CH, Winchester DJ, Yao K. Surgery and hormone therapy trends in octogenarians with invasive breast cancer. Am J Surg. 2016;211(3):541–545. doi: 10.1016/j.amjsurg.2015.11.005 [DOI] [PubMed] [Google Scholar]
  • 36.Chung A, Huynh K, Lawrence C, Sim MS, Giuliano A. Comparison of patient characteristics and outcomes of contralateral prophylactic mastectomy and unilateral total mastectomy in breast cancer patients. Ann Surg Oncol. 2012;19(8): 2600–2606. doi: 10.1245/s10434-012-2299-1 [DOI] [PubMed] [Google Scholar]
  • 37.Damle S, Teal CB, Lenert JJ, Marshall EC, Pan Q, McSwain AP. Mastectomy and contralateral prophylactic mastectomy rates: an institutional review. Ann Surg Oncol. 2011;18(5):1356–1363. doi: 10.1245/s10434-010-1434-0 [DOI] [PubMed] [Google Scholar]
  • 38.Hoskin TL, Hieken TJ, Degnim AC, Jakub JW, Jacobson SR, Boughey JC. Use of immediate breast reconstruction and choice for contralateral prophylactic mastectomy. Surgery. 2016;159(4): 1199–1209. doi: 10.1016/j.surg.2015.11.001 [DOI] [PubMed] [Google Scholar]
  • 39.Jerome-D’Emilia B, Kushary D, Suplee PD. Rising rates of contralateral prophylactic mastectomy as a treatment for early-stage breast cancer. Cancer Nurs. 2019;42(1):12–19. [DOI] [PubMed] [Google Scholar]
  • 40.Jones NB, Wilson J, Kotur L, Stephens J, Farrar WB, Agnese DM. Contralateral prophylactic mastectomy for unilateral breast cancer: an increasing trend at a single institution. Ann Surg Oncol. 2009;16(10):2691–2696. doi: 10.1245/s10434-009-0547-9 [DOI] [PubMed] [Google Scholar]
  • 41.King TA, Sakr R, Patil S, et al. Clinical management factors contribute to the decision for contralateral prophylactic mastectomy. J Clin Oncol. 2011;29(16):2158–2164. doi: 10.1200/JCO.2010.29.4041 [DOI] [PubMed] [Google Scholar]
  • 42.Pinell-White XA, Kolegraff K, Carlson GW. Predictors of contralateral prophylactic mastectomy and the impact on breast reconstruction. Ann Plast Surg. 2014;72(6):S153–S157. doi: 10.1097/SAP.0000000000000099 [DOI] [PubMed] [Google Scholar]
  • 43.Sabel MS, Kraft CT, Griffith KA, et al. Differences between breast conservation-eligible patients and unilateral mastectomy patients in choosing contralateral prophylactic mastectomies. Breast J. 2016;22(6):607–615. doi: 10.1111/tbj.12648 [DOI] [PubMed] [Google Scholar]
  • 44.Stucky CC, Gray RJ, Wasif N, Dueck AC, Pockaj BA. Increase in contralateral prophylactic mastectomy: echoes of a bygone era? surgical trends for unilateral breast cancer. Ann Surg Oncol. 2010;17(suppl 3):330–337. doi: 10.1245/s10434-010-1259-x [DOI] [PubMed] [Google Scholar]
  • 45.Suggs PD, Holliday TL, Thompson SN, Richmond BK. Factors affecting choice of treatment for early-stage breast cancer in West Virginia: a 10-year experience from a rural tertiary care center. Am Surg. 2017;83(7):709–716. [PubMed] [Google Scholar]
  • 46.Yi M, Hunt KK, Arun BK, et al. Factors affecting the decision of breast cancer patients to undergo contralateral prophylactic mastectomy. Cancer Prev Res (Phila). 2010;3(8):1026–1034. doi: 10.1158/1940-6207.CAPR-09-0130 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Clerville J, Bolick S, Clugstone S. Trends in contralateral prophylactic mastectomy and other types of breast cancer surgery, South Carolina, 2005–2013. J Registry Manag. 2018;45(1):28–32. [PubMed] [Google Scholar]
  • 48.Jerome-D’Emilia B, Trinh H. Socioeconomic factors associated with the receipt of contralateral prophylactic mastectomy in women with breast cancer. J Womens Health (Larchmt). 2019;13:13. [DOI] [PubMed] [Google Scholar]
  • 49.Kurian AW, Lichtensztajn DY, Keegan TH, Nelson DO, Clarke CA, Gomez SL. Use of and mortality after bilateral mastectomy compared with other surgical treatments for breast cancer in California, 1998–2011. JAMA. 2014;312(9):902–914. doi: 10.1001/jama.2014.10707 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.McLaughlin CC, Lillquist PP, Edge SB. Surveillance of prophylactic mastectomy: trends in use from 1995 through 2005. Cancer. 2009;115(23):5404–5412. doi: 10.1002/cncr.24623 [DOI] [PubMed] [Google Scholar]
  • 51.Yakoub D, Avisar E, Koru-Sengul T, et al. Factors associated with contralateral preventive mastectomy. Breast Cancer (Dove Med Press). 2015; 7:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Agarwal S, Kidwell KM, Kraft CT, et al. Defining the relationship between patient decisions to undergo breast reconstruction and contralateral prophylactic mastectomy. Plast Reconstr Surg. 2015;135(3):661–670. doi: 10.1097/PRS.0000000000001044 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Albornoz CR, Matros E, Lee CN, et al. Bilateral mastectomy versus breast-conserving surgery for early-stage breast cancer: the role of breast reconstruction. Plast Reconstr Surg. 2015;135(6): 1518–1526. doi: 10.1097/PRS.0000000000001276 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Cemal Y, Albornoz CR, Disa JJ, et al. A paradigm shift in U.S. breast reconstruction: part 2, the influence of changing mastectomy patterns on reconstructive rate and method. Plast Reconstr Surg. 2013;131(3):320e–326e. doi: 10.1097/PRS.0b013e31827cf576 [DOI] [PubMed] [Google Scholar]
  • 55.Grimmer L, Liederbach E, Velasco J, Pesce C, Wang CH, Yao K. Variation in contralateral prophylactic mastectomy rates according to racial groups in young women with breast cancer, 1998 to 2011: a report from the National Cancer Data Base. J Am Coll Surg. 2015;221(1):187–196. doi: 10.1016/j.jamcollsurg.2015.03.033 [DOI] [PubMed] [Google Scholar]
  • 56.Kummerow KL, Du L, Penson DF, Shyr Y, Hooks MA. Nationwide trends in mastectomy for early-stage breast cancer. JAMA Surg. 2015;150(1): 9–16. doi: 10.1001/jamasurg.2014.2895 [DOI] [PubMed] [Google Scholar]
  • 57.Nash R, Goodman M, Lin CC, et al. State variation in the receipt of a contralateral prophylactic mastectomy among women who received a diagnosis of invasive unilateral early-stage breast cancer in the United States, 2004–2012. JAMA Surg. 2017;152(7):648–657. doi: 10.1001/jamasurg.2017.0115 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Pesce CE, Liederbach E, Czechura T, Winchester DJ, Yao K. Changing surgical trends in young patients with early stage breast cancer, 2003 to 2010: a report from the National Cancer Data Base. J Am Coll Surg. 2014;219(1):19–28. doi: 10.1016/j.jamcollsurg.2014.03.043 [DOI] [PubMed] [Google Scholar]
  • 59.Tuttle TM, Habermann EB, Grund EH, Morris TJ, Virnig BA. Increasing use of contralateral prophylactic mastectomy for breast cancer patients: a trend toward more aggressive surgical treatment. J Clin Oncol. 2007;25(33):5203–5209. doi: 10.1200/JCO.2007.12.3141 [DOI] [PubMed] [Google Scholar]
  • 60.Vaz-Luis I, Hughes ME, Cronin A, et al. Trends in the use of mastectomy in women with small node-negative breast cancer treated at US academic centers. Breast Cancer Res Treat. 2016; 155(3):569–578. doi: 10.1007/s10549-016-3707-1 [DOI] [PubMed] [Google Scholar]
  • 61.Wong SM, Freedman RA, Sagara Y, Aydogan F, Barry WT, Golshan M. Growing use of contralateral prophylactic mastectomy despite no improvement in long-term survival for invasive breast cancer. Ann Surg. 2017;265(3):581–589. doi: 10.1097/SLA.0000000000001698 [DOI] [PubMed] [Google Scholar]
  • 62.Yao K, Stewart AK, Winchester DJ, Winchester DP. Trends in contralateral prophylactic mastectomy for unilateral cancer: a report from the National Cancer Data Base, 1998–2007. Ann Surg Oncol. 2010;17(10):2554–2562. doi: 10.1245/s10434-010-1091-3 [DOI] [PubMed] [Google Scholar]
  • 63.Giuliano AE, Hunt KK, Ballman KV, et al. Axillary dissection vs no axillary dissection in women with invasive breast cancer and sentinel node metastasis: a randomized clinical trial. JAMA. 2011; 305(6):569–575. doi: 10.1001/jama.2011.90 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Moran MS, Schnitt SJ, Giuliano AE, et al. Society of Surgical Oncology-American Society for Radiation Oncology consensus guideline on margins for breast-conserving surgery with whole-breast irradiation in stages I and II invasive breast cancer. Ann Surg Oncol. 2014;21(3):704–716. doi: 10.1245/s10434-014-3481-4 [DOI] [PubMed] [Google Scholar]
  • 65.Boughey JC, Attai DJ, Chen SL, et al. Contralateral prophylactic mastectomy (CPM) consensus statement from the American Society of Breast Surgeons: data on CPM outcomes and risks. Ann Surg Oncol. 2016;23(10):3100–3105. doi: 10.1245/s10434-016-5443-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Giuliano AE, Boolbol S, Degnim A, Kuerer H, Leitch AM, Morrow M. Society of Surgical Oncology: position statement on prophylactic mastectomy, approved by the Society of Surgical Oncology Executive Council, March 2007. Ann Surg Oncol. 2007;14(9):2425–2427. doi: 10.1245/s10434-007-9447-z [DOI] [PubMed] [Google Scholar]
  • 67.Hughes KS, Schnaper LA, Bellon JR, et al. Lumpectomy plus tamoxifen with or without irradiation in women age 70 years or older with early breast cancer: long-term follow-up of CALGB 9343. J Clin Oncol. 2013;31(19):2382–2387. doi: 10.1200/JCO.2012.45.2615 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Gainer SM, Hunt KK, Beitsch P, Caudle AS, Mittendorf EA, Lucci A. Changing behavior in clinical practice in response to the ACOSOG Z0011 trial: a survey of the American Society of Breast Surgeons. Ann Surg Oncol. 2012;19(10):3152–3158. doi: 10.1245/s10434-012-2523-z [DOI] [PubMed] [Google Scholar]
  • 69.Galper SR, Lee SJ, Tao ML, et al. Patient preferences for axillary dissection in the management of early-stage breast cancer. J Natl Cancer Inst. 2000;92(20):1681–1687. doi: 10.1093/jnci/92.20.1681 [DOI] [PubMed] [Google Scholar]
  • 70.Havel L, Naik H, Ramirez L, Morrow M, Landercasper J. Impact of the SSO-ASTRO margin guideline on rates of re-excision after lumpectomy for breast cancer: a meta-analysis. Ann Surg Oncol. 2019;26(5):1238–1244. doi: 10.1245/s10434-019-07247-5 [DOI] [PubMed] [Google Scholar]
  • 71.DeSnyder SM, Hunt KK, Smith BD, Moran MS, Klimberg S, Lucci A. Assessment of practice patterns following publication of the SSO-ASTRO consensus guideline on margins for breast-conserving therapy in stage i and ii invasive breast cancer. Ann Surg Oncol. 2015;22(10):3250–3256. doi: 10.1245/s10434-015-4666-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Ager B, Butow P, Jansen J, Phillips KA, Porter D, Group CDA; CPM DA Advisory Group. Contralateral prophylactic mastectomy (CPM): a systematic review of patient reported factors and psychological predictors influencing choice and satisfaction. Breast. 2016;28:107–120. doi: 10.1016/j.breast.2016.04.005 [DOI] [PubMed] [Google Scholar]
  • 73.Jagsi R, Hawley ST, Griffith KA, et al. Contralateral prophylactic mastectomy decisions in a population-based sample of patients with early-stage breast cancer. JAMA Surg. 2017;152(3): 274–282. doi: 10.1001/jamasurg.2016.4749 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Shumway DA, Griffith KA, Sabel MS, et al. Surgeon and radiation oncologist views on omission of adjuvant radiotherapy for older women with early-stage breast cancer. Ann Surg Oncol. 2017;24(12):3518–3526. doi: 10.1245/s10434-017-6013-1 [DOI] [PubMed] [Google Scholar]
  • 75.Wright JL, Parekh A, Pollock YY, et al. Use of Geriatric assessment tools in selecting therapies in women aged ≥70 years with hormone receptor-positive early-stage breast cancer: preliminary experience with a quality improvement initiative. Int J Radiat Oncol Biol Phys. 2017;98(4): 884–890. doi: 10.1016/j.ijrobp.2017.01.210 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement

RESOURCES