Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Dec 21;17(12):e0279227. doi: 10.1371/journal.pone.0279227

Impact of early detection on cancer curability: A modified Delphi panel study

Lee Schwartzberg 1,, Michael S Broder 2,#, Sikander Ailawadhi 3,, Himisha Beltran 4,, L Johnetta Blakely 5,, G Thomas Budd 6,, Laurie Carr 7,, Michael Cecchini 8,, Patrick Cobb 9,, Anuraag Kansal 10,#, Ashley Kim 10,*,#, Bradley J Monk 11,, Deborah J Wong 12,, Cynthia Campos 2,#, Irina Yermilov 2,#
Editor: Kush Raj Lohani13
PMCID: PMC9770338  PMID: 36542647

Abstract

Expert consensus on the potential benefits of early cancer detection does not exist for most cancer types. We convened 10 practicing oncologists using a RAND/UCLA modified Delphi panel to evaluate which of 20 solid tumors, representing >40 American Joint Committee on Cancer (AJCC)-identified cancer types and 80% of total cancer incidence, would receive potential clinical benefits from early detection. Pre-meeting, experts estimated how long cancers take to progress and rated the current curability and benefit (improvement in curability) of an annual hypothetical multi-cancer screening blood test. Post-meeting, experts rerated all questions. Cancers had varying estimates of the potential benefit of early cancer detection depending on estimates of their curability and progression by stage. Cancers rated as progressing quickly and being curable in earlier stages (stomach, esophagus, lung, urothelial tract, melanoma, ovary, sarcoma, bladder, cervix, breast, colon/rectum, kidney, uterus, anus, head and neck) were estimated to be most likely to benefit from a hypothetical screening blood test. Cancer types rated as progressing quickly but having comparatively lower cure rates in earlier stages (liver/intrahepatic bile duct, gallbladder, pancreas) were estimated to have medium likelihood of benefit from a hypothetical screening blood test. Cancer types rated as progressing more slowly and having higher curability regardless of stage (prostate, thyroid) were estimated to have limited likelihood of benefit from a hypothetical screening blood test. The panel concluded most solid tumors have a likelihood of benefit from early detection. Even among difficult-to-treat cancers (e.g., pancreas, liver/intrahepatic bile duct, gallbladder), early-stage detection was believed to be beneficial. Based on the panel consensus, broad coverage of cancers by screening blood tests would deliver the greatest potential benefits to patients.

Introduction

In 2022, an estimated 1.9 million people will be diagnosed with cancer in the United States (US) [1]. Cancer is the second leading cause of death in the US, resulting in more than 600,000 deaths in 2020 [2].

Early detection of cancer is an accepted critical component of prevention and reducing cancer-related mortality. The main goal of screening is to identify cancers, or cancer precursors, early to reduce mortality. Existing cancer screening tests include imaging (e.g., digital mammography), serial exams (e.g., colonoscopy), and tissue sampling (e.g., Pap test), with serum markers (e.g., prostate-specific antigen [PSA] test) measured on an individual basis. Newer approaches to early cancer detection include blood-based screening tests, including multi-cancer tests, which may potentially be used to screen for multiple cancer types simultaneously [3].

Cancer screening reduces cancer mortality by detecting disease at an earlier stage when interventions may be more successful. For example, a US Preventive Services Task Force (USPSTF) meta-analysis showed a 15% to 20% reduction in breast cancer mortality with mammography screening and a 20% to 60% reduction in cervical cancer mortality with cytology-based screening [46]. In addition, the International Agency for Research on Cancer (IARC) reported a 22% to 31% reduction in colorectal cancer mortality associated with sigmoidoscopy screening [7]. Using Surveillance, Epidemiology and End Results (SEER) data, Clarke et al. estimated that detecting all cancer at stage III rather than stage IV would reduce cancer deaths by 15%, with larger gains if those cancers could be detected in even earlier stages [8].

Not all screening tests will decrease mortality, however. According to SEER data on thyroid cancer, kidney cancer, and melanoma, there has been an increase in rates of new diagnoses but not deaths. This suggests that these new diagnoses may include cancers that are less likely to be fatal and that screening for these cancers may result in overdiagnosis [9, 10], or an increase in detection of cancer incidence without a comparable reduction in late-stage disease or mortality [11]. In addition, screening may result in an early cancer diagnosis, generating a lead time bias in outcomes and artificially inflating the length of time a patient is considered to have cancer [12].

The benefits of early detection may vary across cancers. Screening programs have been particularly effective in colon [7] and cervical [13] cancers where precursor lesions are identified and removed; however, many types of cancer exhibit a range of heterogeneous behaviors and variable likelihoods of progression and death [11]. For other cancers, it is difficult to identify the at-risk population. In anal cancer, 91% of cases occur in patients with no perceived risk of invasive anal cancer, suggesting most anal cancers would be missed if only high-risk individuals were screened [14].

Given these complexities, we elicited expert input from practicing oncologists to understand which cancer types may benefit most from early diagnosis and what drove differences between cancer types.

Methods

We used the RAND/University of California, Los Angeles (UCLA) modified Delphi panel method, which is fully described elsewhere [1517]. This method is a formal group consensus process which systematically and quantitatively combines expert opinion and systematic literature review evidence by asking panelists to rate, discuss, and then rerate various patient scenarios. Our panel included 10 experts, which falls within the recommended panel size of 7–15 which permits sufficient diversity and ensures a chance to participate, as per the RAND/UCLA Appropriateness Method guidelines [17]. The criteria to recruit oncology experts included having a breadth and diversity of oncology experience and representing different geographic regions and practice settings in the US. Panelists had an average of 20 years in clinical practice from a variety of practice settings (six academic, three community, and one combined academic and community) and US regions (three from the South, four from the West, two from the Northeast, and one from the Midwest). Panelists included a general practice oncologist and a diversity of oncology subspecialties, with expertise covering the range of cancer types considered. The number of experts with experience for specific cancer types were as follows: hematologic (2), prostate (1), breast (3), lung (2), colorectal (2), gastrointestinal (1), head and neck (1), liver (1), gynecological (1), and sarcoma (2). Expert panelists gave written informed consent for research participation and received honoraria from the study sponsor for their participation. Modified Delphi panels do not involve human subjects as defined by 45 Code of Federal Regulations part 46 and therefore do not require Institutional Review Board approval.

Prior to the meeting, we collaboratively developed a detailed, 540-item written questionnaire, or rating form, through individual phone interviews. We designed the rating form to obtain expert input regarding which cancers may benefit most from early detection (e.g., using a hypothetical multi-cancer screening blood test) and whether there are cancers for which the treatment outcomes would not change, if detected early.

The panel assessed whether a given cancer was considered “curable” at each stage, and how quickly it progresses from the beginning of one stage to the beginning of the next. In addition, we asked panelists to consider the risk of overdiagnosis. We defined “cure” as the receipt of effective treatment such that a population of individuals who are “cured” have the same life expectancy as a population that never had the cancer being considered. Curability was rated on a scale of 1 (extremely unlikely to be cured) to 9 (extremely likely to be cured). Cancer progression was rated on a scale of 1 (less than a year) to 9 (nine or more years). For both questions, experts referred to 10-year survival data from SEER as a proxy for cure and progression. As such, the questions on the rating form were designed and ordered specifically around this fundamental question of curability and developed in an iterative process in conjunction with the panelists to appropriately discuss the benefits and harms of diagnosing cancer at earlier stages. Scores were collected for all cancer types from all experts.

Experts were asked to estimate the benefit of an annual hypothetical screening blood test that is 100% sensitive and 100% specific for patients aged 50 years and older. They were told to assume that the blood test could not detect premalignant tumors and was not meant to replace any existing cancer screening tests. This hypothetical scenario was chosen to focus on the potential benefits of early detection in each cancer type, rather than to assess the impact of any specific screening technology or program. The benefit was defined as the likelihood that cure rates would increase on a scale of 1 (not at all likely to increase) to 9 (likely to increase a great deal).

Experts were also asked to consider both typical treatment (i.e., the care provided to the population as a whole) and best available care (i.e., care consistent with the National Comprehensive Cancer Network [NCCN] guidelines). Although the goal of treatment is to provide the best available treatment to all patients, there is evidence this does not always occur [1820].

Experts considered curability across stages I to IV of 20 solid organ cancers, representing >40 American Joint Committee on Cancer (AJCC)-identified cancer types and 80% of total cancer incidence. Cancer subtypes were not considered. They completed ratings before a panel meeting in December 2020 (S1 Table). During the meeting, experts were provided with their first-round individual ratings and the panel’s median ratings for all questions. As is standard in the RAND/UCLA modified Delphi panel method, we defined panel disagreement as at least 2 ratings of 1 to 3 and at least 2 ratings of 7 to 9 [17]. During the professionally moderated group discussion, panelists shared reasons for their ratings, focusing on areas of disagreement. After the meeting, panelists rerated all questions (S2 Table). Statements describing the group consensus that emerged from the second-round ratings were developed and circulated to all experts for review and approval.

Results

After a group discussion, panelists disagreed on 1% of the 540 ratings, compared to 13% disagreement after the first-round ratings.

Cancer curability and progression

The ratings of curability are provided in Table 1. Experts rated 85% (n = 17) of cancers as somewhat likely to extremely likely to be cured in stage I, 60% (n = 12) in stage II, 5% (n = 1) in stage III, 0% in stage IV. More stage I cancers were rated as being somewhat likely to extremely likely to be cured than later-stage cancers.

Table 1. Median (range) rating scores of the likelihood of cancer curability today.

Cancer type Stage I Stage II Stage III Stage IV
Thyroid 9 (8–9) 8 (7–9) 7 (6–9) 5 (1–7)
Colon/rectum 9 (8–9) 8 (7–8) 5 (3–6) 1.5 (1–3)
Kidney 9 (7–9) 8 (6–8) 5 (4–6) 2 (1–2)
Uterus 9 (8–9) 8 (7–8) 5 (5–7) 1 (1–3)
Anus 9 (8–9) 8 (6–8) 5 (5–7) 1 (1–3)
Head and neck 9 (7–9) 7.5 (6–8) 5 (3–6) 3 (1–5)
Breast 9 (7–9) 7.5 (6–8) 5.5 (4–6) 1 (1–2)
Cervix 9 (8–9) 7 (6–8) 5 (4–6) 1 (1–3)
Melanoma 9 (8–9) 7 (6–8) 4 (3–6) 1.5 (1–8)
Prostate 8.5 (7–9) 8 (7–9) 5.5 (4–8) 1 (1–5)
Sarcoma 8 (6–8) 7 (4–7) 4 (2–5) 1 (1–2)
Ovary 8 (7–9) 7 (5–8) 3 (2–5) 1 (1–3)
Bladder 8.5 (7–9) 6.5 (6–8) 4 (3–5) 1 (1–2)
Urothelial tract 8 (6–9) 5.5 (5–7) 4 (3–5) 1.5 (1–3)
Lung 7 (6–9) 5 (3–8) 3 (1–5) 1 (1–2)
Stomach 7 (6–8) 4.5 (2–7) 2 (1–5) 1 (1–1)
Esophagus 7 (5–8) 4 (3–7) 2 (1–5) 1 (1–1)
Gallbladder 5 (4–6) 3 (2–5) 2 (1–3) 1 (1–1)
Liver/intrahepatic bile duct 4 (2–7) 3 (2–7) 1.5 (1–5) 1 (1–1)
Pancreas 4 (3–7) 2.5 (1–5) 1 (1–3) 1 (1–1)

Experts were asked to rate how likely they believed a cancer could be “cured” today in each stage, defined as the receipt of effective treatment such that a population of individuals who are “cured” would have the same life expectancy as a population that never had the cancer being considered. Curability was rated on a scale of 1 to 9: extremely unlikely = 1; somewhat unlikely = 3; neutral, neither likely nor unlikely = 5; somewhat likely = 7; extremely likely = 9.

Expert estimates of preclinical cancer progression are provided in Table 2. Prostate and thyroid cancer were estimated to be the slowest growing, taking approximately 7 and 5 years, respectively, to progress through stage I (range, 4–8), 5 years to progress through stage II (range, 3–7), and 3 and 4 (range, 2–5) years, respectively, to progress through stage III. Esophageal, lung, liver/intrahepatic bile duct, gallbladder, and pancreatic cancers were estimated to progress quickly through stages I to III (1 to 2 years per stage). The estimated likelihood of cancer curability today in earlier stages and likelihood of progression to the next stage are depicted in S1 Fig.

Table 2. Estimated median (range) number of years for each cancer type to progress from one stage to the next.

Cancer type Stage I Stage II Stage III
Prostate 7 (5–8) 5 (4–6) 3 (2–5)
Thyroid 5.5 (4–8) 5 (3–7) 4 (2–5)
Kidney 5 (<1–7) 3 (<1–5) 2 (<1–2)
Uterus 4 (3–5) 3 (<1–5) 1.5 (<1–3)
Cervix 4 (<1–5) 2.5 (<1–4) <1 (<1–2)
Colon/rectum 3.5 (2–5) 3 (2–5) <1 (<1–2)
Sarcoma 3.5 (<1–6) 2 (<1–4) <1 (<1–2)
Breast 3 (2–4) 2 (<1–3) 1.5 (<1–2)
Melanoma 3 (<1–5) 2 (<1–4) <1 (<1–2)
Head and neck 3 (2–6) 2 (<1–4) <1 (<1–2)
Bladder 3 (2–5) 2 (<1–5) <1 (<1–2)
Ovary 3 (<1–3) 2 (<1–2) <1 (<1-<1)
Stomach 3 (2–5) 2 (<1–2) <1 (<1–2)
Urothelial tract 3 (2–7) 2 (2–5) <1 (<1–4)
Anus 3 (2–7) 2 (2–5) <1 (<1–3)
Esophagus 2.5 (2–5) <1 (<1–2) <1 (<1–2)
Lung 2 (2–3) <1 (<1–2) <1 (<1-<1)
Liver/intrahepatic bile duct 2 (<1–3) <1 (<1–2) <1 (<1-<1)
Gallbladder 2 (<1–3) <1 (<1-<1) <1 (<1-<1)
Pancreas <1 (<1–2) <1 (<1–2) <1 (<1-<1)

Experts were asked to rate how long cancers would take to progress from the beginning of one stage to the beginning of the next. Progression was rated on a scale of 1 (less than a year) to 9 (9 or more years).

Benefit from early detection

When experts considered whether cancers would benefit from early detection by a hypothetical screening test that could detect cancers at all stages, 3 groups of cancers emerged (illustrated in the different colors in Fig 1). Experts estimated those cancers that progress quickly and are considered currently curable would benefit the most from early detection. These cancer types (75.0% of all cancers rated) included stomach, esophagus, lung, urothelial tract, melanoma, ovary, sarcoma, bladder, cervix, breast, colon/rectum, kidney, uterus, anus, and head and neck. Cancer types that progress but were considered to be less curable (liver/intrahepatic bile duct, gallbladder, pancreas) were rated as potentially showing some benefit. Finally, experts did not expect cancers that progress slowly and are curable (prostate, thyroid) to benefit from early detection.

Fig 1. Ratings of cancer curability today and the estimated benefit from a hypothetical screening blood test.

Fig 1

The x-axis represents expert ratings on how likely they believe a cancer could be “cured” today, defined as the receipt of effective treatment such that a population of individuals who are “cured” would have the same life expectancy as a population that never had the cancer being considered. Curability was rated on a scale of 1 (extremely unlikely to be cured) to 9 (extremely likely to be cured). The y-axis represents expert ratings on the estimated benefit from a hypothetical screening test, defined as the improvement in curability as a result of the test. Improvement in cure was rated on a scale of 1 (not at all likely to increase) to 9 (increase a great deal). Cancers in blue are those experts believed could potentially benefit the most from a hypothetical screening test (those with high curability today in earlier stages and likely to progress). Experts believed cancers in purple may show some benefit from a hypothetical screening test (lower curability today in earlier stages and likely to progress). Cancers in orange were rated as least likely to benefit from a hypothetical screening test (high curability in earlier stages today and progress slowly).

Typical treatment versus best available care

Panelists generally rated a higher benefit from early detection if best-available versus typical care was provided (Fig 2, see liver/intrahepatic bile duct, gallbladder, and pancreatic cancers). The difference in potential benefit of early detection between typical versus best-available care was generally higher in stages II and III.

Fig 2. Estimated benefit from a hypothetical screening blood test with typical versus best-available treatment.

Fig 2

This figure illustrates expert ratings on the estimated benefit from a hypothetical screening test, defined as the improvement in curability as a result of the test on a scale of 1 (not at all likely to increase) to 9 (increase a great deal), when considering typical versus best available treatment. Typical treatment was defined as the care provided to the population as a whole; best available treatment was defined as guideline-concordant care. Items in grey represent no difference in ratings for typical versus best available treatment. Items in blue represent a difference in ratings for typical versus best available treatment, with the dark blue representing typical treatment and light blue representing best available treatment.

Discussion

The panel concluded that most solid tumors would have better treatment outcomes if detected early. Only prostate and thyroid cancer, both of which have good long-term survival when diagnosed early, were not expected to benefit from earlier detection by a hypothetical blood-based screening test.

Panelists agreed that the cancers most likely to benefit from early detection were those that progress quickly and are currently curable in earlier stages: anus, bladder, breast, cervix, colon/rectum, esophagus, head and neck, kidney, lung, melanoma, ovary, sarcoma, stomach, urothelial tract, and uterus. Many of these cancers do not have established screening tests, and curability varies by stage at diagnosis. For example, in Fig 1, stage I ovarian cancer was rated as having a high likelihood of curability, whereas in stage III, the likelihood of curability was very low. A similar pattern can be seen in the curability ratings for sarcoma and bladder cancer, both of which do not have established screening tests. The ability to screen for multiple cancers at once, particularly for cancers without existing screening tests, could identify cancer in patients before it is clinically evident. Expert opinion therefore concurs with the intuition that detection at an earlier stage of cancer could improve patient outcomes by diagnosing cancer when it is potentially more treatable.

Experts agreed that pancreatic, gallbladder, and liver/intrahepatic bile duct cancer would benefit from a hypothetical screening blood test, though to a lesser degree than the cancers listed above. These cancers do not have established screening tests and currently have unfavorable survival statistics. Based on SEER18 registry data, the median 10-year survival for stage II pancreatic, gallbladder, and liver/intrahepatic bile duct cancer is 10%,19%, and 30%, respectively. If diagnosed in stage I, the 10-year survival is higher (pancreatic cancer: 31%; gallbladder: 47%; liver/intrahepatic bile duct: 32%), likely due to more effective treatments [2123]. Currently, the majority of patients with these cancers are diagnosed at later stages, which may be limiting the opportunities to develop more effective early-stage treatments. By reducing the prevalence of tumors diagnosed at later stages, potential research gains along with significant improvements in survival could be made.

Prostate and thyroid cancer were not considered good candidates for a hypothetical screening blood test. These cancers have good long-term survival, especially in stages I and II, and even in stage III, though to a lesser extent. These findings align with current practice. The USPSTF recommends against screening the general asymptomatic adult population for thyroid cancer as the harms of screening were considered to outweigh any potential benefits [24]. While the incidence of thyroid cancer steadily increased, mortality rates have remained stable since 1975, suggesting screening may be primarily identifying cancers that would not result in death [25]. The USPSTF also recommends against screening for prostate cancer in men older than 70 years and in those aged 55 to 69 years who do not express a preference for screening [26]. While PSA screening has been shown to reduce metastatic prostate cancer and disease-related death, there are downsides to screening including false-positive tests leading to unnecessary biopsies, overdetection of insignificant cancers, and treatment-related complications [27, 28]. Several organizations (i.e., American Cancer Society, American Urological Association, American College of Physicians) have recommended shared decision making about PSA screening. Risk-adapted individualized approaches including using PSA in conjunction with risk factors (e.g., genetics, race, family history), as well as incorporation of advanced magnetic resonance imaging (MRI) may improve the detection of significant prostate cancer and avoid the overdiagnosis of clinically insignificant disease [29].

Detecting cancers at earlier stages can be crucial to increasing survival rates because it increases the likelihood of treating cancer when more treatment options are available. There have been significant improvements in available treatment for early-stage breast, cervical, and lung cancer over the last few decades, translating screening for these cancers into decreased mortality [3032]. Experts expected treatment innovations would continue, especially in liver/intrahepatic bile duct, gallbladder, and pancreatic cancers, which they anticipated could lead to improved outcomes if cancers were identified through screening. In addition, experts estimated the time to progression from one stage to the next to be faster with each subsequent stage (e.g., 3 years from stage I to stage II, 1 year from stage II to stage III), suggesting there could be more opportunity to detect and intervene at earlier stages and highlighting the need for a screening blood test to be sensitive enough to detect cancers early.

Cancer treatment is not always optimal. Guideline-concordant care was estimated to be provided in approximately 80% of prostate cancers [33, 34], 75% to 80% of breast and endometrial cancers [18, 3537], 62% of cervical cancers [20], and 44% of lung cancers [38]. Experts felt that most cancers, especially stages II and III, would benefit more from early detection if also treated with best-available multidisciplinary care, including those that were not expected to benefit from a hypothetical screening test with typical care (e.g., prostate).

Clinicians must weigh the benefits and harms of screening. Even minor reductions in screening specificity can be associated with large increases in false-positive rates, costs, and other associated harms for low-prevalence cancers [39]. While multi-cancer screening blood tests may also result in false-positive findings [3] and a fixed base of harms, these harms may be substantially reduced compared to the harms associated with screening one cancer at a time [40]. Additionally, the convenience and accessibility of a single multi-cancer screening blood test could improve adherence to existing screening, which is often suboptimal [4143].

This study had several limitations. First, these results reflect the opinion of 10 experts, one of whom was a general oncologist, though the remaining experts represented the majority of cancer types covered within this study. However, we gathered these opinions using the RAND/UCLA modified Delphi panel method, a validated quantitative method for eliciting expert opinion, which has been used extensively to develop quality measures and clinical guidance in a variety of areas [44]. Ratings of appropriateness from this method have been found to be reliable with test-retest reliability >0.9 using the same panelists 6 to 8 months later [45] and kappa statistics across several panels with different members similar to those of some common diagnostic tests [46]. Second, we used expert opinion to identify cancers that may benefit from early detection, rather than collecting data objectively on whether mortality rates changed from screening tests. Finally, the experts included in the panel were from the US only. Therefore, their opinions were based on their knowledge of cancer incidence and mortality rates within the US, which may vastly differ from the opinions of experts from undeveloped or developing countries, given the cancer burden may be distinct in areas with substantial variation in socioeconomic and cultural characteristics.

We also asked experts to assume the hypothetical screening test had 100% sensitivity and 100% specificity to simplify the rating process (e.g., base ratings on clinical factors without accounting for test performance) and focus attention on the effects of early detection rather than the methods, despite differences in the real-world performance of a screening test [47]. Further, although panelists discussed that morbidity is important and could be impacted by screening tests, only the impact of screening tests on mortality was evaluated in the rating form. Lastly, certain cancer groupings used encapsulated a number of disparate cancer types and varying risk profiles, making their ratings of these cancer types challenging. We recommend including further granularity of cancer subtypes in future research.

Conclusions

The panel highlighted opportunities to improve cancer cure by intercepting cancers at an earlier stage. Both clinical trials and real-world evidence have demonstrated that early detection is associated with better survival. Even among difficult-to-treat cancers (e.g., pancreas, liver/intrahepatic bile duct, gallbladder), early-stage detection was believed to be beneficial. Based on the panel consensus, increased coverage of cancer types in a screening test would deliver the greatest potential benefits to patients.

Supporting information

S1 Fig. Estimated cancer curability at a given stage and progression to the next stage.

(PDF)

S1 Table. Pre-meeting (round 1) aggregated ratings from all panelists.

(PDF)

S2 Table. Post-meeting (round 2) aggregated ratings from all panelists.

(PDF)

Data Availability

All relevant data are within the article.

Funding Statement

This study was sponsored by GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021. The funding sponsor had no role in the collection, management, and analysis of the data. The sponsor contributed to data interpretation. SA: Dr. Ailawadhi reported institutional research grants from Pharmacyclics, Amgen, Janssen, Ascentage, Xencor, Cellectar, BMS; consulting fees from BMS, Takeda, Oncopeptides; participating on a Data Safety Monitoring Board or advisory board for GSK, Sanofi. HB: Dr. Beltran reported institutional research grants from Janssen Oncology, BMS; consulting fees and advisory board participation for Janssen, Astellas, AstraZeneca, Merck, Pfizer, Foundation Medicine, Blue Earth Diagnostics, Amgen. JB: Dr. Blakely reported consulting fees from GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021. GTB: Dr. Budd reported institutional research grants from Daiichi, Roche, Ambrx, Tracon, Ayala, Salarius; consulting fees from Roche, Partnership for Health Analytic Research (PHAR), LLC, GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021. LC: Dr. Carr reported consulting fees from Takeda, Sereno EMD, AstraZeneca, Blueprint Medicine, Eli Lilly; payment for expert testimony from Kline & Spector P.C. and Osteen & Harrison, PLC. MC: Dr. Cecchini reported a grant from the National Cancer Institute Care Development Award; consulting fees from Agios Pharmaceuticals, Eisai Inc, AstraZeneca; support for attending meetings and/or travel from Genentech, Orche; stock or stock options from Parthenon Therapeutics. PC: Dr. Cobb reported consulting fees from Partnership for Health Analytic Research (PHAR), LLC. ARK: Dr. Kansal reported stock or stock options in Illumina (parent company of GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021). Dr. Kansal is an employee of GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021., who supported this study. AK: Dr. Kim reported stock or stock options in Illumina (parent company of GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021). Dr. Kim is an employee of GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021., who supported this study. BJM: Dr. Monk reported consulting fees from Abbvie Inc, Agenus, Akeso Bio, Aravive, AstraZeneca, Clovis, Eisai, Elevar, EMD Merck, EMD Serono, Inc, Genmab/Seattle Genetics, GOG Foundation, Gradalis, ImmunoGen, Incyte, Iovance, Janssen Research & Development, LLC, Karyopharm, Merck, Mersana, Myriad, Novocure, Pfizer, Regeneron, Roche/Genentech, Sorrento, Takeda, TESARO/GSK, US Oncology Research, VBL; payment or honoraria from AstraZeneca, Clovis, Eisai, Merck, Roche/Genentech, TESARO/GSK. DJW: Dr. Wong reported institutional research grants from Lilly, Merck Sharp & Dohme, Pfizer, TopAlliance, FSTAR, BMS, KURA, CheckMate, Roche/Genentech, Iovance, AstraZeneca, Elevar Therapeutics, LOXO Oncology, Astellas, Enzychem; consulting fees from Sanofi, Blueprint Medicine, Regeneron. MSB, IY, CC: Dr. Broder, Dr. Yermilov, and Ms. Campos are employees of Partnership for Health Analytic Research (PHAR), LLC which was paid by the following to conduct research related to the work described in the manuscript: Abbvie, Amgen, AstraZeneca, Biomarin Pharmaceuticals, BMS, Celgene, Dompe, Eisai, Exact Sciences Corporation, Genentech, GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021., Ionis, Jazz, Kite, Novartis, Otsuka, Recordati, Regeneron, Sanofi US Services, Takeda Pharmaceuticals USA.

References

  • 1.Siegel RL, Miller KD, Fuchs HE, Jemal A. Cancer statistics, 2022. CA Cancer J Clin. 2022;72:7–33. doi: 10.3322/caac.21708 [DOI] [PubMed] [Google Scholar]
  • 2.Siegel RL, Miller KD, Jemal A. Cancer statistics, 2020. CA Cancer J Clin. 2020;70:7–30. doi: 10.3322/caac.21590 [DOI] [PubMed] [Google Scholar]
  • 3.Beer TM. Novel blood-based early cancer detection: diagnostics in development. Am J Manag Care. 2020;26(14 Suppl):S292–9. doi: 10.37765/ajmc.2020.88533 [DOI] [PubMed] [Google Scholar]
  • 4.Gøtzsche PC, Nielsen M. Screening for breast cancer with mammography. Cochrane Database Syst Rev. 2011. Jan 19;(1):CD001877. doi: 10.1002/14651858.CD001877.pub4 [DOI] [PubMed] [Google Scholar]
  • 5.Pace LE, Keating NL. A systematic assessment of benefits and risks to guide breast cancer screening decisions. JAMA. 2014;311:1327–35. doi: 10.1001/jama.2014.1398 [DOI] [PubMed] [Google Scholar]
  • 6.US Preventive Services Task Force, Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB, et al. Screening for cervical cancer: US Preventive Services Task Force Recommendation Statement. JAMA. 2018;320:674–86. doi: 10.1001/jama.2018.10897 [DOI] [PubMed] [Google Scholar]
  • 7.Lauby-Secretan B, Vilahur N, Bianchini F, Guha N, Straif K, International Agency for Research on Cancer Handbook Working Group. The IARC Perspective on Colorectal Cancer Screening. N Engl J Med. 2018;378:1734–40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Clarke CA, Hubbell E, Kurian AW, Colditz GA, Hartman A-R, Gomez SL. Projected reductions in absolute cancer–related deaths from diagnosing cancers before metastasis, 2006–2015. Cancer Epidemiol Prev Biomark. 2020; 29:895–902. doi: 10.1158/1055-9965.EPI-19-1366 [DOI] [PubMed] [Google Scholar]
  • 9.Welch HG, Black WC. Overdiagnosis in cancer. J Natl Cancer Inst. 2010;102:605–13. doi: 10.1093/jnci/djq099 [DOI] [PubMed] [Google Scholar]
  • 10.Carter SM, Barratt A. What is overdiagnosis and why should we take it seriously in cancer screening? Public Health Res Pract. 2017. Jul 26;27(3):2731722. doi: 10.17061/phrp2731722 [DOI] [PubMed] [Google Scholar]
  • 11.Srivastava S, Koay EJ, Borowsky AD, De Marzo AM, Ghosh S, Wagner PD, et al. Cancer overdiagnosis: a biological challenge and clinical dilemma. Nat Rev Cancer. 2019;19:349–58. doi: 10.1038/s41568-019-0142-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Pinsky PF. An early- and late-stage convolution model for disease natural history. Biometrics. 2004;60:191–8. doi: 10.1111/j.0006-341X.2004.00023.x [DOI] [PubMed] [Google Scholar]
  • 13.Landy R, Pesola F, Castañón A, Sasieni P. Impact of cervical screening on cervical cancer mortality: estimation using stage-specific results from a nested case-control study. Br J Cancer. 2016;115:1140–6. doi: 10.1038/bjc.2016.290 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Tomassi MJ, Abbas MA, Klaristenfeld DD. Expectant management surveillance for patients at risk for invasive squamous cell carcinoma of the anus: a large US healthcare system experience. Int J Colorectal Dis. 2019;34:47–54. doi: 10.1007/s00384-018-3167-7 [DOI] [PubMed] [Google Scholar]
  • 15.Fink A, Kosecoff J, Chassin M, Brook RH. Consensus methods: characteristics and guidelines for use. Am J Public Health. 1984;74:979–83. doi: 10.2105/ajph.74.9.979 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Campbell SM. Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002;11:358–64. doi: 10.1136/qhc.11.4.358 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Fitch K, editor. The Rand/UCLA appropriateness method user’s manual. Santa Monica (CA): Rand; 2001. [Google Scholar]
  • 18.Rocque GB, Williams CP, Kenzik KM, Jackson BE, Azuero A, Halilova KI, et al. Concordance with NCCN treatment guidelines: relations with health care utilization, cost, and mortality in breast cancer patients with secondary metastasis: effect of treatment nonconcordance. Cancer. 2018;124:4231–40. [DOI] [PubMed] [Google Scholar]
  • 19.Richardson PG, San Miguel JF, Moreau P, Hajek R, Dimopoulos MA, Laubach JP, et al. Interpreting clinical trial data in multiple myeloma: translating findings to the real-world setting. Blood Cancer J. 2018;8:109. doi: 10.1038/s41408-018-0141-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Spees LP, Wheeler SB, Varia M, Weinberger M, Baggett CD, Zhou X, et al. Evaluating the urban-rural paradox: The complicated relationship between distance and the receipt of guideline-concordant care among cervical cancer patients. Gynecol Oncol. 2019;152:112–8. doi: 10.1016/j.ygyno.2018.11.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Hundal R, Shaffer EA. Gallbladder cancer: epidemiology and outcome. Clin Epidemiol. 2014;6:99–109. doi: 10.2147/CLEP.S37357 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Bruix J, Reig M, Sherman M. Evidence-based diagnosis, staging, and treatment of patients with hepatocellular carcinoma. Gastroenterology. 2016;150:835–53. doi: 10.1053/j.gastro.2015.12.041 [DOI] [PubMed] [Google Scholar]
  • 23.Singhi AD, Koay EJ, Chari ST, Maitra A. Early detection of pancreatic cancer: opportunities and challenges. Gastroenterology. 2019;156:2024–40. doi: 10.1053/j.gastro.2019.01.259 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Lamartina L, Grani G, Durante C, Filetti S, Cooper DS. Screening for differentiated thyroid cancer in selected populations. Lancet Diabetes Endocrinol. 2020;8:81–8. doi: 10.1016/S2213-8587(19)30324-9 [DOI] [PubMed] [Google Scholar]
  • 25.Davies L, Welch HG. Current thyroid cancer trends in the United States. JAMA Otolaryngol Neck Surg. 2014;140:317–22. doi: 10.1001/jamaoto.2014.1 [DOI] [PubMed] [Google Scholar]
  • 26.US Preventive Services Task Force, Grossman DC, Curry SJ, Owens DK, Bibbins-Domingo K, Caughey AB, et al. Screening for prostate cancer: US Preventive Services Task Force recommendation statement. JAMA. 2018;319:1901–13. doi: 10.1001/jama.2018.3710 [DOI] [PubMed] [Google Scholar]
  • 27.Nyame YA, Gulati R, Tsodikov A, Gore JL, Etzioni R. Prostate-specific antigen screening and recent increases in advanced prostate cancer. JNCI Cancer Spectr. 2020;5(1):pkaa098. doi: 10.1093/jncics/pkaa098 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Hugosson J, Roobol MJ, Månsson M, Tammela TLJ, Zappa M, Nelen V, et al. A 16-yr follow-up of the European Randomized study of Screening for Prostate Cancer. Eur Urol. 2019;76(1):43–51. doi: 10.1016/j.eururo.2019.02.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Shoag JE, Nyame YA, Gulati R, Etzioni R, Hu JC. Reconsidering the trade-offs of prostate cancer screening. N Engl J Med. 2020;382(25):2465–8. doi: 10.1056/NEJMsb2000250 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Howlader N, Forjaz G, Mooradian MJ, Meza R, Kong CY, Cronin KA, et al. The Effect of advances in lung-cancer treatment on population mortality. N Engl J Med. 2020;383(7):640–9. doi: 10.1056/NEJMoa1916623 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Guo F, Kuo Y-F, Shih YCT, Giordano SH, Berenson AB. Trends in breast cancer mortality by stage at diagnosis among young women in the United States. Cancer. 2018;124:3500–9. doi: 10.1002/cncr.31638 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Lu G, Li J, Wang S, Pu J, Sun H, Wei Z, et al. The fluctuating incidence, improved survival of patients with breast cancer, and disparities by age, race, and socioeconomic status by decade, 1981–2010. Cancer Manag Res. 2018;10:4899–914. doi: 10.2147/CMAR.S173099 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Chen RC, Carpenter WR, Hendrix LH, Bainbridge J, Wang AZ, Nielsen ME, et al. Receipt of guideline-concordant treatment in elderly prostate cancer patients. Int J Radiat Oncol. 2014;88(2):332–8. doi: 10.1016/j.ijrobp.2013.11.004 [DOI] [PubMed] [Google Scholar]
  • 34.Ellis SD, Blackard B, Carpenter WR, Mishel M, Chen RC, Godley PA, et al. Receipt of National Comprehensive Cancer Network guideline-concordant prostate cancer care among African American and caucasian American men in North Carolina: Prostate Cancer Guideline Concordance. Cancer. 2013;119:2282–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Rocque GB, Williams CP, Jackson BE, Ingram SA, Halilova KI, Pisu M, et al. Impact of nonconcordance with NCCN guidelines on resource utilization, cost, and mortality in de novo metastatic breast cancer. J Natl Compr Canc Netw. 2018;16:1084–91. doi: 10.6004/jnccn.2018.7036 [DOI] [PubMed] [Google Scholar]
  • 36.Felix AS, McLaughlin EM, Caan BJ, Cohn DE, Anderson GL, Paskett ED. Guideline‐concordant endometrial cancer treatment and survival in the Women’s Health Initiative Life and Longevity After Cancer study. Int J Cancer. 2020;147:404–12. doi: 10.1002/ijc.32740 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Kaspers M, Llamocca E, Quick A, Dholakia J, Salani R, Felix AS. Black and Hispanic women are less likely than white women to receive guideline-concordant endometrial cancer treatment. Am J Obstet Gynecol. 2020;223:398.e1–398.e18. doi: 10.1016/j.ajog.2020.02.041 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Nadpara PA, Madhavan SS, Tworek C, Sambamoorthi U, Hendryx M, Almubarak M. Guideline-concordant lung cancer care and associated health outcomes among elderly patients in the United States. J Geriatr Oncol. 2015;6:101–10. doi: 10.1016/j.jgo.2015.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Myers ER, Moorman P, Gierisch JM, Havrilesky LJ, Grimm LJ, Ghate S, et al. Benefits and harms of breast cancer screening: a systematic review. JAMA. 2015;314:1615–34. doi: 10.1001/jama.2015.13183 [DOI] [PubMed] [Google Scholar]
  • 40.Hackshaw A. Estimating the population health impact of a multi-cancer early detection genomic blood test to complement existing screening in the US and UK. Br J Cancer. 2021;125:1432–42. doi: 10.1038/s41416-021-01498-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Cossu G, Saba L, Minerba L, Mascalchi M. Colorectal cancer screening: the role of psychological, social and background factors in decision-making process. Clin Pract Epidemiol Ment Health. 2018;14:63–9. doi: 10.2174/1745017901814010063 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Narayan A, Fischer A, Zhang Z, Woods R, Morris E, Harvey S. Nationwide cross-sectional adherence to mammography screening guidelines: national behavioral risk factor surveillance system survey results. Breast Cancer Res Treat. 2017;164:719–25. doi: 10.1007/s10549-017-4286-5 [DOI] [PubMed] [Google Scholar]
  • 43.Brasher P, Tanner N, Yeager D, Silvestri G. Adherence to annual lung cancer screening within the Veterans Health Administration Lung Cancer Screening Demonstration Project. Chest. 2018;154:636A–637A.29705221 [Google Scholar]
  • 44.Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS ONE. 2011;6(6):e20476. doi: 10.1371/journal.pone.0020476 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Merrick NJ, Fink A, Park RE, Brook RH, Kosecoff J, Chassin MR, et al. Derivation of clinical indications for carotid endarterectomy by an expert panel. Am J Public Health. 1987;77:187–90. doi: 10.2105/ajph.77.2.187 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Shekelle PG, Kahan JP, Bernstein SJ, Leape LL, Kamberg CJ, Park RE. The reproducibility of a method to identify the overuse and underuse of medical procedures. N Engl J Med. 1998;338:1888–95. doi: 10.1056/NEJM199806253382607 [DOI] [PubMed] [Google Scholar]
  • 47.Hubbell E, Clarke CA, Aravanis AM, Berg CD. Modeled reductions in late-stage cancer with a multi-cancer early detection test. Cancer Epidemiol Biomarkers Prev. 2021;30:460–8. doi: 10.1158/1055-9965.EPI-20-1134 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Kush Raj Lohani

19 Jul 2022

PONE-D-22-14922Impact of early detection on cancer curability: a modified Delphi panel studyPLOS ONE

Dear Dr. Kim,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 02 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Kush Raj Lohani, Master of Surgery

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. Thank you for stating the following in the Competing Interests section: 

"I have read the journal's policy and the authors of this manuscript have the following competing interests: LS, SA, HB, JB, GTB, LC, MC, PC, BJM, DJW reported consulting fees from Partnership for Health Analytic Research (PHAR), LLC and GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021. ARK and AK are employees of GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021, who supported this study, and reported stock or stock options in Illumina (parent company of GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021). MSB, IY, and CC are employees of Partnership for Health Analytic Research (PHAR), LLC which was paid by the following to conduct research related to the work described in the manuscript: Abbvie, Amgen, AstraZeneca, Biomarin Pharmaceuticals, BMS, Celgene, Dompe, Eisai, Exact Sciences Corporation, Genentech, GRAIL, LLC, a subsidiary of Illumina, Inc., currently held separate from Illumina, Inc. under the terms of the Interim Measures Order of the European Commission dated 29 October 2021, Ionis, Jazz, Kite, Novartis, Otsuka, Recordati, Regeneron, Sanofi US Services, Takeda Pharmaceuticals USA."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: ""This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. 

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is an interesting paper on a modified Delphi study on the impact of early detection on cancer mortality. However, some parts of the methodology are not fully clear / justified in the current version, specifically:

1) Data access: only aggregated data is provided in the manuscript, without individual expert scores; and only the results of the second round of scoring are reported. It is suggested to include the individual expert ratings for both rating rounds as supplementary material.

2) Lines 105-107: The Delphi panel involved 10 oncology experts from a diversity of oncology subspecialties (e.g., prostate, breast, lung, colorectal, gastrointestinal, gynecologic, head and neck, hematologic cancers, and sarcoma) and included a general practice oncologist. Apparently, a single expert was involved from most subspecialties, raising that the consensus building on the specific cancer types could be dominated by this single expert with the strongest background in the corresponding subspecialty. The Authors are invited to discuss this risk/limitation, and to report more details on disagreements in round 1 that were solved in round 2.

3) Word anchors for benefit were 1 (cure rates not at all likely to increase) and 9 (cure rates likely to increase a great deal). Please clarify if additional word anchors were used for scores 2-8.

4) Experts were asked to rate curability of 20 solid organ cancers across stages I to IV before the meeting, where they were presented with individual first-round ratings and median values, and the reasons of their peers for their ratings (Lines 143-154). On the other hand, SEER registry data on median 10-year survival was also referenced in the manuscript by cancer types and stages (Lines 256-260). The Authors are invited to explain why did they decide to collect curability data from their expert panel of limited size and heterogeneous subspecialty background, instead of building on SEER registry data; and whether SEER data on curability / survival by cancer types and stages was presented at the consensus meeting to the involved panelists or not. Correlation of expert-elicited curability rates with SEER statistics on survival would also be an interesting point to add to this manuscript as a kind of validation, even if curability (as elicited by the experts) and 10-year survival (in SEER analyses) are not identical concepts.

5) Table 2, estimated median (range) number of years for each cancer type to progress from one stage to next: The Authors are invited to clarify whether there is existing data in the literature / in registries relevant for the US on cancer stage transition times, or not. The lack of available data would justify the use of the opinions of the 10 involved experts as data source.

6) Figure 1 shows three clusters of cancer types-stages, by various colors: cancers in blue ("those with high curability today in earlier stages and likely to progress"); cancers in purple ("lower curability today in earlier stages

and likely to progress"); and cancers in orange ("high curability in earlier stages today and progress slowly"). However, it is unclear how these clusters were formed. If statistical methods were used for the identification of clusters, the corresponding methods should be described. If the clusters were identified by the Authors visually, please provide a corresponding chart that allows for visual cluster identification (i.e., a plot of curability today ~ progression to next stage), since Figure 1 does not include data on likeliness to progress. There is a risk that the clusters were defined based on preconception - which is a very plausible preconception, but is not driven from the expert panel score data.

Please note that figure resolution need to be improved.

Reviewer #2: Disclosures: ok

Title: adequate

Key words: There is not available key words, please insert it

Abstract: adequate

Introduction

PG 3- line 63- Please inset some words about PSA, however controverse there are in the literature several prostate cancer, screening studies using PSA as a serum marker. I suggest to include it, with imaging tests, tissue tests and biopsy. Despite to promote overdiagnosis and overtreatment, and the elevated number necessary to treat patients, European Trials has shown death reduction in prostate cancer screened patients.

I think prostate cancer screening controversies might be cited in paragraphs between lines 77-91.

Methods:

Please, clarify how were the criteria for the 10 experts invitation. It is not clear in the methodology (or how many were invited and declined e.g.), How to choose someone in a US region, among a great quantity of oncologists available?

Results

Figures present poor quality; being necessary to click in the link ( good quality at link). It is necessary to enhance it for the readers.

Figures legend are absent it he manuscript- Are there in the pages 11 and 12?

Discussion

In the study limitations, authors must recognize that they focused only in the United States scenario. We do not know what would be the opinion of experts form Far East Countries, or form undeveloped and developing countries. As we know the incidence and mortality rates from several prevalent tumors, are quite distinct among several nations and in distinct socioeconomical and cultural populational groups.

It is difficult to understand why only 10 experts were choose for this study. In my view this study might be a pilot or a feasibility study, performed as a first step, to development of a new screening, which could invite hundreds of experts around the world, and to include radiation oncologists, oncologic surgeons etc. What was the objective of authors in inviting on 10 professionals, in a where the answers may be contaminated by subjectively and diverse personal bias?

The hypothetic blood test only diagnostic early stage cancers or cancer in all stages? Please clarify it.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Janos G Pitter MD, PhD

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Dec 21;17(12):e0279227. doi: 10.1371/journal.pone.0279227.r002

Author response to Decision Letter 0


20 Sep 2022

Thank you for your in-depth review and helpful comments. Based on the feedback provided, we have made edits to the manuscript and have included our responses below to the reviewers’ comments. The new changes have been identified in the revised manuscript.

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

________________________________________

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: N/A

________________________________________

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

________________________________________

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is an interesting paper on a modified Delphi study on the impact of early detection on cancer mortality. However, some parts of the methodology are not fully clear / justified in the current version, specifically:

1) Data access: only aggregated data is provided in the manuscript, without individual expert scores; and only the results of the second round of scoring are reported. It is suggested to include the individual expert ratings for both rating rounds as supplementary material.

Response: Thank you for this comment. We have added the aggregated raw results from both the first and second rounds as supplemental material. Experts were told their individuals scores would not be shared with others, and only group medians were shared with the panel during the discussion. Given our panel of experts was small, there may be concerns regarding the privacy of the panelists if we share anonymized individual scores. We have noted these points in the cover letter.

2) Lines 105-107: The Delphi panel involved 10 oncology experts from a diversity of oncology subspecialties (e.g., prostate, breast, lung, colorectal, gastrointestinal, gynecologic, head and neck, hematologic cancers, and sarcoma) and included a general practice oncologist. Apparently, a single expert was involved from most subspecialties, raising that the consensus building on the specific cancer types could be dominated by this single expert with the strongest background in the corresponding subspecialty. The Authors are invited to discuss this risk/limitation, and to report more details on disagreements in round 1 that were solved in round 2.

Response: Thank you for this point. The panel consisted of ten oncology experts representing various clinical specialties and a diverse range of experience and backgrounds. Given the level of expertise of most, if not all, of the specialists, we rarely had a single expert speaking on a specific cancer type, as there was a high level of familiarity with regards to multiple cancer types as a whole. Panelists were explicit on whether they had any experience with a certain cancer type, and the discussion stemmed naturally from the panelists comparing their experiences with different cancer types and patient populations more broadly, as well as different treatment options and severity levels. Most of the disagreements in round 1 that were resolved in round 2 stemmed from panelists having various interpretations of some of the questions and concepts on the rating form, as they discussed how to define and consider “curability” and cure rates, life expectancy, and staging of cancers.

3) Word anchors for benefit were 1 (cure rates not at all likely to increase) and 9 (cure rates likely to increase a great deal). Please clarify if additional word anchors were used for scores 2-8.

Response: Thank you for this comment. To clarify, when asking panelists whether cure rates would increase with a hypothetical screening test, we provided a scale of 1-9, with 1 (cure rates are not at all likely to increase), 3 (cure rates are slightly likely to increase), 5 (cure rates are moderately likely to increase), 7 (cure rates are considerably likely to increase), and 9 (cure rates are likely to increase a great deal, or double). We did not provide more specific and tangible word anchors for the other scores other than a score of 9, as we hypothesized that it would be difficult for panelists to think about a certain percentage (e.g., 10-20%) of the outcome of interest for each cancer type and stage. Instead, we used categories which allowed more room for panelists to answer the question in a more holistic way, given the nuances with each cancer type and stage and the highest possible score of 9 would suggest doubling.

4) Experts were asked to rate curability of 20 solid organ cancers across stages I to IV before the meeting, where they were presented with individual first-round ratings and median values, and the reasons of their peers for their ratings (Lines 143-154). On the other hand, SEER registry data on median 10-year survival was also referenced in the manuscript by cancer types and stages (Lines 256-260). The Authors are invited to explain why did they decide to collect curability data from their expert panel of limited size and heterogeneous subspecialty background, instead of building on SEER registry data; and whether SEER data on curability / survival by cancer types and stages was presented at the consensus meeting to the involved panelists or not. Correlation of expert-elicited curability rates with SEER statistics on survival would also be an interesting point to add to this manuscript as a kind of validation, even if curability (as elicited by the experts) and 10-year survival (in SEER analyses) are not identical concepts.

Response: Thank you for this comment. Prior to the consensus meeting, the panelists were provided a comprehensive evidence summary on the survivability (curability) of 20 solid organ cancers, which was primarily obtained from SEER data and the American Cancer Society (ACS) Facts & Figures 2020 Report. We wanted to elicit expert input on curability across cancer stages and types based on their current clinical practice and experience, and also on curability given the addition of a hypothetical screening test and either typical or best available treatment.

5) Table 2, estimated median (range) number of years for each cancer type to progress from one stage to next: The Authors are invited to clarify whether there is existing data in the literature / in registries relevant for the US on cancer stage transition times, or not. The lack of available data would justify the use of the opinions of the 10 involved experts as data source.

Response: Thank you for this point. There is limited data and literature to allow inferences regarding the natural history of cancers (e.g., 5-year survival by stage, tumor doubling time) for a few cancer types, but there is a lack of relevant data for the large majority of cancer types. Even for cancer types with some data on natural history, there is an absence of data on progression between stages prior to clinical diagnosis.

6) Figure 1 shows three clusters of cancer types-stages, by various colors: cancers in blue ("those with high curability today in earlier stages and likely to progress"); cancers in purple ("lower curability today in earlier stages

and likely to progress"); and cancers in orange ("high curability in earlier stages today and progress slowly"). However, it is unclear how these clusters were formed. If statistical methods were used for the identification of clusters, the corresponding methods should be described. If the clusters were identified by the Authors visually, please provide a corresponding chart that allows for visual cluster identification (i.e., a plot of curability today ~ progression to next stage), since Figure 1 does not include data on likeliness to progress. There is a risk that the clusters were defined based on preconception - which is a very plausible preconception, but is not driven from the expert panel score data.

Response: Thank you for this comment. The three clusters of cancer types were in fact determined from the panel consensus on the estimated likelihood of cure by cancer type and stage (Table 1) and the estimated number of years for cancer to progress through stages (Table 2), both of which are in the manuscript. Panelists agreed that cancers in orange (e.g., prostate, thyroid) progress slowly despite having high curability in earlier stages. Panelists also agreed that cancers in purple (e.g., gallbladder, live/intrahepatic bile duct, and pancreas) are likely to progress, but have a lower likelihood of cure today in earlier stages. Finally, panelists agreed that cancers in blue (e.g., anus, uterus, head and neck, kidney, colon/rectum, breast, cervix, urothelial tract, lung, melanoma, ovary, sarcoma, bladder, stomach, esophagus) are likely to progress, but have a lower likelihood of cure today in earlier stages. Also, we have added Figure S1, which plots the likelihood of cancer curability today and the progression to the next stage, as part of the Supporting Information and in lines 185-186.

Please note that figure resolution need to be improved.

Response: Thank you for this comment. We have reuploaded the figures to PACE.

Reviewer #2: Disclosures: ok

Title: adequate

Key words: There is not available key words, please insert it

Response: Thank you for this comment. The following key words (cancer screening, Delphi panel, survival, curability) have been added within the submission form.

Abstract: adequate

Introduction

PG 3- line 63- Please inset some words about PSA, however controverse there are in the literature several prostate cancer, screening studies using PSA as a serum marker. I suggest to include it, with imaging tests, tissue tests and biopsy. Despite to promote overdiagnosis and overtreatment, and the elevated number necessary to treat patients, European Trials has shown death reduction in prostate cancer screened patients.

I think prostate cancer screening controversies might be cited in paragraphs between lines 77-91.

Response: Thank you for this comment. We included PSA tests as an example of an existing cancer screening test, albeit on an individual basis, in lines 64-65. We did not include other imaging tests, tissue tests, and biopsies, as the scope of this study was to consider cancer screening modalities specifically, and not diagnostic tests. We have also elaborated further on the controversies surrounding PSA screening in lines 281-293.

Methods:

Please, clarify how were the criteria for the 10 experts invitation. It is not clear in the methodology (

or how many were invited and declined e.g.), How to choose someone in a US region, among a great quantity of oncologists available?

Response: Thank you for this comment. Given readily accessible lists of experts across the US were unavailable, recruitment was conducted indirectly (e.g., professional networks). We initially reached out to 37 experts across the US to gauge interest and availability. We ended up with a panel of 11 experts, of which one was not able to attend the meeting. As a result, our final panel included 10 experts, which was in line with the RAND/UCLA Appropriateness Method guideline (Fitch et al 2001) recommendations of 7-15 panelists. The criteria for the 10 experts included having a breadth and diversity of oncology experience (i.e., treating a variety of cancers) across the US, representing different geographic regions and practice settings. This has been clarified in lines 102-107.

Results

Figures present poor quality; being necessary to click in the link ( good quality at link). It is necessary to enhance it for the readers.

Response: Thank you for this comment. The figures have been reuploaded to PACE.

Figures legend are absent it he manuscript- Are there in the pages 11 and 12?

Response: Thank you for pointing this out. The Figure 1 legend is within lines 210-223, and the Figure 2 legend is within lines 233-241.

Discussion

In the study limitations, authors must recognize that they focused only in the United States scenario. We do not know what would be the opinion of experts form Far East Countries, or form undeveloped and developing countries. As we know the incidence and mortality rates from several prevalent tumors, are quite distinct among several nations and in distinct socioeconomical and cultural populational groups.

Response: Thank you for this point. We recognize our US-specific a panel as a study limitation in lines 330-335.

It is difficult to understand why only 10 experts were choose for this study. In my view this study might be a pilot or a feasibility study, performed as a first step, to development of a new screening, which could invite hundreds of experts around the world, and to include radiation oncologists, oncologic surgeons etc. What was the objective of authors in inviting on 10 professionals, in a where the answers may be contaminated by subjectively and diverse personal bias?

Response: Thank you for your comment. We chose 10 panelists because this is in line with the RAND/UCLA Appropriateness Method guidelines (Fitch et al 2001), which recommended anywhere from 7-15 panelists. We initially reached out to 37 experts to gauge interest and availability. The final 10 experts for the panel were chosen due to their breadth and diversity of oncology experience across the US, with the aim of including oncologists who treat a variety of cancers. This has been clarified in lines 102-107. In addition, given the level of expertise of most, if not all, of the specialists, we rarely had a single expert speaking on a specific cancer type, as there was a decent level of overlap and familiarity with regards to multiple cancer types as a whole. Panelists were explicit on whether they did or did not have much experience with a certain cancer type, and the discussion stemmed naturally from the panelists comparing their experiences with different cancer types and patient populations more broadly, as well as different treatment options and severity levels. Most of the disagreements stemmed from panelists having various interpretations of some of the questions and concepts on the rating form, as they discussed how to define and consider “curability” and cure rates, life expectancy, and staging of cancers.

The hypothetic blood test only diagnostic early stage cancers or cancer in all stages? Please clarify it.

Response: Thank you for this question. Our hypothetical scenario of annual cancer screening blood test with high sensitivity and specificity would be able to detect cancers at all stages. We have clarified this point in line 197.

________________________________________

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Janos G Pitter MD, PhD

Reviewer #2: No

________________________________________

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Response: The figure files have been uploaded to PACE.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Kush Raj Lohani

6 Nov 2022

PONE-D-22-14922R1Impact of early detection on cancer curability: a modified Delphi panel studyPLOS ONE

Dear Dr. Authors,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Dec 21 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Kush Raj Lohani, MBBS, MS (Master of General Surgery)

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Thank you for this interesting and conceptual study. There is no doubt that early diagnosis and prompt treatment remains our main motto. However, before we jump into universal screening for all cancers, we need to know the limitations and practical aspects of it. We certainly need to weigh benefit / risk of screening to provide comprehensive benefit to patients. This study is an initial step in this endeavor. As highlighted in the reviews, one of the main limitations of this study is incorporating opinion of an Oncologist on all cancers. I hope this will be mentioned in the limitations. I believe this study will invite further dedicated studies with more concrete data from experts in each type of cancer by implementing real data from the institutional experience and comparing with reference information such as from the SEER.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The Authors explained in their response letter that panelists were explicit on whether they had any

experience with a certain cancer type or not. This information is important for the interpretation of the findings and shall be added to the manuscript: please include the number of experts with explicit experience for each specific cancer type.

In addition, please clarify whether scores were collected from all experts for all cancer types? Or for each cancer type, scores were collected only from experts with declared experience with the particular cancer type?

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Janos G. Pitter MD, PhD

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Dec 21;17(12):e0279227. doi: 10.1371/journal.pone.0279227.r004

Author response to Decision Letter 1


21 Nov 2022

Thank you for your review and comments. Based on the feedback provided, we have made edits to the manuscript and have included our responses below to the reviewers’ comments. The new changes have been identified in the revised manuscript.

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Response: No changes need to be made to the reference list.

Additional Editor Comments (if provided):

Thank you for this interesting and conceptual study. There is no doubt that early diagnosis and prompt treatment remains our main motto. However, before we jump into universal screening for all cancers, we need to know the limitations and practical aspects of it. We certainly need to weigh benefit / risk of screening to provide comprehensive benefit to patients. This study is an initial step in this endeavor. As highlighted in the reviews, one of the main limitations of this study is incorporating opinion of an Oncologist on all cancers. I hope this will be mentioned in the limitations. I believe this study will invite further dedicated studies with more concrete data from experts in each type of cancer by implementing real data from the institutional experience and comparing with reference information such as from the SEER.

Response: Thank you for your comments. We have included as a limitation that the panel of experts did include one general oncologist, though we have also further clarified that the rest of the panel did represent the majority of cancer types covered within this study in lines 322-324 of the discussion section.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

________________________________________

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

________________________________________

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

________________________________________

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

________________________________________

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

________________________________________

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The Authors explained in their response letter that panelists were explicit on whether they had any

experience with a certain cancer type or not. This information is important for the interpretation of the findings and shall be added to the manuscript: please include the number of experts with explicit experience for each specific cancer type.

In addition, please clarify whether scores were collected from all experts for all cancer types? Or for each cancer type, scores were collected only from experts with declared experience with the particular cancer type?

Response: Thank you for these points. While we had one general practice oncologist, the remaining specialists specified their expertise within the following cancer types: hematologic (2), prostate (1), breast (3), lung (2), colorectal (2), gastrointestinal, including, but not limited to, bile duct, pancreas, esophageal, stomach (1), head and neck (1), liver (1), gynecological, including, but not limited to, cervical and ovarian (1); sarcoma (2). The scores were collected for all cancer types from all experts. As expected in the Delphi approach, the discussion did include the group hearing from experts with more experience for certain cancer types and then each panelist synthesizing that information with their own experience in their individual ratings. We addressed these two points within the methods section in lines 112-115 and 136.

________________________________________

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Janos G. Pitter MD, PhD

________________________________________

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Response: The figure files have been uploaded to PACE.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Kush Raj Lohani

5 Dec 2022

Impact of early detection on cancer curability: a modified Delphi panel study

PONE-D-22-14922R2

Dear Dr. Kim,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Kush Raj Lohani, MBBS, MS (General Surgery)

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Kush Raj Lohani

12 Dec 2022

PONE-D-22-14922R2

Impact of early detection on cancer curability: a modified Delphi panel study

Dear Dr. Kim:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Kush Raj Lohani

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Estimated cancer curability at a given stage and progression to the next stage.

    (PDF)

    S1 Table. Pre-meeting (round 1) aggregated ratings from all panelists.

    (PDF)

    S2 Table. Post-meeting (round 2) aggregated ratings from all panelists.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the article.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES