Skip to main content
PLOS One logoLink to PLOS One
. 2021 May 19;16(5):e0250379. doi: 10.1371/journal.pone.0250379

Health system interventions to integrate genetic testing in routine oncology services: A systematic review

Rosie O’Shea 1,2,*, Natalie Taylor 1,3,, Ashley Crook 2,#, Chris Jacobs 2,#, Yoon Jung Kang 1,3,, Sarah Lewis 1,#, Nicole M Rankin 1,#
Editor: Alvaro Galli4
PMCID: PMC8133413  PMID: 34010335

Abstract

Background

Integration of genetic testing into routine oncology care could improve access to testing. This systematic review investigated interventions and the tailored implementation strategies aimed at increasing access to genetic counselling and testing and identifying hereditary cancer in oncology.

Methods

The search strategy results were reported using the PRISMA statement and four electronic databases were searched. Eligible studies included routine genetic testing for breast and ovarian cancer or uptake after universal tumour screening for colorectal or endometrial cancer. The titles and abstracts were reviewed and the full text articles screened for eligibility. Data extraction was preformed using a designed template and study appraisal was assessed using an adapted Newcastle Ottawa Scale. Extracted data were mapped to Proctor’s et al outcomes and the Consolidated Framework for Implementation Research and qualitatively synthesised.

Results

Twenty-seven studies, published up to May 2020, met the inclusion criteria. Twenty-five studies ranged from poor (72%), fair to good (28%) quality. Most interventions identified were complex (multiple components) such as; patient or health professional education, interdisciplinary practice and a documentation or system change. Forty-eight percent of studies with complex interventions demonstrated on average a 35% increase in access to genetic counselling and a 15% increase in testing completion.

Mapping of study outcomes showed that 70% and 32% of the studies aligned with either the service and client or the implementation level outcome and 96% to the process or inner setting domains of the Consolidated Framework for Implementation Research.

Conclusion

Existing evidence suggests that complex interventions have a potentially positive effect towards genetic counselling and testing completion rates in oncology services. Studies of sound methodological quality that explore a greater breadth of pre and post implementation outcomes and informed by theory are needed. Such research could inform future service delivery models for the integration of genetics into oncology services.

Introduction

A challenge of optimising standards in oncology is the slow rate that evidence is adopted into clinical care, leading to inequity and variation between hospital settings [1, 2]. Health services research identifies ways to ease the burden on cancer care provision, improve system inefficiencies and optimise standards [1, 2]. In the case of cancer germline genetic testing (GT), a systematic way to sustain implementation of GT is needed as this is increasingly being used in the assessment and care of patients in many specialities [3]. Evidence based clinical practice guidelines in the United States of America (USA), Australia and the United Kingdom (UK) recommend access for epithelial ovarian cancer (EOC) and triple negative breast cancer (TNBC) patients to have BRCA testing [46]. Established clinical guidelines for directing access to GT for endometrial and colorectal cancers (EC/CRC) exist in the USA, UK and Australia [79].

Direct access to GT in oncology care (known as ‘mainstreaming’) could improve access to GT and the identification of patients with hereditary cancer. Prior to mainstreaming, access to genetic counselling (GC) services has been through referral to genetics services. In many jurisdictions, medical specialists in oncology can now order a panel of multiple genes to assess for hereditary breast and ovarian cancer (HBOC) [10] without prior referral to genetic services. Mainstreaming assumes that oncology health professionals will take on the role of pre-test GC for GT.

Barriers to mainstreaming exist among non-genetics health professionals from a range of specialities and include, a lack of genetics knowledge and skill, resources and guidelines, low confidence with genetics, and concerns about discrimination and psychological harm [11, 12]. These barriers have led to suboptimal referral and identification of hereditary cancer [13, 14] and reduce the potential for GT to inform cancer prevention through regular screening or preventative surgery [1517]. Integrating GT into oncology services aims to circumvent recognised barriers to improve the identification of BRCA related HBOC and personalise treatments with the use of poly ADP ribose polymerase (PARP) inhibitors (PARPi) [18]. The initial BRCA mainstreaming programs allows implementation insights to inform approaches to improve access to GT and identification for other hereditary cancer.

Hereditary colorectal and endometrial cancer associated with Lynch Syndrome (LS) is a parallel example where direct access to GT instead of referral to genetics services allows surgeons and oncologists to directly order GT. Recent changes in Australian public funding of GT [19] in 2020, now allow medical specialists caring for EC and CRC patients to request GT directly, as a new form of mainstreaming. Before ordering GT for CRC or EC patients, oncologists or surgeons need to identify deficient mismatch repair (dMMR) positive status on a universal tumour screen (UTS) [20]. The aim of UTS is to increase the number of LS individuals identified, enabling cancer screening and risk prevention and reducing the burden of disease in individuals and their families [20].

In Australia, as direct access to GT to align with UTS begins, learning from other jurisdictions where GT has been part of routine oncology care, can provide important lessons. The application of implementation science using Proctor’s evaluative framework [21] and the Consolidated Framework for Implementation Research (CFIR) [22] provides a means of assessing existing interventions used to incorporate GT into routine oncology, to understand the effectiveness of mainstreaming strategies and to inform its long-term sustainability.

Understanding implementation outcomes can enhance the implementation success of an intervention. However, many studies miss out this important step, focusing the evaluation of the interventions’ implementation on the service and client level [21]. Therefore, an implementation outcome evaluative framework provides a means to assess and evaluate implementation efforts, differentiating three groups of outcomes–implementation, service and client [21]. The CFIR framework [22] allows an understanding of the factors that can affect implementation processes and outcomes.

Interventions are most effective when there is an understanding of the constituent components, implementation factors in the relevant health system and the implementation outcomes of the intervention [21, 23]. For the purposes of this review an intervention is defined as a single unit that can bring about change in a system [23] and complex interventions are described as ‘interventions that contain several interacting components’ [24]. The term complex refers to the multi component nature of the health system intervention and relates to the intervention, setting, patients and professionals interacting with it [24]. An example of a single unit intervention would be education about incorporating GT into routine oncology practice. A complex intervention example would consist of multiple components, for example, education/training of staff, changes to referral pathways and use of electronic medical record to streamline appointments. These components, which can be described as ‘implementation strategies’, strive to increase access to GC and GT in routine oncology practice. The specific review question we asked was: What interventions have been shown to increase the uptake of GC and GT in oncology services, specifically for ovarian, breast, colorectal and endometrial cancer, to identify hereditary cancer? Interventions of interest were those that aimed to:

  1. increase GT integration in oncology care (mainstreaming) for subsets of ovarian and breast cancer in the oncology setting, and

  2. increase the uptake of GT after UTS for colorectal and endometrial cancer.

Our outcomes of interest for intervention studies were:

  • 1

    Referral rates of eligible patients with breast, ovarian, endometrial and colorectal cancer to GC

  • 2

    Breast, ovarian, colorectal and endometrial cancer patients completing GC and GT

  • 3

    Identification of hereditary cancer.

The second objective was to understand the implementation factors that influence GT adoption in oncology services.

Our outcomes of interest for implementation factors were;

  • 4

    Qualitative or quantitative implementation outcome factors.

Methods

This systematic review used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement (PRISMA) [25] to report the search results. The protocol of the review was not registered as it is part of a PhD program of study.

Inclusion/exclusion criteria

Study inclusion criteria were as follows;

  1. A population consisting of;
    • Breast, ovarian, colorectal and endometrial cancer patients > 18 years old with 80% of the population being studied for access to GT for HBOC or uptake of GT after UTS for CRC or EC
  2. An intervention focussed on the following;
    • integration of routine genetic testing through mainstreaming for breast and ovarian cancer in oncology services
    • increasing GC and GT completion rates after UTS for CRC and EC
  3. A comparator consisting of the following;
    • Another intervention with the same purpose described in intervention section above
    • No intervention (in the case of qualitative studies)
    • Standard or usual care
  4. Outcomes focusing on Proctor’s evaluative framework and CFIR’s five implementation factor domains as follows;
    • Implementation outcomes and factors
    • Service outcomes and factors
    • Client outcomes and factors
  5. Study designs as specified below;
    • Experimental, quasi-experimental and observational study designs (randomised control trials, cohort studies, controlled pre and post studies, case series).
    • Qualitative studies on implementation factors or outcomes that influence genetic testing adoption in oncology
  6. Organisation setting;
    • Any healthcare system engaging in integrating GT into oncology services.

A study was excluded if it focused on patients with other cancers not related to HBOC and LS or asymptomatic individuals or relatives at high risk of these conditions. Additionally, a study was excluded if the outcomes were not linked to mainstreaming of GT or enhancing the uptake of UTS.

Search strategy

A search strategy was developed by checking the subject headings and text terms used for the area of interest. An initial draft was reviewed with systematic review experts (CC SH) and trialled on MEDLINE. The search terms were revised by ROS and systematic reviewers (CC) and the final version included search terms for ovarian, breast, colorectal and endometrial cancer, combined with genetic counselling, genetic testing, mainstreaming, and implementation science terms (S1 Table). This strategy was then translated for use in CINAHL (S2 Table). The strategy was executed in four databases on 26.09.19: MEDLINE, EMBASE, PsychINFO and CINAHL and alerts from this search were screened until 26.05.20 A list of included studies is in the Supporting information.

Study selection

All of the titles and abstracts were exported to Endnote X8 and screened by ROS independently against the inclusion criteria. Full text articles of those with unclear or missing information were retrieved and screened by ROS against the inclusion criteria. Studies meeting the inclusion criteria were retained. ROS obtained all relevant full texts articles and randomly assigned these to two other reviews through Excel. Full text articles were screened for eligibility by three reviewers (ROS, AC and CC) and the reasons for excluding articles were documented in Excel. Any disagreements were resolved through initial discussion between the three reviewers and if no consensus was reached, a fourth reviewer was considered an arbitrator.

Data extraction

Data was extracted from each included study on population (healthcare professional, setting and patient); description of the intervention (adapted criteria template for intervention description and replication (TIDieR) checklist [26]); implementation study dates, use of a model or framework, study design and intervention outcomes for the implementation period were assessed by mapping to all of the components of Proctor et al.’s evaluative framework [21] at the implementation, service or client level and all CFIR [22] domain and relevant constructs; and information for quality appraisal (S4 Table). Two reviewers (ROS, CC) extracted data from two included studies and compared results. Discrepancies were discussed and a consensus reached for future data extraction. One reviewer (ROS) independently completed data extraction for the remainder of the included studies (S4 Table).

Quality appraisal

The quality assessment of each included study was assessed using an adapted Newcastle Ottawa Scale (NOS) [27] for cohort studies and further adapted for case series with implementation outcomes. The adapted NOS evaluated selection bias, study design, confounders, blinding of study participants, data collection methods, and follow up rates. The tool was independently applied by two reviewers (AC, ROS) and consensus was reached on any discrepancies through discussion. The star rating for each component was then converted to Agency for Healthcare Research and Quality (AHRQ) rating from poor to good quality. Qualitative studies were assessed using the Critical Appraisal Skills Programme (CASP) [28].

Data synthesis

Descriptive data analysis was preformed to summarise study characteristics through proportions or percentages on study design and location, types of health professionals and patients targeted with the intervention, the hospital setting used and quality appraisal. Heterogeneity in intervention characteristics, measured outcomes, and small sample sizes did not allow for a meta-analysis. A narrative synthesis was performed to summarise and explain the intervention characteristics and potential effects. The intervention effectiveness (absolute difference) was measured for studies with intervention and control data (S4 Table). Due to the heterogeneity of intervention components, a domain directed intervention classification system was created (Table 1). We used the designed intervention classification system (Table 1), Proctor’s evaluative framework [21] and CFIR [22] as the sensitising lens for thematic analysis. Each study’s outcomes were mapped to Proctor’s implementation, service and client outcomes and implementation factors through CFIR’s domains and constructs. The development of themes and subthemes was informed from this overarching structure. Each study was checked and referred to as per the disease context (breast and ovarian cancer versus colorectal and endometrial cancer) as themes were incorporated into a narrative synthesis. Three reviewers (AC, NR, CJ) commented on and discussed a draft of the themes and sub-themes, and a final version was agreed.

Table 1. Classification of intervention components into four distinct domains.

Complex intervention [24] type Implementation strategies [23]
Education (health professional or patient) Face to face education
Online education
Written information
Family history collection proforma
Interdisciplinary practice Genetic counsellor at multidisciplinary team (MDT) meeting
Embedded Genetic counsellor in oncology
Genetic counsellor or oncologist facilitates communication
Genetics or oncologist led referral pathway
Patient navigators
Documentation (GC referral, GT outcomes and written information to facilitate mainstreaming) Use of electronic medical record (EMR) or MDT proforma
Testing protocol
Pathway or checklist
Standardised letters for results
Consent form
Systems (electronic or process) Smart text for EMR or pathology reporting
Synchronous scheduling of GC appointments
Shared GC referral or review e-mail inbox
E-mail alerts
E-mail notifications for referral
EMR GC referral
Result tracking

MDT multidisciplinary team, EMR electronic medical record, GC Genetic Counselling, GT Genetic testing.

Results

Study characteristics

Studies and location

Of the 2224 titles generated through database-searching (Fig 1), we included 27 [2955] studies of which 25 [2948, 5155] described interventions. The majority of included studies (44%) were from North America [3439, 41, 4447, 54] (Table 2). The 25 studies [2948, 5155] (93%) described interventions to increase access to GC and GT through mainstreaming or UTS initiatives (S4 Table). The study designs found were retrospective or prospective cohort studies with concurrent or historical controls (44%) [34, 36, 37, 4247, 54, 55] or case series that reported on intervention outcomes (56%) [2933, 35, 3841, 48, 5153] (Table 2). Two qualitative studies [49, 50] and eight of the intervention studies (with a qualitative or quantitative component) [2931, 33, 40, 48, 51, 54] described implementation outcomes that relate to acceptability and cost of interventions (Table 5, S4 Table).

Fig 1. Flow chart summarizing identification of studies for inclusion in this systematic review using PRISMA [25].

Fig 1

Table 2. Summary of included studies and participants’ characteristic.
Health professionals targeted Breast and ovarian cancer intervention (n = 20) Colorectal and endometrial cancer intervention (n = 5)
Number of studies/Total (%) References Number of studies/Total (%) References
Genetic counsellors 12/20 (60%) [29, 31, 33, 35, 37, 38, 41, 43, 46, 48, 53, 54] 3/5 (60%) [42, 44, 47]
Medical oncologists 13/20 (65%) [29, 3033, 37, 43, 45, 48, 51, 5355] 2/5 (40%) [42, 47]
Gynaecology oncologists 9/20 (45%) [29, 33, 35, 38, 39, 45, 46, 53, 55] NA
Clinical nurse specialists 5/20 (25%) [29, 30, 33, 37, 55] 3/5 (60%) [39, 41, 42]
Advanced nurse practitioners 3/20 (15%) [35, 38, 39] NA
Clinical geneticists 4/20 (20%) [37, 43, 48] 2/5 (40%) [42, 47]
Resident or fellow or trainee 2/20 (10%) [35, 37]
Other 1/20 (5%) [38, 45]
Pathologists NA 5/5 (100%) [39, 41, 42, 44, 47]
Surgeons NA 4/5 (80%) [41, 42, 44, 47]
Location all studies n = 27
North American and Canada 12/27 (44%) [3439, 41, 4447, 54]
United Kingdom 8/27 (30%) [29, 30, 31, 32, 40, 50, 51, 52]
Australia 5/27 (18%) [33, 48, 43, 42, 49]
Europe 2/27 (7%) [53, 55]
System setting n = 25
Single site urban hospitals 16/25 (59%) [29, 30, 33, 36, 37, 39, 40, 43, 46, 47, 51, 52, 55]
Large multi-site urban and regional hospital 6/25 (24%) [34, 35, 38, 41, 44, 53]
State wide systems 3/25 (12%) [43, 45, 54]
Unspecified health system 1/25 (4%) [42]
Study Design n = 27
Cohort 11/27 (40%) [34, 36, 37, 4244, 46, 47, 54, 55]
Case series 14/27 (51%) [2933, 35, 38, 3941, 48, 5153]
Qualitative 2/27 (7%) [49, 50]

Participants

Twenty-one studies included a variety of healthcare professionals (years of practice not indicated) exposed to the interventions (Table 2) and four studies did not specify the health professionals involved. The numbers of patients exposed to the intervention in the studies ranged from 16 to 1214. Nearly half of the studies (44%) [30, 32, 33, 36, 37, 41, 43, 46, 47, 51, 54] had fewer than 200 patients exposed to the intervention. Seventeen studies (68%) reported participants’ ages [29, 3133, 3537, 3941, 45, 46, 5155] and 14 (56%) reported subtypes of cancer [29, 3133, 35, 3740, 43, 45, 46, 51, 52].

Interventions, setting and framework

The majority of studies used complex interventions (Table 1, S4 Table) to increase access to GC and GT, either in the routine oncology setting [2940, 5155] or optimizing referral to genetic services for GC and GT [4547] for ovarian or breast cancers and through optimizing access to genetic services after UTS in colorectal and endometrial cancer [39, 4144]. The 25 studies spanned a variety of health systems (Table 2) with six studies (24%) included either a quality improvement or process model [3537, 39, 40] or an implementation science framework [42] to guide implementation. None of the studies used an evaluation framework to underpin the outcomes with a robust assessment of intervention effectiveness.

Quality assessment

Fifty-six percent of the studies (n = 14) received a poor AHRQ rating due to the study design–case series with no comparator [2933, 35, 3841, 48, 5153], selection bias in the use of a single site health system [29, 30, 39, 40, 47, 48] and/or no statistical adjustment for patient population differences or assessment of confounders [30, 42, 47] (S5 and S6 Tables).

Thirty-six percent of the studies received a fair to good AHRQ rating (n = 9) and were cohort studies with a historical or concurrent comparator [34, 36, 37, 4447, 54, 55]. Statistical analysis was preformed between intervention and control but were not adjusted for differences in patient population characteristics or confounders, apart from two studies [46, 54] that performed regression analysis (S4 Table). All studies except two [44, 45] had >80% of the patient population followed up in the study period.

Ninety-one percent (10/11) of historical or concurrent cohort studies had between 10 months to three and a half years when the intervention was implemented [34, 36, 4146, 54, 55], allowing sufficient follow up time for outcomes to be measured. The two qualitative studies [49, 50]. assessed using the CASP tool [28] reached a high-quality rating score with all questions (1–10) addressed in each study.

Mapping of outcomes and studies to framework

About two-thirds of studies (64%) measured the following outcomes to assess the adoption of the intervention at the service level; GC recommendation and referral, GC and GT completion rate and at the client level, through identification of hereditary cancer (68%) and treatment management impact (Table 3). About one-third of studies measured implementation level outcomes, acceptability through satisfaction with the intervention (32%) and cost effectiveness (16%). Studies focussed on the process domain of CFIR in relation to engaging with health professionals in the implementation effort (96%) and on executing (24%) using a process model or implementation framework to execute the implementation plan (Table 3). The available resource construct of the inner setting domain mapped to 96% of studies using the health professional as the resource for implementation efforts and access to knowledge and information about the intervention (64%), through education as a core component of the intervention. Twelve percent of studies mapped to the process domain-reflecting and evaluating through health professional’s feedback about the intervention. Characteristics of individuals—self-efficacy (16%) and outer setting—patients’ needs and resources (n = 6) or intervention characteristics–cost (16%) were also addressed (Table 3).

Table 3. Proctor et al.’s implementation outcome framework [21] and CFIR [22] applied to outcomes of included studies.
Domain Description Measure No. of intervention studies/Total (%)
Implementation outcomes and factors
Proctor et al. [21]. (hereafter ‘Proctor’)
Implementation outcomes
• the effects of deliberate and purposive actions to implement new treatments, practices, and services [21]
Acceptability
The perception among implementation stakeholders that a given treatment, service, practice, or innovation is agreeable, palatable, or satisfactory [21]

• Patients or healthcare professionals’ satisfaction with the mainstreaming intervention [2931, 33, 40, 48, 51, 54]
8/25 (32%)
Cost
The cost impact of an implementation effort [21]

• implementation cost of intervention or cost savings [29, 31, 40, 48]
4/25 (16%)
CFIR
Process
Reflecting & Evaluating
Quantitative and qualitative feedback about the progress and quality of implementation accompanied with regular personal and team debriefing about progress and experience [22]

• Healthcare professionals’ feedback about the intervention [40, 42, 54]

3/25 (12%)
Self-efficacy Characteristics of individuals
Individual belief in their own capabilities to execute courses of action to achieve implementation goals [22]

• Healthcare professionals’ belief about their ability to undertake intervention [29, 30, 33, 40]

4/25 (16%)
Intervention Characteristics Cost
Costs of the innovation and costs associated with implementing the innovation including investment, supply, and opportunity costs [22]

• implementation cost of intervention or cost savings [29, 31, 40, 48]

4/25 (16%)
Service outcomes and implementation factors
Proctor
Service Outcomes
• the extent to which services are safe, effective, patient -centred, timely, efficient, and equitable [56, 57]
Effectiveness
Providing services based on scientific knowledge to all who could benefit [56, 57]

• GC Referral [29, 3439, 41, 42, 44, 4648, 52, 53, 55]
• GC completed [3441, 44, 4648, 5154]
• GT completed [31, 3441, 44, 4748, 5155]
• Patients with identified gene mutations [29, 43, 3136, 39, 40, 41, 44, 48, 51, 52, 54, 55]

16/25 (64%)
Timeliness
Reducing waits and sometimes harmful delays for both those who receive and those who give care [56, 57]

• Time to GC or GT [3235, 52] and results [29, 3133, 54]

10/25 (40%)
Equity
Providing care that does not vary in quality because of personal characteristics [56, 57]

• GT access and undertaken [31, 3441, 44, 4748, 5155]
• GC referrals [29, 3439, 41, 42, 44, 4648, 52, 53, 55]

17/25 (68%)
16/25 (64%)
CFIR
Process
Executing
Carrying out or accomplishing the implementation according to plan [22]

• use of a quality improvement or process model [3537, 39, 40]
• use of an implementation science framework [42]

6/25 (24%)
Engaging
Attracting and involving appropriate individuals in the implementation and use of the intervention through a combined strategy of social marketing, education, role modelling, training, and other similar activities [22]

• Engaging health professionals through education or implementing the intervention [29, 3048, 51, 52, 54, 55]

24/25 (96%)
Inner setting Readiness for Implementation–Available resources
The level of resources dedicated for implementation and on-going operations, including money, training, education, physical space, and time [22]

• use of health professional as a resource for implementation [2948, 51, 52, 54, 55]

24/25 (96%)
Access to Knowledge & Information
Ease of access to digestible information and knowledge about the intervention and how to incorporate it into work tasks [22]

• use of education as a component of the intervention [29, 30, 32, 33, 3640, 42, 45, 46, 5154]

16/25 (64%)
Client outcomes and implementation factors
Proctor
Client Outcomes
Consumer wellbeing and clinical effectiveness [21]
Satisfaction
The consumers’ satisfaction with the intervention used [21]

• Patients satisfaction with mainstreaming intervention [2931, 48, 51, 52]

6/25 (24%)
Symptomology
Identifying hereditary cancer so that patients and health professionals can enact treatment management and cancer prevention strategies

• Identification of hereditary cancer [29, 43, 3136, 3941, 44, 48, 51, 52, 54, 55]
• Access or referral to cancer prevention information [29, 32, 45, 55]
• Treatment management impact [29, 33, 52, 55]

17/25 (68%)
4/25 (16%)
4/25 (16%)
CFIR
Outer setting
Patient Needs & Resources
The extent to which patient needs, as well as barriers and facilitators to meet those needs, are accurately known and prioritized by the organization [22]

• Patients satisfaction with mainstreaming intervention [29, 30, 31, 48, 51, 52]

6/25 (24%)

GC Genetic Counselling GT Genetic testing.

Intervention outcomes and implementation factors

The following themes describe the potential effects of complex interventions for the integration of GT in ovarian, breast, colorectal and endometrial cancer settings along with outcomes and factors at the implementation, service and client level.

Increasing access to genetic counselling and genetic testing in routine oncology for ovarian and breast cancer

Twenty-five studies described interventions to increase access to GC and completion of GT in breast and ovarian cancer patients through; referral rates to GC [29, 3439, 4648, 52, 53, 55], GC [3440, 4648, 5154] or GT completion [31, 3440, 4748, 5155], identification of hereditary cancer [29, 43, 3136, 40, 48, 51, 52, 54, 55], time to gain access to GT and results [29, 3133, 35, 45, 52, 54], treatment management impact [29, 33, 52, 55] and uptake of predictive testing in families [29, 32, 45] (S4 Table). The implementation strategies used were varied and classified under complex intervention type of education, documentation, interdisciplinary practice or electronic systems domains (Table 1). Twenty studies mapped to Proctor’s evaluative framework [21] at the service or client level measuring effectiveness through the outcomes outlined above [2940], [4346, 5155] (Table 3). CFIR [22] mapped to implementation process factors through the executing and engaging constructs with five studies using a quality improvement or process model [3537, 39, 40] carrying out implementation according to a plan and 20 studies engaging health professionals through education or implementing the intervention [2940, 43, 45, 46, 48, 51, 52, 54, 55] (Table 3).

Nine studies showed a potential positive effect in favour of the intervention having an impact mainly on GC referral [34, 36, 38, 43, 44, 46, 55] and GC and/or GT completion [34, 36, 38, 43, 45, 46, 55]. Thirteen studies revealed an unclear intervention impact in relation to all outcomes with no comparator presented for assessment [29, 31, 32, 33, 35, 39, 40, 47, 48, 5154].

Complex interventions—Education, documentation and electronic system

Four studies [36, 37, 45, 46] used complex interventions related to education, documentation and electronic system domains. One of these studies [36], employed a complex intervention consisting of education (patient and clinicians), documentation (smart text and written handouts in EMR and for patient) and electronic system (EMR documentation of GC referral and outcome in MDT, GC appointment scheduling). The outcomes assessed showed a significant difference in GC referral rates (+51.2 (95% CI 43.9–58.5) p ≤0.001), patients completing GC (+54 (95% CI 45.3–62.8) p ≤0.001) and GT (+13.2 (95%CI 3.3–23.3) p = 0.007), between the intervention and control [36]. Another study [37] used a complex intervention consisting of health professional and patient education (written information, family history collection proforma), documentation (EMR documentation of referral for GC/GT and testing protocol pathway) and systems (scheduling GC appointments directly at gynaecology clinic) showed a trend towards the intervention for GC referral (+27.4 (95% CI 11.1–43.7) p = 0.02) and completion of GT (+20.6 (95% CI 5.9–35.4) and towards the control for completion of GC (-27.8 (95% CI -46.7 to -9.1)) and identifying hereditary cancer (- 17.9 (95% CI– 40.9–5.1) p = 0.17). This study was limited by a small study sample size and short follow up period.

Two studies [45, 46] employed an education, documentation and systems complex intervention. The education (clinicians educated on EOC GC referral guidelines) and systems (use of smart text to refer all EOC to GC on the pathology report) intervention showed an absolute difference in eligible serous histology patients completing GC and GT (+13.7% (95% CI 7.6–19.1) [45] (Table 4).

Table 4. Implementation strategies in the various health system and professional settings grouped by complex intervention effects results.
Reference Population and setting Implementation strategies Absolute Difference % Framework mapping Study Quality and design
Group 1: Results significantly favour complex intervention
Uyar [36] 2018 USA Healthcare Professionals:
All gynaecology oncology providers non-specified
Patients: All women with EOC
Healthcare Institution:
Academic cancer centre
Education for patients and healthcare professionals
Handouts for patients
EMR documentation of GC/GT and/or referral
GC at MDT or documentation of GC and GT outcomes
Scheduling GC appointments
directly at gynaecology clinic
Rates of GC/GT recommendation in EHR (Electronic Health Record)
Outcome 1. Rates of GC/GT recommendation in EHR
+ 67.7% (95% CI 59.8–75.6) p value not provided
Outcome 2. GC referral
+51.2% (95% CI 43.9–58.5, p ≤0.001)
Outcome 3. GC completion
+54% (95% CI 45.3–62.8, p ≤0.001)
GT completion
+13.2% (95% CI 3.3–23.3, p = 0.007)
Outcome 4 Patients identified with BRCA mutations
+ 3.6% (95% CI -9.4–16.5, p = 0.68)
Service:
Effectiveness
• GC referral
• GC completion
• GT completion
• Patients with identified gene mutations
Equity
• GT access
• GC referrals
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge and information
Process
Engaging
• key stakeholders
Executing
Fair Quality
Cohort study with historical control
Single site health system and no analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system
Brown [38] 2018 USA Healthcare Professionals
Gynaecology oncologists
Breast surgeons
Genetic counsellors
Patient navigators
Advanced care providers
Patients:
All women with EOC
Triple Negative Breast Cancer < 60years
Breast Cancer < 45 years
Healthcare Institution:
Comprehensive not-for-profit system with more than 900 care locations in 2 states, including academic medical centres, hospitals, freestanding emergency departments, health care pavilions, physician practices, and outpatient surgical centres.
Patient navigators in gynaecologic oncology and breast surgery clinics.
Increase volume of GC and telemedicine consults
Education to all gynaecologic oncologists, breast surgeons, and advanced care providers on guidelines
Referral to GC was made a standard of practice
Outcome 1. GC referral
EOC
+59.7% (95% CI 50.2–69.4, p<0.05)
TNBC < 60 yrs
+21.2% (95% CI 10.6–31.8, p<0.05)
BrCa < 45 yrs
+6.3% (95% CI -1.0–13.5) p value not provided
Outcome 2. GT completion
EOC
+29% (95% CI 16.8–41.2, p<0.05)
TNBC < 60 yrs
+26.6% (95% CI 14.9–38.4, p<0.05)
BrCa < 45 yrs
+15.7% (95% CI -7.5–6.1, p<0.05)
Outcome 3. Patients identified with BRCA mutations
EOC
+7.5% (95% CI– 7.9–23, p = 0.53)
TNBC < 60 yrs
+0.22% (95% CI -8.2–12.6) p value not provided
BrCa < 45 yrs
-0.54% (95% CI -7.2–6.1) p value not provided
Service:
Effectiveness
• GT undertaken
• GC referrals
Equity
• GT access
• GC referrals
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge & information
• available resources
Process
Engaging
• key stakeholders
Poor Quality
Case series with no comparator to control
Miesfeldt [41] 2018 USA Healthcare Professionals:
Pathologist
Surgeon
Patient navigator—Oncology Nurse
Patients:
All colorectal and uterine cancer
Healthcare Institution:
Medical Centre Cancer Institute’s Cancer Risk and Prevention Clinic—community hospital and a state tertiary centre with a GC-supported cancer genetic program
Triggered GC referral after abnormal IHC and MSI
Pathology communication via e-mail to surgeon
Patient navigator to ensure follow through to GC for abnormal IHC and MSI
Outcome 1. GC referral
I: 16/16 (100.0)
C:12/12 (100.0)
p value not provided
Outcome 2. GC completion
+45.8% (95% CI 13.6–78.1, p = 0.020)
Outcome 3. GT completion
+12.9% (95% CI -24.7–50.4)
p value not provided
Outcome 4. Patients identified with BRCA mutations
+28.8% (95% CI -21.5–79.2)
p value not provided
Service:
Effectiveness
• GT undertaken
• GC referral
• GC apt uptake
Equity
• GT access
• GC referrals
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• available resources
Process
Engaging
• key stakeholders
Poor quality
Case series with no comparator for control
Heald [44] 2013 USA Healthcare Professionals:
Genetic Counsellor
Colorectal Surgeon
Pathologist
Patients:
All patients with colorectal cancer
Healthcare Institution:
Academic and tertiary (2 regional community hospitals) and primary care centres (multiple family health centres)
Triggered EMR GC referral after abnormal IHC and MSI to surgeon
EMR documentation of GC/GT and/or referral via email
GC embedded to increase communication of abnormal IHC to patients and facilitate referral
Shared GC e-mail to review all abnormal MSI and IHC from pathologist to GC
Outcome 1. GC referral
GC v No GC
+44.7% (95% CI 28.1–60.5, p<0.001)
GC & Surgeon v No GC
+26.5% (95% CI -1.2–54.2, p = 0.023)
Outcome 2. GC completion
GC v No GC
+39.8% (95% CI 20.9–58.8, p<0.001)
GC & Surgeon v No GC
+32.0% (95% CI 0.017–64)
p value not provided
Outcome 3. GT completion
GC v No GC
+39.8% (95% CI 21.1–58.5, p<0.001)
GC & Surgeon v No GC
+19.2% (95% CI -13.4–51.7)
p value not provided
Outcome 4. Patients identified with LS
GC v No GC
+22.5% (95% CI 7.7–37.2)
GC & Surgeon v No GC
+1.2% (95% CI -17.8–20.2)
p value not provided
Outcome 5. Time to appointment
GC v No GC1–413 days p<0.001
GC & Surgeon v No GC -164 days
p value not provided
Service:
Effectiveness
• GT undertaken
• GC referral
• GC apt uptake
Timeliness
• Time to GC apt
Equity
• GT access
• GC referral
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• available resources
Process
Engaging
• key stakeholders
Fair Quality
Cohort study with historical control
Single site health system with no analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system
Less than 80% of population followed up
Senter [34] 2017 USA Healthcare Professionals:
Gynaecology oncology and cancer genetics health professionals-unspecified
Patients:
All women with EOC
Healthcare Institution:
Large academic medical comprehensive cancer centre
GC embed in oncology services
EMR documentation of GC/GT and/or referral
Scheduling GC appointments directly at gynaecology clinic
Outcome 1. GC referral
+22.8% (95% CI 16.7–29.4, p<0.00001)
Outcome 2. GC completion
+45.5% (95% CI 33.6–57.6, p<0.00001)
Outcome 3. Time to gain access to GC
I: 1.67 months
C:2.52 months P< 0.01
Service:
Effectiveness
• GC referral
• GC and GT completion
Equity
• GT access
• GC referrals
• GT undertaken
Timeliness
• Time to GC apt
CFIR
Inner setting
Readiness for implementation
• available resources
Process
Engaging
• key stakeholders
Good quality
Cohort study with historical control
Group 2: Results trend towards complex or single unit intervention
Hanley [45] 2018 USA Healthcare Professionals:
Family practitioners
General obstetrician
Gynaecologists
Medical and gynaecology oncologists
Patients:
All patients with serous, endometroid and clear cell ovarian cancer type
Healthcare Institution:
State wide Hereditary cancer program
Education to healthcare professionals on GC and GT referral guidelines for ovarian cancer
Smart text including standard recommendation to refer to GC included on the pathology report
Outcome 1. GC and GT completion by histopathology
Serous
+13.7% (95% CI 7.6–19.1)
(OR = 4.70; 95% CI 2.89–7.62)
Endometrioid
-6.3% (95% CI -6.4 to– 2.4)
Clear cell
-3.3% (95% CI -6.2 to -0.4)
Unknown
-4.2%
P< 0.001 serous vs endometroid and clear cell cancers getting GT after 2010
Outcome 2. Patients identified with BRCA
Serous histopathology
+6.2% (95% CI -6.1 to 19.4, P = 0.519)
Outcome 3. Cancer prevention
Familial predictive GT uptake and mutation identification
Carrier tests
+0.73% p = 0.071
Family members identified as BRCA
+0.56% p = 0.009
Carrier tests per serous histopathology
+ 0.76% P = 0.098
Family members identified as BRCA positive
+0.65% P = 0.012
Service:
Effectiveness
• GT undertaken
• GC uptake
Equity
• GT access
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge and information
Process
Engaging
• key stakeholders
Fair to poor quality
Cohort study with historical control
Multisite health system but with no analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system
Unclear how many patients were followed up
Petzel [46] 2014 USA Healthcare Professionals:
Gynaecology oncologists
Genetic Counsellor
Patients:
All women with EOC
Healthcare Institution:
Primary academic metro Women’s Cancer Centre
EMR referral to GC
EMR documentation of GC referral
Use of referral guidelines and checklist
Outcome 1. GC referral
+12.7% (95% CI -0.04–25.4, P = 0.053)
Outcome 2. GC completion
+9.9% (95% CI– 0.41–20.4)
p value not provided
Service:
Effectiveness
• GC referrals
• GC uptake
Equity
• GT access
• GC referral
• GT undertaken
CFIR
Inner setting
Readiness for implementation
• access to knowledge and information
Process
Engaging
• key stakeholders
Good quality
Cohort study with historical control
Single site with regression analysis on the characteristics inherent in the control verses the intervention population or health system but no analysis on confounding variables
Cohen [43] 2016 Australia Healthcare Professionals:
Geneticist
Genetic Counsellor
Oncologists
Patients:
All patients with EOC < 70 years old
Healthcare Institution:
Metropolitan hospital
Genetics attendance at an MDT tumour board meeting in gynaecology oncology Outcome 1. GC referral
+25% (95% CI 13.6–36.4, P < 0.0001)
Outcome 2. GC completion
-7.4% (95% CI– 16.8 to 1.9)
p value not provided
GT completion
-16% (95% CI -32.9 to– 0.14)
p value not provided
Outcome 3. Patients identified with BRCA mutations
+1.9% (95% CI -22.9–26.9)
p value not provided
Service:
Effectiveness
• GC referral
• GT undertaken
Equity
• GT access
• GC referral
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Process
Engaging
• key stakeholders
Fair Quality
Cohort study with historical control
State-wide health system with no analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system
Lobo [55] 2018 Spain Healthcare Professionals
Medical oncologist
Cancer Nurse
Psychologist
General Surgeon
Gynaecologist
Patients:
Breast cancer patients
Healthcare Institution:
Single site urban hospital, Madrid Spain
Oncologist led pathway and communication
MDT oncology led
Outcome 1. Eligible for GC referral
+0.97% (95% CI -3.3–5.3)
p value not provided
Outcome 2. GC referral
+25.4% (95% CI 16.4–34.3, p < 0.0001)
Outcome 3.GT completion
-11% (95% CI -23.3–0.069)
p value not provided
Outcome 4. Patients identified with BRCA mutations
-5% (95% CI -18–8)
p value not provided
Outcome 5. Cancer prevention management impact
+22% (95% CI -16.2–60.3, p = 0.03)
Service
Effectiveness
• GC referral
• GC completion
• GT completion
Client
Equity
• GT access
GC referral
Cancer prevention
• Identification of hereditary Cancer
• cancer prevention strategies up taken
CFIR
Inner setting
Readiness for implementation
• available resources
Process
Engaging
• key stakeholders
Fair Quality Cohort study with historical control
Single site health system and no analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system
Unclear how many patients followed up
Group 3: Results with unclear complex intervention effect
George [29] 2016 UK Healthcare Professionals:
Gynaecology oncologist
Specialist nurse
Medical oncologist
Genetic Counsellor
Patients: All women with EOC
Healthcare Institution:
Publicly funded cancer unit at a major treating centre
Education for healthcare professionals
Testing protocol pathway
Handouts for patients and healthcare professionals
Standardised letters for results
Standardised consent form
Outcome 1. GC and GT referral
I: 207/207 100% C: NR
p value not provided
2.Time to gain access to genetic test results
I: Four-fold reduction in time to result C:NR
p value not provided
Outcome 3. Patients identified with BRCA mutations
I: 33/207; 16% C: NR
p value not provided
Outcome 4. Treatment management
I:132/207 (64%)
20/23 BRCA+—PARPi access
C: NR
I: 31/32 with mutations breast cancer surveillance
C: NR
p value not provided
Implementation:
Acceptability
• Satisfaction with mainstreaming intervention
Cost
• implementation cost
Service:
Efficiency
• Time to gain access to GT
Effectiveness
• GC referral
• Patients with identified gene mutations
Equity
• GT access
• GC referral
Patient centeredness
• Patients satisfaction with mainstreaming intervention
Client:
Cancer prevention
• Identification of hereditary Cancer
• Access to cancer prevention information
• Referral for cancer prevention
CFIR
Intervention Characteristics
• Cost
Inner setting
Readiness for implementation
• access to knowledge and information
Process
Engaging
• key stakeholders
Characteristics of Individuals
Self-efficacy
Poor Quality
Case series with no comparator to control
Single site health system
Kentwell [33] 2017 Australia Healthcare Professionals:
Gynaecology oncologist
Specialist nurse
Medical oncologist
Genetic Counsellor
Patients: All women with EOC
Healthcare Institution:
Publicly funded cancer unit at a major treating centre
Education for healthcare professionals
GC embed in oncology services
GC at MDT or documentation of GC and GT outcomes
Genetics led referral pathway and triage
Outcome 1: GC referral
+30.4% (95% CI 20.2–40.6, p≤0.001)
Outcome 2. Time to gain access to GC and results
GC referral
I:2014–15–42 days
2015-16- 54.5 days
GC referral to results
2014–15–106 days
2015-16- 140.5 days
C: NR
p value not provided
Outcome 3. Patients identified with BRCA mutations
I: 2014–2015
7/34; 20.6%
2015–2016
4/30; 13.3%
C: NR
p value not provided
Outcome 4. Familial predictive GT uptake
I:31/120 (28) C:NR
p value not provided
Implementation:
Acceptability
• Satisfaction with mainstreaming
Service:
Efficiency
• Time to gain access to GT and results
Effectiveness
• GC referral
• Patients with identified gene mutations
Equity
• GT access
• GC referral
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
-access to knowledge and information
- available resources
Poor Quality
Case series with no control
Single site health system
Tutty [48] 2019 Australia Healthcare Professionals:
Genetic counsellors
Geneticist
Gynaecology oncologist
Patients:
Women with EOC
Healthcare Institution:
Urban Australian Familial Cancer Centre
Genetic counsellor led telephone GC service for oncology services
Genetics lead referral pathway and triage
Outcome 1. GC referral
I: 284 C: NR
p value not provided
2. GC and GT completion
I: 284 C: NR
p value not provided
Outcome 3. Patients identified with BRCA mutations
I: 26/284; 9%
12/284; 4% variants of unknown significance (VUS)
C: NR
p value not provided
Implementation:
Acceptability
• Satisfaction with TGC intervention
Cost
• Implementation cost
Service:
Efficiency
• Cost of Resources to implement the intervention
Effectiveness
• GC referral
and completion rate
• GT completion
• Patients with identified gene mutations
Equity
• GT access
• GC referral
Patient centeredness
• Patients satisfaction with TGC intervention
CFIR
Intervention Characteristics
• Cost
Outer setting
Needs & Resources of Those Served by the Organization
Process
Engaging
• key stakeholders
Poor Quality
Case series with no comparator to control
Single site health system
Bednar [35] 2017 USA Healthcare Professionals:
Physicians
Genetic counsellors
Advanced practice providers Nurses
Clinical managers
Physician trainees
Patients:
All women with EOC
Healthcare Institution:
An academic cancer
centre’s (regional and main campus clinics)
Education and direct access to GT via gynaecology
Email notifications to refer
EMR documentation and referral to GC
Integrated genetic counsellor in oncology
Scheduling GC appointments to co-inside with gynaecology
Outcome 1–3. GC referral
I:561/1214 (46.2%) main campus clinic
PCGT 84/151 (55.6%) regional clinic
653/1214 (53.8%) outside institution
C: NR
p value not provided
I: AGCR 33/34 (97%) signed GC electronic referrals
14/72 (19.4%) email referrals
C: NR
p value not provided
Outcome 4. GT completion
I: 1214/1423 (85.3%) C: NR
p value not provided
Outcome 5. Patients identified with BRCA mutations
I: 217/1214 (17.9%) C: NR
p value not provided
Outcome 6. Time to gain access to GC
Absolute difference -119 days
p value not provided
Service:
Effectiveness
• GT undertaken
• GC referral
• GC apt uptake
Equity
• GT access
• GC referral
• GT undertaken
Timeliness
• Time to GC apt
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• available resources
Process
Engaging
• key stakeholders
Executing
Poor Quality
Case series with no comparator to control
Bednar [39] 2019 USA Healthcare Professionals:
Genetic counsellor
Gynaecology oncologists
Advanced practice registered nurses
Patients
Ovarian and uterine cancer patients
Healthcare Institution:
Regional hospital–single site with a gynaecology oncology clinic
Education for healthcare professionals
Integrated GC in gynaecology
EMR tracking and referral with e-mail notifications to refer
Outcome 1. GC referral
I: 48/57 (84.2%) C: NR
(p = 0.02)
Outcome 2. GC and GT completion
I: 43/48 (89.6%) completed GC
39/43(90.7%) completed GT
C: NR (p = 0.03)
Outcome 3. Patients identified with mutations
I: 8/39 (20.5%) C: NR
p value not provided
Service:
Effectiveness
• GT undertaken
• GC referral
• GC apt uptake
• TT undertaken
Equity
• GT access
• GC referrals
• GT/TT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge & information
• available resources
Process
Engaging
• key stakeholders
Executing
Poor Quality
Case series with no comparator to control
Single site health system
Percival [30] 2016 UK Healthcare Professionals:
Clinical nurse specialist in oncology
Medical oncologists
Patients:
All women with EOC
Healthcare Institution:
Single centre urban hospital
Online education on pre-test GC for nurses
Written information on BRCA testing for patients
Written information for results significance
Competency certificate after training complete for nurses
Clinical Nurse specialist providing pre-test GC
Outcome 1. Patient satisfaction
No difference in patient satisfaction between those consented by a nurse or a doctor
No patients refused GT, or requested a GC appointment before GT.
Implementation:
Acceptability
• Satisfaction with mainstreaming intervention
Client:
Patients satisfaction with mainstreaming intervention
CFIR
Inner setting
Readiness for implementation
• access to knowledge and information
Outer setting
Needs & Resources of Those Served by the Organization
Characteristics of Individuals
Self-efficacy
Process
Engaging
• key stakeholders
Poor quality
Case series with no comparator to control
Single site health system
Rahman [32]
2017 UK
Healthcare Professionals:
Medical/clinical oncologists
Patients:
All women with EOC
Healthcare Institution:
Tertiary oncology centre
Education for healthcare professionals
Testing protocol pathway
Handouts for patients and healthcare professionals
Standardised letters for results
Standardised consent form
Outcome 1. GT completion
I: 122/NR C: NR
p value not provided
Outcome 2. Patients identified with BRCA mutations
I: 18/122 (14.8%) C: NR
p value not provided
Outcome 3. Time to gain access to GT, results & GC referral
I: The time from sample receipt to result was between 14–48 working days—GC referral between 12–43
working days after MGT results
-20/56 (36%) had MGT
within 1 month of diagnosis
C: NR
No stats
Outcome 4. Treatment management impact
I: 11/18 (67%) no change in management
6/18 (33%) access PARP inhibitors
C: NR
No stats
Outcome 5. Familial predictive GT uptake
I: 11/ 15 family members of BRCA carriers having predictive GT
C: NR
No stats
Service:
Effectiveness
• GT undertaken
Equity
• GT access
• GT undertaken
Timeliness
• Time to access GT, results and GC referral
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge and information
Process
Engaging
• key stakeholders
Poor Quality
Case series with no comparator to control
Single site health system
Plaskoinska [31] 2016 UK Healthcare Professionals:
Genetic Counsellor
Oncologist
Study co-ordinator
Patients: All women with EOC
Healthcare Institution:
Rural and urban publicly funded hospitals of different sizes, ranging from smaller district general hospitals to large regional centres
Written information on pre-test GC for patients
Genetics co-ordinated mainstreaming pathway
Post–test GC by GC
Outcome 1. GT completion
I: 232/281 (83%) C: NR
p value not provided
Outcome 2. Patients identified with BRCA mutations
I: 18/232 (8%) C: NR
p value not provided
Outcome 3. Time to gain access to genetic test results
I: Consent to results
delivery 46 working days
C: NR
p value not provided
Implementation:
Acceptability
-Satisfaction with mainstreaming intervention
Cost
• Implementation cost
Service:
Effectiveness
• GC referral
• GT undertaken
Equity
• GT access
• GC referrals
• GT undertaken
Efficiency
-Time to gain access to GT results
Patient centeredness
-Patients satisfaction with mainstreaming intervention
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Intervention Characteristics
• Cost
Outer setting
Needs & Resources of Those Served by the Organization
Process
Engaging–key stakeholders
Poor Quality
Case series with no comparator to control
Single site health system
Cohen [47] 2016 USA Healthcare Professionals:
Medical Oncology
Gastroenterology
Surgery
Pathology Laboratory
Medical Genetics
Genetic Counselling
Patients:
Patients with colorectal cancer
Healthcare Institution:
An outpatient cancer care centre for oncology patients treated at a tertiary academic National Cancer Institute (NCI)-designated Comprehensive Cancer Consortium
Triggered GC referral after abnormal IHC and MSI
Handouts on referral process for LS for healthcare professionals
Results tracking by nurse
Shared GC e-mail to review all abnormal MSI and IHC
Electronic communication with doctor
Scheduling GC and CRC clinic appointments synchronously
Outcome 1. GC referral
+9.4% (95% CI -7.9–26.8)
p value not provided
Outcome 2. Completion of GC
+9.4% (95% CI -7.9–26.8)
p value not provided
Outcome 3. GT completion
+10% (95% CI -47.6–67.6)
p value not provided
Service: Effectiveness
• GT undertaken
• GC apt uptake
Equity
• GT access
• GT undertaken
CFIR
Inner setting
Readiness for implementation
• available resources
Process
Engaging
• key stakeholders
Poor Quality
Cohort study with historical control
Single site health system with no analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system
Kemp [40] 2019 UK Healthcare Professionals:
All gynaecology oncology and cancer genetics health professionals unspecified
Patients:
Breast cancer patients
Healthcare Institution:
Publicly funded cancer unit at a major treating centre–cancer genetics services available
Education for healthcare professionals
Testing protocol pathway
Handouts for patients and healthcare professionals
Standardised letters for results
Standardised consent form
Outcome 1: GT completion
I: 1184/1184 (100%) C: NR
p value not provided
Outcome 2. GC completion after GT
I: 115/117 (98.3%) C:NR
p value not provided
Outcome 3. Patients identified with BRCA mutations
I: 117/1184 (9.9%) C: NR
p value not provided
Implementation:
Acceptability
• Satisfaction with mainstreaming intervention
Service:
Effectiveness
• GT completion
• Patients with identified gene mutations
Patient centeredness
• Patients satisfaction with mainstreaming intervention
Equity
• GT access
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Intervention Characteristics
• Cost
Inner setting
Readiness for implementation
• access to knowledge & information
Outer setting
Needs & Resources of Those Served by the Organization
Characteristics of Individuals
Self-efficacy
Process
Engaging
Poor Quality
Case series with no comparator to control
Single site health system
Richardson l [54] 2020 Canada Healthcare Professionals:
Oncologists
Genetic counsellor
Patients:
Breast and ovarian cancer patients
Healthcare Institution:
Population state based cancer program in Canada
Oncologist led pathway and communication
Education for healthcare professionals
Written information for clinician use
Standardised consent form
Outcome 1. Acceptability
I: Patients indicated comfort and acceptability with the GT process—no difference between oncology clinic-based model (OCB) and the traditional model (TM). OCB M = 4.54, SD = 0.71 vs TM M = 4.52, SD = 0.69. See Table 5 below
C: NR
Outcome 2. GC completed
+58.6% (95% CI 49–68) and +8.5% (95% CI -8.2–25) in person and videoconference P< 0.001 OCB vs TM
Outcome 3. GT completed
+8.5% (95% CI -8.2–25 and +7.6% (95% CI -9.4–25, p = 0.015) OCB vs TM
Outcome 4. Patients identified with BRCA mutations
+3.1% (95% CI -6.7–13) p = 0.507 OCB vs TM
Outcome 5. Time to gain access to GT results
-212 days P< 0.001 OCB vs TM
Implementation:
Acceptability
• Satisfaction with mainstreaming intervention
Service:
Effectiveness
• GT undertaken
• GC referral
Equity
• GT access
• GC referral
• GT undertaken
Client:
Knowledge
Acceptability
Satisfaction
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge & information
• available resources
Outer setting
Needs & Resources of Those Served by the Organization
Process
Engaging
• key stakeholders
Reflecting & Evaluating
Good to Fair quality
Cohort study with concurrent control
State-wide health system with analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system
Representation of patient population selective–all patients didn’t complete survey. Small proportion of all patients included
Grinedal [53] 2020 Norway Healthcare Professionals:
Medical oncologist
General Surgeon
Gynaecologist
Genetic Counsellor
Geneticist
Patients:
Breast cancer patients
Healthcare Institution:
Regional and urban hospital in Norway
Education for healthcare professionals
Testing pathway
Written information for clinician use
Standardised consent form
Outcome 1. GC referral
I:131/356 (36.8%) C: NR
p value not provided
Outcome 2. GC completion
I:125/356 (34.6%) C: NR
p value not provided
Outcome 3. GT completion
I:125/131 (95.4%) C: NR
p value not provided
Service:
Effectiveness
• GC referral
• GC completion
• GT completion
Client:
Equity
• GT access
• GC referral
• GT undertaken
CFIR
Inner setting
Readiness for implementation
• access to knowledge & information
• available resources
Process
Engaging
• key stakeholders
Poor Quality
Case series with no comparator to control
Rumford [52] 2020 UK Healthcare Professionals:
All gynaecology oncology health professionals unspecified
Patients:
EOC patients
Healthcare Institution:
Publicly funded cancer unit at a major treating centre
Education for healthcare professionals
Testing protocol pathway
Handouts for patients and healthcare professionals
Standardised letters for results
Standardised consent form
Outcome 1. GC referral
I:255/268 (95%) C: NR
p value not provided
Outcome 2. GC and GT completion
I:255/268 (95%) C: NR
p value not provided
Outcome 3. Patients identified with BRCA mutations
I:34/255 (13.3%) C: NR
p value not provided
Outcome 4: Time to gain access to GT
I: Turnaround time between blood sample and return of GT result was 20.6 (11–42) calendar days
C: Turnaround time of 148.2 calendar days prior to I
Outcome 5. Treatment management impact
I: 9/34 received a PARPi
5/34 receiving platinum-based chemotherapy–clinician intent to initiate PARPi chemotherapy
15/34 still receiving first-line (adjuvant) treatment or in remission—not eligible for PARPi
5/34 ineligible to receive PARPi C: NR
p value not provided
Service:
Efficiency
• Time to gain access to GT
Effectiveness
• GC referral
• GC completion
• GT completion
Client:
Equity
• GT access
• GC referral
• GT undertaken
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge & information
• available resources
Process
Engaging
• key stakeholders
Poor Quality
Case series with no comparator to control
Single site health system
McLeavy [51] 2020 UK Healthcare Professionals:
Oncologist
Patients:
All EOC patients
Healthcare Institution:
Publicly funded tertiary referral centre
Education for healthcare professionals
Testing protocol pathway
Handouts for patients and healthcare professionals
Standardised letters for results
Standardised consent form
Outcome 1. Acceptability
I: Decision Regret Scale 9.14±12.397–14/29 (48.3%), reported no decision regret
26/29 (89.6%) were satisfied with their decision to pursue GT
Participants produced relatively low MICRA scores regardless of mutation status
C: NR p value not provided
Outcome 2. GC completion
I:170/170 (100%) C: NR
p value not provided
Outcome 3. GT completion
I:170/170 (100%) C: NR
p value not provided
Outcome 4. Patients identified with BRCA mutations
I:23/170 (13.5%) C:NR
p value not provided
Implementation:
Acceptability
• Satisfaction with decision to undergo GT
Service:
Effectiveness
• GT completed
• Patients with identified gene mutations
Patient centeredness
• Patients satisfaction with mainstreaming intervention
Equity
• GT access
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge & information
Outer setting
Needs & Resources of Those Served by the Organization
Process
Engaging
• key stakeholders
Poor Quality
Case series with no comparator to control
Single site tertiary hospital setting
Group 4: Results trend towards the control
Long [42] 2018 Australia Healthcare Professionals:
Medical oncologist
Surgeons
Pathologist
Genetic Counsellor and Geneticist
Radiation oncologist
Oncology nurses
Oncology and genetics admin
Palliative care
Patients:
Patients with colorectal cancer
Healthcare Institution:
NR
Education
Standardised text for pathology reports and interpretation handouts
Handouts on referral process for LS for healthcare professionals
EMR documentation of GC/GT and/or referral via email
MDT documentation of GC and pathology outcomes
Results tracking
Outcome 1. Eligible for referral to GC
Hospital A +7.24% (95% CI -2.3–17)
Hospital B -1.88% (95% CI -9.4–5.6)
Outcome 2. GC referral
Hospital A -25% (95% CI -71-20)
Hospital B +0.76% (95% CI -22-24)
Service:
Effectiveness
• GC referral
CFIR
Inner setting
Readiness for implementation
• access to knowledge & information
• available resources
Process
Engaging
• key stakeholders
Reflecting and evaluating
Poor Quality
Cohort study with historical control
Two hospital sites but with no analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system
Swanson [37] 2018 USA Healthcare Professionals:
Surgeon
Allied health staff
Nurse
Administrative
Resident and fellow,
Medical oncologist
Geneticist
Genetic counsellors
Patients:
All women with EOC
Healthcare Institution:
A tertiary care centre
Education for patients and healthcare professionals
Family history collection proforma
Handouts for patients
EMR documentation of GC/GT and/or referral
Testing protocol pathway
Scheduling GC appointments directly at gynaecology clinic
Outcome 1. GC referral
+27.4% (95% CI 11.1–43.7, p = 0.02)
Outcome 2. GC completion
-27.8% (95% CI -46.7 to -9.1)
p value not provided
Outcome 3. GT completion
+20.6% (95% CI 5.9–35.4)
p value not provided
Outcome 4. Patients identified with BRCA mutations
- 17.9% (95% CI– 40.9–5.1, p = 0.17)
Service:
Effectiveness
• GC referral
• GC and GT completion
Equity
• GT access
• GC referral
• GT undertaken
Client:
Cancer prevention
• Identification of hereditary Cancer
CFIR
Inner setting
Readiness for implementation
• access to knowledge and information
Process
Engaging
• key stakeholders
Executing
Fair Quality
Cohort study with historical control
Single site health system and no analysis on confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system

MDT multidisciplinary team, EMR electronic medical record, EHR electronic health record GC Genetic Counselling, GT Genetic testing, I intervention, C comparator, NR not recorded, TT tumour testing, UTS universal tumour screening, MSI microsatellite instability testing, IHC immunohistochemistry, TNBC triple negative breast cancer, BrCa breast cancer, CRC colorectal cancer, VUS variant of unknown significance, EOC epithelial ovarian cancer, LS Lynch syndrome, PARPi poly (ADP-ribose) polymerase inhibitor

A documentation (referral guidelines and checklist in EMR GC referral) and system (GC EMR referral) intervention study [46] did not appear to have an impact on completion of GC (+9.9 (95% CI– 0.41–20.4) p = 0.505), but had a significant effect on GC referral (+12.7 (95% CI -0.04–25.4) p = 0.053). Regression analysis showed the intervention (p = 0.009), hereditary risk of cancer (p < 0.0001), and patients living in the metropolitan zone (p = 0.006) affected GC referral rates between the intervention and control [46] (Table 4). Three of the above studies [36, 37, 45] were not controlled for confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system apart from one [46] and the above interpretation of casual intervention impact needs to be interpreted with caution.

Complex interventions with interdisciplinary practice

Three studies [34, 38, 55] included an interdisciplinary practice complex intervention using a genetic counsellor or oncologist. One study used an interdisciplinary practice (GC embedded into oncology), documentation (EMR GC and GT referral and completion) and system (GC appointment scheduling in oncology) complex intervention and led to a significant difference in GC referral (+22.8 (95% CI 16.7–29.4) p<0.00001) and GC completion rate (+45.5 (95% CI 33.6–57.6) p<0.00001) between the intervention and control [34]. Similarly, GT completion rate was impacted using an intervention consisting of education (oncology and breast health professionals’ education on guidelines), interdisciplinary practice (increase in volume of GC and telemedicine consults) and documentation (referral to GC was made a standard of practice) [38]. A significant difference in GT completion was found by cancer or histology type for EOC (+29% (95% CI 16.8–41.2) p<0.05), TNBC < 60 yrs (+26.6% (95% CI 14.9–38.4) p<0.05) or breast cancer < 45 yrs (+15.7% (95% CI -7.5–6.1) p<0.05) between the intervention and control [38] (Table 4). An oncologist led GT intervention [55] with multidisciplinary team (MDT) communication and case management led to significant increase in GC referral (+25.4% (95% CI 16.4–34.3) p < 0.0001) and cancer prevention management (+22% (95% CI -16.2–60.3) p = 0.03), with less of an effect on GT completion between the intervention and control [55]. Similarly, a genetic counsellor at the MDT led to a significant difference in GC referral rates (+25% (95% CI 13.6–36.4) (P < 0.0001) p < 0.0001), between the intervention and control [43] (Table 4).

Among the complex interventions described above the common components of education [45, 36] and use of EMR to document and ensure GC referral occurred [34, 36, 37, 46] appear to have potential effects on outcomes such as GC referral, completion and GT completion.

Complex interventions with no comparator

For the remaining seven studies, the composition of the interventions varied with five studies sharing a common complex intervention [29, 32, 40, 51, 52] in the UK and two studies from the USA [35, 39] and four studies with independent interventions [31, 48, 53, 54]. The complex interventions contained education [29, 32, 40, 35, 39, 51, 52], systems [35, 39], documentation [29, 32, 40, 35, 5154] and interdisciplinary practice [35, 48] components (S4 Table). The potential intervention effect in relation to GT and GC completion rates were unclear with no comparator present to quantify an effect.

Enhancing access to genetic counselling and genetic testing after universal tumour screening for colorectal and endometrial cancer

Five studies [41, 42, 44, 47, 39] described interventions aimed at enhancing access to GC and GT after UTS in colorectal and endometrial cancer (S4 Table). The interventions were varied with education, documentation, interdisciplinary practice or systems related domains (Table 1). The studies outcomes mapped to Proctor’s evaluative framework [21] at the service or client level measuring potential effectiveness through GC referral [39, 41, 42, 44, 47] or GC [39, 41, 44, 47], GT completion rate [39, 41, 44, 47] or identification of hereditary cancer [39, 41, 44] and timely access to GC [44] (Table 2). CFIR [22] process and inner setting implementation factors were mainly addressed through engaging with health professionals in education or implementing the intervention [39, 41, 42, 44, 47] and two studies executing the implementation according to a plan [39, 42].

Two of the five studies showed a potential positive effect in favour of the intervention due to enhanced GC referral [44], completion of GC and GT [41, 44] and more patients being identified with hereditary cancer [41, 44] (Table 4).

Complex interventions—Documentation and electronic system

Two studies [47, 41] used complex interventions, one consisting of education (handouts on LS referral process for clinicians) and systems (triggered GC referral after abnormal IHC and MSI, shared GC e-mail to review all abnormal MSI and IHC, electronic communication with physician, scheduling GC and CRC clinic appointments synchronously and results tracking by nurse) led to an absolute difference in GC referral (+9.4 (95% CI -7.9–26.8) and GC (+9.4 (95% CI -7.9–26.8) or GT completion (+10 (95% CI -47.6–67.6) but with no statistical significant difference shown [47] (Table 4). Similarly, a systems (triggered GC referral after abnormal IHC and MSI, pathology communication via e-mail to surgeon) and interdisciplinary practice (patient navigators to ensure follow through to GC for abnormal IHC and MSI) led to an absolute difference in GC (+45.8% (95% CI 13.6–78.1) p = 0.020) and GT (+12.9%, (95% CI -24.7–50.4) completion and the identification of hereditary cancer (+28.8% (95% CI -21.5–79.2) between the intervention and control, with no statistical difference found [41] (Table 4).

Complex interventions with interdisciplinary practice

One study consisting of interdisciplinary practice (GC embedded to review and communication abnormal IHC to patients and facilitate referral) and systems (triggered EMR GC referral after abnormal IHC and MSI to surgeon and documentation in EMR) complex intervention led to a significant difference in, GC referral (+44.7 (95% CI 28.1–60.5) p<0.001) and GC (+39.8% (95% CI 20.9–58.8) p<0.001) and GT (+39.8% (95% CI 21.1–58.5) p<0.001) completion rates between one arm of the intervention (genetic counsellor facilitation) and the control [44] (Table 4).

Among the complex interventions described above the common components of triggering GC referral after abnormal IHC results [41, 44, 47] and use of e-mail communication and review of IHC results between GC, pathology and surgeon [41, 47] appear to have potential effects on outcomes such as GC referral, completion and GT completion.

Complex interventions with no comparator

One study [39] had an unclear intervention effect in relation to GC referral, GT and tumour testing completion rate and identification of hereditary cancer [39], as no comparator was available for assessment (S4 Table). Of note, all studies described under this theme had small sample sizes and none were controlled for confounding variables or regression analysis on the characteristics inherent in the control verses the intervention population or health system. As such the above interpretation of casual intervention impact on outcomes measured should be interpreted with caution.

Efficiency and treatment management

Seven studies in breast and ovarian cancer measured the time taken to access GC or GT [32, 35, 52] and to receive the results of GT [29, 31, 32, 33, 54] after the intervention was implemented (Table 3). Six studies indicated efficiency in gaining access to GC and results [29, 3133, 52, 54] and one study noted a reduction in time to access GC [35] (Table 5). The complex intervention in four studies representing single site hospitals with either GC services available on site [29, 35] or off site [32, 33] and one multiple centre study with regional and urban sites had unclear GC access for each site [31]. Three studies [44, 45, 54] with a historical or concurrent comparator in ovarian [45, 54], and colorectal [44] cancer showed a potential effect of the intervention in the reduction in time to gain access to GC and enhancement of familial GT uptake.

Table 5. Implementation level outcomes of complex interventions in ovarian and subsets of breast cancer.
Study Design Acceptability Cost
George [29] 2016 UK Case series Satisfaction and comfort with mainstreaming intervention 13-fold reduction in genetics appointments with annual cost saving of 2.6 million
Quantitative I:105/105 patients were pleased to have had the genetic test
Survey 15/15 clinicians were comfortable with consenting for genetic testing
Patients and Health professionals C: NR
Percival [30] 2016 UK Case series I: 108/300 Nurse NR
Quantitative C: 192/300 Doctor
Survey No difference in patient satisfaction between those consented by a nurse or a doctor
Patients and Health professionals
I: 75/108 patients consented by nurses completed a questionnaire.
No patients refused GT, or requested a GC appointment before GT.
C: NR
Nurses satisfaction with pre-test GC training and role
I: 5/6 nurses found the BRCA training helpful and
saw BRCA testing was part of their role and felt supported.
C: NR
Plaskoinska [31] 2016 UK Case series I: 173/232 (75%) I: £121 229 mainstreaming pathway
Quantitative low psychological impact to GT compared to cancer diagnosis (p<0.001). C: £130 102 current standard pathway
Survey C: NR Absolute difference = £8,873
Patients I: 174/232 (75%) had enough information and time to decide to have GT
C: NR
Kentwell [33] 2017 Australia Case series A high level of comfort with; the process of consenting and delivering results NR
Quantitative Medical oncologists (n = 6),
Health professionals Less comfort in gynaecology oncologists and trainees (n = 5)
Tutty [48] 2019 UK Case series I:97.2% and 94.3% were satisfied with the timing of the telephone call and information provided (n = 107) I: $91.52 per woman tested (n = 72)
Quantitative C: NR C: $ 107. 37 SIGC (n = 52)
Survey Low score for decisional regret (M = 4.25) Absolute difference cost-saving—$15.85
Patients 72% of the women indicating they had no regret regarding TFGT
The psychological impact of receiving BRCA1/2 results was low
(M = 7.9, SD = 7.5 for a negative test result;
M = 16.8, SD = 9.7 for a positive test result;
M = 12.0, SD = .6.3 for a VUS result)
Kemp [40] 2019 UK Case series I: 129/259 patients surveyed I: 2,500 genetics appointments
Quantitative 128/128 (100%) -pleased to have GT 124/129 C: 50,000 genetics appointments
Survey 96.1% -happy that GT was via cancer team. 95% reduction in genetic consultation
Patients 23/23 (100%) of cancer team members reported feeling confident to do BRCA testing during their consultation and believed that the process worked well 85% reduction in time to test result
Discounted QALY of 2746 compared to no testing
McLeavy [51] 2020 UK Case series I: Decision regret scale M 9.14±12.397–14/29 (48.3%), reported no decision regret NR
Quantitative 26/29 (89.6%) were satisfied with their decision to pursue GT. Zero participants expressed clear dissatisfaction.
Survey All participants felt sufficient time had been given to consider the offer of mainstreamed genetic testing.
Patients Participants produced low MICRA scores
Distress M = 2.66 ± SD 4.108
Uncertainty M = 5.07± SD 4.154
Positive experiences M = 3.36± SD 4.093
Familial risk M = 7.05± SD 3.027
Ability to cope M = 0.26± SD 0.656 (coping harder with MGT)
M = 2.46± SD 2.134 (coping easier with MGT)
26/29 (89.6%) felt adequately supported by the oncology department.
Richardson [54] 2020 Canada Concurrent cohort 259/400 completed survey– 57/259 from the oncology clinic based (OCB) and 202/259 from the traditional model (TM) NR
Quantitative Patient Acceptability Scale
Survey OCB M = 4.54, SD = 0.71 vs TM M = 4.52, SD = 0.69
Patients 8/19 oncologists completed survey– 5/8 strongly agreed or agreed with ‘the process for carrying out multi-gene panel testing worked well’,
Healthcare professionals MICRA score–Distress
OCB M = 4.53, SD = 5.65 vs TM M = 3.37, SD = 5.24
Uncertainty
OCB M = 9.51, SD = 8.19 vs TM M = 10.02, SD = 6.88
Positive experience
OCB M = 6.00, SD = 5.78 vs TM M = 4.45, SD = 4.66
Decisional conflict scale
Uncertainty
OCB M = 22.57, SD = 19.52 vs TM M = 23.36, SD = 21.25
Informed
OCB M = 19.71, SD = 14.04 vs TM M = 18.04, SD = 17.38
Values Clarity
OCB M = 24.13, SD = 17.04 vs TM M = 24.22, SD = 19.73
Support
OCB M = 25.18, SD = 18.23 vs TM M = 26.61, SD = 20.94
Effective Decision
OCB M = 13.16, SD = 14.32 vs TM M = 15.21, SD = 19.43
Genetic Counselling Outcome Scale
OCB M = 120.17, SD = 16.78 vs TM M = 120.93, SD = 15.15
Shipman [50] 2017 UK Qualitative Motivations and Influences re Offers of GT NR
Interviews Genetic Testing was Just Not Disruptive in the Context of Cancer Diagnosis
17 Patients and Health Professionals Illustrative Quote “I mean I was going- I was going through chemo at the time an, you know, I just wanted to get through the chemo (laughing tone) I really didn’t really care about you know, as long as I was gonna be all right, that was all I was concerned about …And that’s made a big difference to my attitude to all the tests and studies and everything” (EOC patient with mutation identified)
Staff Anxieties
“Once they’ve had a diagnosis they’re bamboozled with the idea of all the treatment options in front of them or they might be post-surgical and facing chemo…and they’re probably not at the most receptive point to consider this. They’re already on this sort of rollercoaster, they’re in shock” (Research staff)
Meiser [49] 2012 Australia Qualitative Acceptance of TFGT NR
“It’s the same as having an operation. It’s not very pleasant but if you have to have it, you have to have it” (Invasive ovarian cancer patient eligible for BRCA testing)
Interviews Perceived advantages of TFGT
“But I just think that more information, yes it’s scary, but the more you know the better off you are to be able to make a decision” (Invasive ovarian cancer patient eligible for BRCA testing)
22 Patients Perceived need to make TFGT a routine test
“I believe that it should be incorporated into the overall testing because then it ultimately gives the treating oncologist like a much bigger picture and the full picture” (Invasive ovarian cancer patient eligible for BRCA testing)

GC Genetic Counselling, GT Genetic testing, I intervention, C comparator, NR not recorded, TFGT treatment focused genetic testing, OCB oncology clinic based, TM traditional model, MICRA Multidimensional Impact of Cancer Risk Assessment

System level outcome—Time efficiency

Two studies showed a reduction in time to receipt of GC [33, 35]. One study with a reduction of time within 42 and 54.5 days to GC and referral to results access within 106 and 140.5 days in two respective intervention time periods [33]. The other study reduced time to GC from 197 to 78 days when comparing the intervention and baseline times [35] and a fourfold reduction in time from GC to result was achieved in another study [29]. The time from sample receipt to result was reduced from 48 to 14 [32], 148.2 to 20.6 [52] days and post-test GC referral between 43 to 12 days [32]. Of note, sites with GC services available [29, 35] did not appear to show an advantage in time to gain access to GC in single site centres. However, the above studies did not compare the reduction in time to a comparator and firm conclusion cannot be drawn from the data presented.

Two studies with a historical or concurrent comparator [44, 54]—in the context of colorectal and ovarian cancer—showed a statistical difference with a reduction in time to gain access to GC. One study found a time reduction of 413 days (p<0.001) between intervention (when a GC was involved in receiving IHC results along with the surgeon and facilitated results communication between patient and making a GC referral) and control (no GC involved and all IHC results sent to surgeon and GC referral made at surgeon discretion) [44]. The other study showed a time reduction to gain access to GT results of 212 days (p<0.001) between the intervention (direct access to pre-test GC and panel GT through oncologists in an oncology clinic-based model with post-test GC provided by a genetic counsellor) versus the control (referral to GC) [54] (Table 4 and S4 Table).

Client level outcome—Treatment management

Four studies described the treatment impact of direct access to GT in routine oncology care for EOC [29, 33, 52, 55] (Table 4 and S4 Table). Treatment was informed in 132/207 of ovarian cancer patients either at first line therapy or relapse of their disease with 20/23 women [29] and 6/18 women with BRCA mutations gaining access to PARPi [32]. Ovarian cancer patients with BRCA pathogenic variants (32/33) had breast cancer surveillance [29] and breast cancer patients had significantly more risk reducing measures compared with the control (+22% (95% CI -16.2–60.3) p = 0.03) [55] with the oncologist led intervention (oncologist led pathway, communication and MDT) compared to control (usual care and referral pathway to a genetics unit). PARPi was received by 9/34 BRCA pathogenic variant women with ovarian cancer, with 5/34 indicated to initiate PARPi, in the future [52] (Table 4 and S4 Table).

Three studies described the family management of BRCA through the uptake of predictive GT in family members [32, 33, 45]. At risk family members accessed predictive GT with varying degrees from 31/120 [33] to 11/ 15 [32] in the study time period. Predictive GT and identification of BRCA carriers significantly increased per histology subtype in the intervention (education on benefit of GC referral for cancer prevention and inclusion on pathology reporting) arm from 2.54 to 3.27 (p = 0.071) and 1.62 and 2.18 (p = 0.009) compared to the control (usual care with no education or pathology reporting GC recommendations), respectively [45] in ovarian cancer families (Table 4 and S4 Table).

Implementation level outcome and factors

Eight studies assessed the acceptability of the intervention used to introduce routine GT into oncology care of EOC [2931, 33, 48, 51, 54] and for subsets of breast cancer patients [40, 54] (Tables 3 and 5). Four studies assessed satisfaction of the new process from the patients and healthcare professional perspective using survey style questions [29, 30, 40, 54] and mapped to CFIR outer setting of patient needs and resources. Implementation factors addressed through CFIR showed that only a minority of studies focused on reflecting and evaluation the implementation efforts through health professionals’ feedback about the intervention [40, 42, 54], their belief with regards to their ability to undertake the intervention [29, 30, 33, 40] and the cost or cost savings with such efforts [29, 31, 40, 48] (Tables 3 and 5).

Implementation level outcome—Acceptability

Two studies [29, 40] showed most patients were pleased to have had the genetic test and via the cancer team [40] and all healthcare professionals involved were comfortable with consenting for GT [29] and felt confident to provide BRCA testing, believing the process worked well [40]. Patient satisfaction between GT consented by a nurse or a doctor was not impacted amongst surveyed participants [30], with no patients refusing GT or requesting a GC appointment beforehand with nurses consenting [30]. The majority of nurses found the BRCA training helpful, saw BRCA testing as part of their role and felt supported [30]. Five studies assessed satisfaction either from the patient [31, 48, 51, 54] or the healthcare professional perspective [33, 54]. The majority of patients were satisfied with the timing of the telephone call, their decision to pursue GT [51] and the information provided, indicating they had sufficient information and time to decide to have GT [48, 51]. Overall, women indicated high scores of satisfaction based on the Genetic Counselling Satisfaction Scale (GCSS [58]) [48, 54]. Healthcare professionals indicated a high level of comfort with the process of consenting to and delivering results for GT amongst the medical oncologists [33, 54], but less so amongst the gynaecology oncologists and trainees [33]. All except two [48, 54] of the above studies used self-designed survey question with no validated measures of satisfaction to evaluate this aspect of acceptability. The reliability and validity of the results are limited in this regard.

Four studies evaluated the psychological impact of receiving GT during the cancer diagnosis and treatment period [31, 48, 51, 54]. Low patient scores on psychological impact to GT compared to their cancer diagnosis were found with validated measures such as the impact of events scale (IES) [59] and Depression, anxiety and stress scale (DASS -21 [60]) [31]. The only difference in population characteristics was younger age and mutation status, leading to more intrusive thoughts (IES intrusion r = −0.172, p = 0.026) and significantly more stress (DASS stress r = 0.162, p = 0.014) and cognitive avoidance scores based on BRCA pathogenic variant status, respectively [33]. Patients indicated a low score for decisional regret and psychological impact [48, 51, 54] of GT results, in relation to their decision to undergo treatment-focused genetic testing (TFGT) and receiving results [48]. Validated measures such as the decisional regret scale [61] and the multidimensional impact of risk assessment [62] were used respectively. Validated measures strengthen the results reporting acceptability of the new approach from the patients’ perspective and can be reliably reproduced in future studies on acceptability of interventions.

Two qualitative studies support the acceptability of routine GT in oncology for ovarian cancer patients [49, 50] (Table 5). Both the 12 ovarian patients who had TFGT and those who were asked hypothetically found the concept of TFGT to be acceptable and wanted it as a routine test to inform their care [49]. Seventeen patients and five staff members offered or involved in TFGT [31] did not see GT as disruptive in the overall experience of having a cancer diagnosis [50]. However, some staff expressed concern about overburdening recently diagnosed patients undergoing chemotherapy. Both qualitative studies support the implementation outcome of acceptability of incorporating GT into routine oncology.

Implementation level outcome—Cost

Four studies assessed the cost and resources needed to implement routine GT [29, 31, 40, 48] into oncology when mapped to both Proctor’s evaluative lens and CFIR intervention characteristics of cost (Tables 3 and 5). Two studies [29, 40] evaluated the reduction in genetics appointments and cost. A 13-fold reduction in genetics appointments, with an annual cost saving of 2.6 million for the mainstreaming pathway in ovarian cancer was found in one study [29]. Another study found a 95% reduction in genetic consultation, with an 85% reduction in time to test result for the mainstreaming pathway for subsets of breast cancer [40]. The cost of the pathway or testing per patient in the mainstreaming versus the traditional pathway showed a cost reduction of UK£8,873 [31] for the former and AUS $15.85 [48] for the later. A robust economic analysis was not evident in the above studies and many lacked a comparator to strengthen the evidence regarding cost reduction.

Discussion

This systematic review aimed to examine health system interventions used to increase the uptake of GC and GT in oncology services to identify hereditary breast, ovarian, colorectal and endometrial cancer. The evidence indicates that complex interventions have a potentially positive effect on GC and GT completion rates in oncology services. Twenty-five studies identified intervention characteristics, with eight of these also describing implementation factors that influenced access to GT, GC and identification of hereditary cancer. The health professional groups targeted by the interventions were varied. About one-quarter of studies included an implementation science model or framework to guide intervention design or implementation and high priority CFIR constructs were not always applied in studies to understand the implementation factors.

Many types of health professionals were targeted with the designed intervention mainly focusing on oncologists or surgeons, advanced practice nurses or clinical nurse specialists, pathologists or genetic counsellors. A broader range of healthcare professionals such as radiographers, gastroenterologists and colorectal surgeons could be included in future GT integration programs in oncology through breast or CRC screening programs, once these health professionals have been appropriately skilled [6365].

As described above, about one quarter of the studies included an implementation science framework or a quality improvement model to guide intervention design and implementation. However, the interaction between the intervention and the theory behind the strategies was not addressed from the above studies and thus limits generalizable lessons. Evidence based pre-implementation research underpinned with implementation theory is crucial in guiding the development and evaluation of interventions [66]. In future, more studies using a theory-based evaluation of implementation-level outcomes are needed to better understand intervention implementation efforts. Some high priority CFIR constructs identified by the Implementing GeNomics In PracTicE (IGNITE) [67] model were present in the included studies apart from intervention characteristics (relative advantage), individuals characteristics (knowledge and belief about the intervention) and inner setting (implementation climate). Future genomics implementation research incorporating all high priority constructs would aid in a broader understanding of genomics implementation factors in diverse contexts and systems.

Strengths and limitations

Our review provides a comprehensive and rigorous assessment of interventions to integrate GT in oncology. It is the first to assess GT mainstreaming programs and apply a recognised implementation science outcome [21] and determinant framework [22] to identify common client, service or implementation outcomes in assessing intervention effectiveness and implementation factors. The data aligned with some of the high priority CFIR constructs identified as important to assess in genomics implementation research. Most studies used complex interventions that can inform implementation strategies for future genomics implementation research.

Regarding limitations, the inclusion of a variety of study designs and intervention types precluded the conduct of a meta-analysis. With this variation, no specific quality measure was available to evaluate the diverse literature. The adaptation of the NOS addressed the potential bias in studies by developing specific implementation intervention assessment criteria (S5 and S6 Tables). Many studies had poor methodological design and reported on few outcomes across the implementation level. A lack of focus on implementation outcomes impacts the understanding of what will contribute to the longer-term sustainability of GT integration in health systems.

Across the included studies, there was a lack of consistency in classification of interventions and the strategies used to implement them. A classification system (Table 1) was created to apply parameters to intervention characteristics and provide a means to analyse a potential effect. However, the mechanisms and data that explain why an intervention may, or may not, yield change were unclear. Those studies that did use a framework or theory rarely addressed the interaction between these and the strategies selected. This limits the generalizable lessons that might have been learned from these studies. Finally, the calculated absolute difference value cannot conclusively provide accurate estimates about the impact of a particular component of an intervention due to the heterogeneity of intervention characteristics, variability of health systems and range of health professionals involved.

The majority of studies were single site, urban hospital settings, which limits generalisability. However, a wide variety of health systems structures implementing complex interventions were represented in the included studies, allowing understanding of the possible implementation strategies that may work in similar settings.

Implications for research and policy

Our findings indicate that complex interventions–using systems, education, documentation and interdisciplinary practice–have a potential positive effect on GC and GT outcomes in various cancer types. The majority of the studies were of small sample size and did not collect longitudinal data or utilize an evaluation framework to underpin the intervention effectiveness findings with an assessment of all outcomes at the client, service and implementation level. Future research requires more rigorous study and evaluation designs by examining the patient, provider, organization and policy levels of healthcare to improve health outcomes [66].

The optimisation of patient outcomes requires implementation research to align with the real-world problems and priorities of healthcare organisations [2]. As more GT is mainstreamed into routine oncology care, future interventions need to fit with organizational workflows and processes to encourage successful implementation. Hybrid study designs allow for simultaneous measurement of intervention and implementation effectiveness [68]. Similarly, step wedge designs allow interventions to be introduced and evaluated in a staged way and to compare the effects of implementation [69] across different hospital settings [70].

Furthermore, pre-implementation research that identifies organisation characteristics and barriers and then tailor interventions to address these adds value to the likely adoption of new innovations [71]. In our review, a minority of studies assessed acceptability as part of the intervention implementation efforts; evidence from other qualitative studies supports the acceptability and feasibility of integrating GT into oncology services [72]. Future research with a pre-implementation focus on implementation outcomes and defined intervention characteristics could enhance understanding of the factors that influence GT integration implementation efforts.

Conclusion

This systematic review contributes new knowledge to the genomics implementation field by summarizing and assessing the characteristics and outcome findings of mainstreaming GT programs and uptake of GT after UTS. The existing evidence on intervention effectiveness suggests GT mainstreaming programs increase access to GC and GT in oncology services. However, there is a significant gap in understanding the interaction between the intervention and implementation theory to harness generalizable implementation strategies. Future primary research studies with robust methodological quality informed by theory are required. Results from this systematic review could inform future implementation strategies to integrate genetics into routine care of oncology health systems.

Supporting information

S1 Table. Search strategy Medline, Embase, PsychINFO (ovid) up to 26.05.20*.

(PDF)

S2 Table. Search strategy CINAHL (EBSCO) up to 26.05.20*.

(PDF)

S3 Table. Inclusion and exclusion criteria for routine genetic testing integration intervention studies in oncology.

(PDF)

S4 Table. Complex interventions to increase genetic counselling, testing and identification of hereditary in ovarian, breast, colorectal and endometrial cancer.

(PDF)

S5 Table. Assessment of risk of bias of included cohort studies.

(PDF)

S6 Table. Assessment of risk of bias of included case series.

(PDF)

S1 File. References: Included studies.

(PDF)

S2 File. Definitions.

(DOCX)

S1 Checklist

(DOC)

Acknowledgments

The authors are grateful to Suzanne Hughes and Chelsea Carle for supporting the development of the systematic review process.

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

Research funding by a Cancer Council New South Wales PhD scholarship and a Translational Cancer Research Network Clinical PhD Scholarship Top-up award, supported by the Cancer Institute NSW supports ROS in the completion of her PhD studies in the Faculty of Medicine and Health at The University of Sydney. The funding bodies did not play a direct role in the design of the study or collection, analysis, and interpretation of data or in writing the manuscript.

References

  • 1.IOM (Institute of Medicine): Delivering High-Quality Cancer Care: Charting a New Course for a System in Crisis. Washington, DC, The National Academies Press, 2013 [PubMed] [Google Scholar]
  • 2.Koczwara B, Stover AM, Davies L, Davis MM, Fleisher L, Ramanadhan S, et al. Harnessing the Synergy Between Improvement Science and Implementation Science in Cancer: A Call to Action. JCO Oncology Practice. 2018;14: 335–340. 10.1200/JOP.17.00083 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Roberts M, Kennedy AE, Chambers DA, Khoury MJ. The current state of implementation science in genomic medicine: opportunities for improvement. Genet Med. 2017; 19:858–863. 10.1038/gim.2016.210 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.National Comprehensive Cancer Network (NCCN). Clinical Practice Guidelines in Oncology. Genetic/Familial high risk Assessment: Breast, Ovarian and pancreatic cancer. Version 1.2020. https://www.nccn.org/professionals/physician_gls/default.aspx#genetics_screening [Accessed: 28/06/2020]. [DOI] [PubMed] [Google Scholar]
  • 5.EviQ. Genetic Testing for Heritable Mutations in the BRCA1 and BRCA2 Genes. Australia Version 9: Cancer Institute NSW 2020. https://www.eviq.org.au/cancer-genetics/adult/genetic-testing-for-heritable-pathogenic-variants/620-brca1-and-brca2-genetic-testing#probability-of-a-heritable-pathogenic-variant [Accessed 28 June 2020].
  • 6.National Institutes of health and Care Excellence (NICE) CG164. Familial breast cancer clinical guideline 164, 2019. https://www.nice.org.uk/guidance/cg164 [Accessed 28 June 2020]. [Google Scholar]
  • 7.National Comprehensive Cancer Network (NCCN). Clinical Practice Guidelines in Oncology. Genetic/Familial High-Risk Assessment: Colorectal Version 3.2019. [Accessed 28 June 2020]. [Google Scholar]
  • 8.Monahan KJ, Bradshaw N, Dolwani S, Desouza B, Dunlop MG, East JE, et al. Hereditary CRC guidelines eDelphi consensus group Guidelines for the management of hereditary colorectal cancer from the British Society of Gastroenterology (BSG)/Association of Coloproctology of Great Britain and Ireland (ACPGBI)/ United Kingdom Cancer Genetics Group (UKCGG). Gut. 2020; 69:411–444. 10.1136/gutjnl-2019-319915 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.EviQ. Mismatch repair (MMR) genetic testing. Australia Version 6: Cancer Institute NSW 2019 https://www.eviq.org.au/cancer-genetics/adult/genetic-testing-for-heritable-pathogenic-variants/619-mismatch-repair-mmr-genetic-testing [Accessed 28 June 2020].
  • 10.Petelin L, James PA, Trainer AH. Changing landscape of hereditary breast and ovarian cancer germline genetic testing in Australia. Intern Med J. 2018; 48:1269–1272. 10.1111/imj.14058 [DOI] [PubMed] [Google Scholar]
  • 11.White S, Jacobs C, Phillips J. Mainstreaming genetics and genomics: a systematic review of the barriers and facilitators for nurses and physicians in secondary and tertiary care. Genet Med. 2020; 10.1038/s41436-020-0785-6 [DOI] [PubMed] [Google Scholar]
  • 12.Owusu Obeng A, Fei K, Levy KD, Elsey AR, Pollin TI, Ramirez AH, et al. Physician-Reported Benefits and Barriers to Clinical Implementation of Genomic Medicine: A Multi-Site IGNITE-Network Survey. J Pers Med. 2018; 10.3390/jpm8030024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Pi S, Nap-Hill E, Telford J, Enns R. Recognition of Lynch Syndrome Amongst Newly Diagnosed Colorectal Cancers at St. Paul’s Hospital. Can J of Gastroenterol Hepatol. 2017; 10.1155/2017/9625638 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Powell CB, Littell R, Hoodfar E, Sinclair F, Pressman A. Does the diagnosis of breast or ovarian cancer trigger referral to genetic counseling? Int J Gynecol Cancer. 2013; 10.1097/IGC.0b013e318280f2b4 [DOI] [PubMed] [Google Scholar]
  • 15.Jarvinen HJ, Aarnio M, Mustonen H, Aktan-Collan K, Aaltonen LA, Peltomaki P, et al. Controlled 15-year trial on screening for colorectal cancer in families with hereditary nonpolyposis colorectal cancer. Gastroenterology. 2000;118:829–34. 10.1016/s0016-5085(00)70168-5 [DOI] [PubMed] [Google Scholar]
  • 16.Evans DG, Harkness EF, Howell A, Wilson M, Hurley E, Holmen MM, et al. Intensive breast screening in BRCA2 mutation carriers is associated with reduced breast cancer specific and all cause mortality. Hered Cancer Clin Pract. 2016; 14: 8. 10.1186/s13053-016-0048-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Domchek SM, Friebel TM, Singer CF, Evans DG, Lynch HT, Isaacs C et al. Association of risk-reducing surgery in BRCA1 or BRCA2 mutation carriers with cancer risk and mortality. JAMA, 2010; 10.1001/jama.2010.1237 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Norquist BM, Harrell MI, Brady MF, Walsh T, Lee MK, Gulsuner S, et al. Inherited Mutations in Women With Ovarian Carcinoma. JAMA Oncol. 2016; 10.1001/jamaoncol.2015.5495 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Medical benefit Scheme Australia media release; http://www.mbsonline.gov.au/internet/mbsonline/publishing.nsf/Content/20200501-News Accessed 01.05.20
  • 20.Berg AO, Armstrong K, Botkin J, Calonge N, Haddow J, Hayes M et al. Recommendations from the EGAPP Working Group: genetic testing strategies in newly diagnosed individuals with colorectal cancer aimed at reducing morbidity and mortality from Lynch syndrome in relatives. Genet Med. 2009;11:35–41. 10.1097/GIM.0b013e31818fa2ff [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Proctor E, Silmere H, Van R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Policy Mental Health. 2011; 38: 65–76. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. 10.1186/1748-5908-4-50 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths C, et al. Standards for Reporting Implementation Studies (StaRI): explanation and elaboration document. BMJ Open. 2017;7:e013318. 10.1136/bmjopen-2016-013318 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Guise JM, Chang C, Viswanathan M, Glick S, Treadwell J, Umscheid CA et al. Systematic Reviews of Complex Multicomponent Health Care Interventions. Agency for Healthcare Research and Quality 2014;1–32. [PubMed] [Google Scholar]
  • 25.Moher D, Liberati A, Tetzlaff J, Altman DG. The PRISMA Group: preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097. 10.1371/journal.pmed.1000097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348 mar07 3:g1687. 10.1136/bmj.g1687 [DOI] [PubMed] [Google Scholar]
  • 27.Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp [Google Scholar]
  • 28.Critical Appraisal Skills Programme. CASP Checklists. 2013. https://casp-uk.net/wp-content/uploads/2018/03/CASP-Qualitative-Checklist-2018_fillable_form.pdf.
  • 29.George A, Riddell D, Seal S, Talukdar S, Mahamdallie S, Ruark E, et al. Implementing rapid, robust, costeffective, patient-centred, routine genetic testing in ovarian cancer patients. Sci. Rep. 2016; 10.1038/srep29506 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Percival N, George A, Gyertson J, Hamill M, Fernandes A, Davies E, et al. The integration of BRCA testing into oncology clinics. Br J Nurs. 2016;12:690–694 10.12968/bjon.2016.25.12.690 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Plaskocinska I, Shipman H, Drummond J, Thompson E, Buchanan V, Newcombe B, et al. New paradigms for BRCA1/BRCA2 testing in women with ovarian cancer: results of the Genetic Testing in Epithelial Ovarian Cancer (GTEOC) study. J Med Genet. 2016; 10.1136/jmedgenet-2016-103902 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Rahman B, Lanceley A, Kristeleit RS, Ledermann JA, McCormack M, et al. Mainstreamed genetic testing for women with ovarian cancer: first-year experience. J Med Genet. 2019;56:195–198. 10.1136/jmedgenet-2017-105140 [DOI] [PubMed] [Google Scholar]
  • 33.Kentwell M, Dow E, Antill Y, Wrede CD, McNally O, Higgs E, et al. Mainstreaming cancer genetics: A model integrating germline BRCA testing into routine ovarian cancer clinics. Gynecol Oncol. 2017;145:130–136. 10.1016/j.ygyno.2017.01.030 [DOI] [PubMed] [Google Scholar]
  • 34.Senter L, O’Malley DM, Backes FJ, Copeland LJ, Fowler JM, Salani R, et al. Genetic consultation embedded in a gynecologic oncology clinic improves compliance with guideline-based care. Gynecol Oncol. 2017;147:110–114. 10.1016/j.ygyno.2017.07.141 [DOI] [PubMed] [Google Scholar]
  • 35.Bednar EM, Oakley HD, Sun CC, Burke CC, Munsell MF, Westin SN, et al. A universal genetic testing initiative for patients with high-grade, non-mucinous epithelial ovarian cancer and the implications for cancer treatment. Gynecol Oncol. 2017;146 399–404. 10.1016/j.ygyno.2017.05.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Uyar D, Neary J, Monroe A, Nugent M, Simpson P, Geurts JL. Implementing a quality improvement project for universal genetic testing in women with ovarian cancer. Gynecol Oncol. 2018. 10.1016/j.ygyno.2018.03.059 [DOI] [PubMed] [Google Scholar]
  • 37.Swanson CL, Kumar A, Maharaj JM, Kemppainen JL, Thomas BC, Weinhold MR, et al. Increasing genetic counseling referral rates through bundled interventions after ovarian cancer diagnosis. Gynecol Oncol. 2018;149:121–126. 10.1016/j.ygyno.2018.01.033 [DOI] [PubMed] [Google Scholar]
  • 38.Brown J, Athens A, Tait DL, Crane EK, Higgins RVR, Naumann W, et al. A Comprehensive Program Enabling Effective Delivery of Regional Genetic Counseling. Int J Gynecol Cancer. 2018;28: 996–1002. 10.1097/IGC.0000000000001256 [DOI] [PubMed] [Google Scholar]
  • 39.Bednar EM, Sun CC, Camacho B, Terrell J, Rieber AG, Ramondetta L, et al. Disseminating universal genetic testing to a diverse, indigent patient population at a county hospital gynecologic oncology clinic. Gynecol Oncol. 2019;152: 328–333. 10.1016/j.ygyno.2018.12.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Kemp Z, Turnbull A, Yost S, Seal S, Mahamdallie S, Poyastro-Pearson E, et al. Evaluation of Cancer-Based Criteria for Use in Mainstream BRCA1 and BRCA2 Genetic Testing in Patients With Breast Cancer. JAMA Network Open. 2019; 10.1001/jamanetworkopen.2019.4428 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Miesfeldt S, Feero WG, Lucas FL, Rasmussen K. Association of patient navigation with care coordination in a Lynch syndrome screening program. Transl Behav Med. 2018. 23;8:450–455. 10.1093/tbm/ibx078 [DOI] [PubMed] [Google Scholar]
  • 42.Long JC, Debono D, Williams R, Salisbury E, O’Neill S, Eykman E, et al. Using behaviour change and implementation science to address low referral rates in oncology. BMC Health Serv Res. 2018. 18:904 10.1186/s12913-018-3653-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Cohen PA, Nichols CB, Schofield L, Van Der Werf S, Pachter N. Impact of Clinical Genetics Attendance at a Gynecologic Oncology Tumor Board on Referrals for Genetic Counseling and BRCA Mutation Testing. Int J of Gynecol Cancer. 2016;26:892–897. [DOI] [PubMed] [Google Scholar]
  • 44.Heald B, Plesec T, Liu X, Pai R, Patil D, Moline J, et al. Implementation of Universal Microsatellite Instability and Immunohistochemistry Screening for Diagnosing Lynch Syndrome in a Large Academic Medical Center. J Clin Oncol. 2013;31:1336–1340. 10.1200/JCO.2012.45.1674 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Hanley GE, McAlpine JN, Miller D, Huntsman D, Schrader KA, Gilks CB, et al. A population-based analysis of germline BRCA1 and BRCA2 testing among ovarian cancer patients in an era of histotype-specific approaches to ovarian cancer prevention. BMC Cancer. 2018; 18:254. 10.1186/s12885-018-4153-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Petzel SV, Vogel RI, McNiel J, Leininger A, Argenta PA, Geller MA. Improving Referral for Genetic Risk Assessment in Ovarian Cancer Using an Electronic Medical Record System. Int J of Gynecol Cancer. 2014;24:1003–1009. 10.1097/IGC.0000000000000148 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Cohen SA, Laurino M, Bowen DJ, Upton MP, Pritchard C, Grady WM. Initiation of Universal Tumor Screening for Lynch Syndrome in Colorectal Cancer Patients as a Model for the Implementation of Genetic Information Into Clinical Oncology Practice. Cancer. 2016; 393–401. 10.1002/cncr.29758 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Tutty E, Petelin L, McKinley J, Young M, Meiser B, Rasmussen VM, et al. Evaluation of telephone genetic counselling to facilitate germline BRCA1/2 testing in women with high-grade serous ovarian cancer. Eur J Hum Genet. 2019; 10.1038/s41431-019-0390-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Meiser B, Gleeson M, Kasparian N, Barlow-Stewart K, Ryan M, Watts K, et al. There is no decision to make: Experiences and attitudes toward treatment-focused genetic testing among women diagnosed with ovarian cancer. Gynecol Oncol. 2012;124:153–157. 10.1016/j.ygyno.2011.09.040 [DOI] [PubMed] [Google Scholar]
  • 50.Shipman H, Flynn S, MacDonald-Smith CF, Brenton J, Crawford R, et al. Universal BRCA1/BRCA2 Testing for Ovarian Cancer Patients is Welcomed, but with Care: How Women and Staff Contextualize Experiences of Expanded Access. J Genet Counsel. 2017; 26:1280–1291 10.1007/s10897-017-0108-5 [DOI] [PubMed] [Google Scholar]
  • 51.McLeavy L, Rahman B, Kristeleit R, Ledermann J, Lockley M, McCormack M, et al. Mainstreamed genetic testing in ovarian cancer: patient experience of the testing process. Int J Gynecol Cancer. 2020;30:221–226. 10.1136/ijgc-2019-000630 [DOI] [PubMed] [Google Scholar]
  • 52.Rumford M, Lythgoe M, McNeish I, Gabra H, Tookman L, Rahman N, et al. Oncologist-led BRCA ‘mainstreaming’ in the ovarian cancer clinic: A study of 255 patients and its impact on their management. Sci Rep. 2020. 10:3390 10.1038/s41598-020-60149-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Grindedal EM, Jørgensen K, Olsson P, Gravdehaug B, Lurås H, Schlichting E, et al. Mainstreamed genetic testing of breast cancer patients in two hospitals in South Eastern Norway. Fam Cancer. 2020;19:133–142. 10.1007/s10689-020-00160-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Richardson M, Jung Min H, Hong Q, Compton K, Wing Mung S, Lohn Z, et al. Oncology Clinic-Based Hereditary Cancer Genetic Testing in a Population-Based Health Care System. Cancers. 2020;12:338. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Lobo M, López-Tarruella S, Luque S, Lizarraga S, Flores-Sánchez C, Bueno O, et al. Evaluation of Breast Cancer Patients with Genetic Risk in a University Hospital: Before and After the Implementation of a Heredofamilial Cancer Unit. J Genet Couns. 2018; 27:854–862. 10.1007/s10897-017-0187-3 [DOI] [PubMed] [Google Scholar]
  • 56.Institute of Medicine (US) Committee on Crossing the Quality Chasm. Adaption to mental health and addictive disorder: Improving the quality of health care for mental and substance use conditions. Washington, DC: Institute of Medicine, National Academies Press; 2006. [Google Scholar]
  • 57.Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the quality chasm: A new health system for the 21st century. Washington, DC: Institute of Medicine, National Academy Press;2001. [PubMed] [Google Scholar]
  • 58.DeMarco TA, Peshkin BN, Mars BD, Tercyak KP. Patient satisfaction with cancer genetic counseling: a psychometric analysis of the genetic counseling satisfaction scale. J Genet Couns.2004;13:293–304 10.1023/b:jogc.0000035523.96133.bc [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Horowitz MJ, Hulley S, Alvarez W, Reynolds AM, Benfari R, Blair S, et al. Life events, risk factors, and coronary disease. Psychosomatics. 1979;20:586–92. 10.1016/S0033-3182(79)70763-8 [DOI] [PubMed] [Google Scholar]
  • 60.Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther 1995;33:335–43. 10.1016/0005-7967(94)00075-u [DOI] [PubMed] [Google Scholar]
  • 61.Brehaut J, O’Connor A, Wood T, Hack T, Siminoff L, Gordon E, et al. Validation of a decision regret scale. Med Decis Making. 2003;23:281–92. 10.1177/0272989X03256005 [DOI] [PubMed] [Google Scholar]
  • 62.Cella D, Hughes C, Peterman A, Chang C-H, Peshkin BN, Schwartz MD, et al. A brief assessment of concerns associated with genetic testing for cancer: the Multidimensional Impact of Cancer Risk Assessment (MICRA) questionnaire. Health Psychol. 2002;21:564. [PubMed] [Google Scholar]
  • 63.Manchanda R, Patel S, Gordeev VS, Antoniou AC, Smith S, Lee A, et al. Cost-effectiveness of Population-Based BRCA1, BRCA2, RAD51C, RAD51D, BRIP1, PALB2 Mutation Testing in Unselected General Population Women. J Natl Cancer Inst. 2018;110:714–725. 10.1093/jnci/djx265 [DOI] [PubMed] [Google Scholar]
  • 64.Manchanda R, Legood R. Population based germline testing for primary cancer prevention. Oncotarget. 2018; 9: 33062–33063. 10.18632/oncotarget.25995 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Veldwijk J, Lambooij MS, Kallenberg FGJ, van Kranen HJ, Bredenoord AL, Dekker E, et al. Preferences for genetic testing for colorectal cancer within a population-based screening program: a discrete choice experiment. Eur J Hum Genet. 2016; 24: 361–366. 10.1038/ejhg.2015.117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Brown CH, Curran G, Palinkas LA, Aarons GA, Wells KB, Jones L, et al. An Overview of Research and Evaluation Designs for Dissemination and Implementation. Annu Rev Public Health. 2017; 38:1–22 10.1146/annurev-publhealth-031816-044215 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Orlando LA, Sperber NR, Voils C, Nichols M, Myers RA, Wu R, et al. on behalf of the IGNITE Network. Developing a Common Framework for Evaluating the Implementation of Genomic Medicine Interventions in Clinical Care: The IGNITE Network’s Common Measures Working Group. Genet Med. 2018; 20:655–663. 10.1038/gim.2017.144 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care 2012;50:217–26. 10.1097/MLR.0b013e3182408812 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28:182–91. 10.1016/j.cct.2006.05.007 [DOI] [PubMed] [Google Scholar]
  • 70.Kallenberg FGJ, Aalfs CM, The FO, Wientjes CA, Depla AC,·Mundt MW, et al. Evaluation of an online family history tool for identifying hereditary and familial colorectal cancer. Fam Cancer. 2018;17:371–380. 10.1007/s10689-017-0041-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Damschroder LJ, Hagedorn HJ. A guiding framework and approach for implementation research in substance use disorders treatment Psychology of addictive behaviors. J Soc Psychol Addic Behav. 2011;25:194–205. [DOI] [PubMed] [Google Scholar]
  • 72.Scheinberg T, Young A, Woo H, Goodwin A, Mahon KL, Horvath LG. Mainstream consent programs for genetic counseling in cancer patients: A systematic review. Asia-Pac J Clin Oncol. 2020;1–15. 10.1111/ajco.13334 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Alvaro Galli

22 Feb 2021

PONE-D-20-35958

Health system interventions to integrate genetic testing in routine oncology services : a systematic review

PLOS ONE

Dear Dr. O'Shea,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Apr 08 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Alvaro Galli

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We would suggest  that some of the  information  at present shown in the Supplementary materials should be included in the main text; for example, the main text should contain a  table reporting all the included studies and their main characteristics, and the results of the quality assessment.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors present an extensive systematic review of interventions aiming to increase referrals to, and uptake of, genetic counseling and testing in oncology for breast, ovarian, and tumor screen-positive colon and uterine cancers. The summary tables represent an extraordinary amount of work, and there is clearly a high level of rigor in adhering to current standards for implementation science and reporting of systematic reviews.

My minor comments are as follows:

1) Line 69/70: There are already established clinical guidelines for GT for colon/uterine cancer; I don't think they are "emerging".

2) Line 88-89: The statement that "GT access is via referral to genetics services"; in many localities (particularly in the US) this is not the case; colorectal surgeons and oncologists and GYN oncologists have been ordering GT directly without referral to genetics clinics for many years.

3) Similarly for line 96/97: "GT is now being introduced..."-- GT has in fact been ongoing for nearly two decades; while there is quite a lot of heterogeneity in access and implementation and processes, I don't believe it is accurate to say that it is "now being introduced". At least in the US, the NCCN guidelines have had recommendations for routine testing of certain patient populations for many years.

4) Lines 133-161: It may be that the formatting and use of bullet points did not translate well into the manuscript, but the inclusion criteria should be stated more clearly and with more attention to grammar. It partly reads as a set of bullet point criteria, but starts out as though it will read as a sentence- this is confusing to the reader.

5) Lines 165-166: The sentence does not make sense-- I think you meant to say "Additionally, * a study was excluded* if the outcomes..... "

6) The results section overall is very comprehensive, but the text paragraphs summarizing each grouping is fairly dry, and does not really add much in the way of practical information to the reader. While the details are nicely presented in the tables, I think that readers who are looking to understand "which interventions have been most effective, and might they apply to my clinic" would like to see additional observations about specific interventions here. For example, the authors might note when a specific type of intervention (e.g. pathology report language; physician education) was a component of multiple studies showing an effect, or similar color; otherwise this section has little information to guide a reader who is a health care provider looking for evidence that a particular intervention might be effective. I appreciate that an implementation science audience would likely disagree with my suggestion though!

7) Similarly the use of p values in the majority of the results text is not as helpful as effect sizes; a p-value by itself is not informative and most journals are moving away from emphasizing p-values out of context.

8) I don't see a clear justification for why a positive genetic test result is a desired outcome- in practical terms, a completed test result has value whether it is positive or negative. For example, a woman with ovarian cancer who undergoes testing and does not have a BRCA1/2 mutation now knows that iPARP therapy is not likely to be useful. In studies of family members undergoing cascade testing, those who test negative for the familial mutation are released from high risk screening-- that is extremely valuable. While some studies certainly reported on mutation rates, the way this is presented in this manuscript implies that positive tests are a desirable outcome that "should be increased", in clinical practice this is not the case.

9) Line 467- should say "except" instead of "exempt"

10) Lines 567-571- Given the wide variety of practice settings and heterogeneity in oncology clinics around the world, I don't know that it is fair to imply that there are uncertainties about the "true effects of interventions...". While single site studies do limit generalizability, they are in fact very helpful for informing possible interventions that might be effective *at similar clinics*. For example, a clinic intervention that trains nurses to do pre-test consent and sees an increase in the proportion of ovarian cancer patients who complete genetic testing prior to starting treatment would be highly valuable for other clinics who do not have an on-site genetics clinic but do have nurses who have access to genetics training, while other clinics who have on-site "embedded" genetic counselors in their gyn clinic might not have a use for that particular intervention. In other words, heterogeneity is not necessarily a bad thing. I note that this may be more of a fact for US-based oncology clinics vs clinics in systems with universal health care where there is a more uniform approach.

Reviewer #2: The authors completed a SR on integrating genetic testing into routine oncology care. This SR covers a relevant research question and the authors report on key outcomes that are especially important for researchers trying to implement genomic programs. Although well written and the methods are well documented, a few minor comments are suggested below to help enhance the analysis.

Abstract:

• Line 43: what was the cutoff date? 2011-?

• Line 46: define complex intervention. Quantify “increase in access to genetic counseling and testing in routine oncology practice”. How much of an increase?

Background:

• Line 64: specify the type of genetic testing. Somatic vs germline testing.

• Line 111: provide an example of a single unit vs complex intervention

Methods

• Line 133: Although not required, it would be helpful to include timing/length of follow up as part of the inclusion/exclusion criteria.

• Line 193: double check how the tables/figures are numbered. Table 3 is mentioned here but Tables 1 and 2 were not mentioned prior to this.

• Line 201: how was the quality of RCTs assessed?

Results:

• Line 277: I like how the studies were mapped to outcomes and CFIR constructs. One challenge in implementing programs is knowing which outcomes and constructs to use and the optimal combination of them. These outcomes and constructs are reported individually, but what would be helpful from a practice standpoint is knowing the combination of constructs that studies implemented and seeing how that impacted outcomes. Perhaps the CFIR constructs could be included in Table 4?

• It’s a bit difficult to follow all the tables. Perhaps to simplify this, a diagram outlining how the studies were mapped to Proctor and CFIR could be diagrammed and mention of which table the results are in could be referenced in the figure. Just a thought to help the reader know which table to reference for specific information.

Tables:

• Is there a table where the study design is summarized? This would be helpful to know in tables such as Table 4.

• Table 1: I’m still confused about what a “complex intervention type” is. Is “Education” considered complex because there were 4 implementation strategies that were involved in a study? And what about the single units? Is there a list of these somewhere?

Supplemental materials:

• All titles for tables and figures should start with “Supplemental”.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Lisa Madlensky

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 May 19;16(5):e0250379. doi: 10.1371/journal.pone.0250379.r002

Author response to Decision Letter 0


18 Mar 2021

Dr. Alvaro Galli

Academic Editor

PLOS ONE

19.03.21

Dear Dr. Galli,

PONE-D-20-35958, entitled "Health system interventions to integrate genetic testing in routine oncology services: a systematic review"

We are grateful to the reviewers for taking the time to provide detailed and constructive feedback that has certainly improved the quality of our revised manuscript in both content and clarity. We thank the reviewers for acknowledging the rigor and reporting of the studies for our systematic review and the well written manuscript examining interventions and implementation factors for integrating genetic testing into routine oncology setting.

We have highlighted the changes in the revised manuscript and re-submitted a clean version for your consideration. Our detailed responses are as follows:

Journal Requirements

When submitting your revision, we need you to address these additional requirements.

1.COMMENT TO THE AUTHOR:

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

RESPONSE: The formatting of the title page has been revised as per the PLOS ONE template style above. See tracked changes on page 1. The heading style, table and figure and supporting information citations and captions have been updated as per required format. Reference list has been check to comply with Vancouver style referencing. Reference number 75 has been removed and replaced with the correct reference. See tracked changes throughout the manuscript.

2.COMMENT TO THE AUTHOR:

We would suggest that some of the information at present shown in the Supplementary materials should be included in the main text; for example, the main text should contain a table reporting all the included studies and their main characteristics, and the results of the quality assessment.

RESPONSE: The characteristics of the included studies including the study design characteristics are included in Table 2. Framework mapping and quality assessment including the study design have now been included in Table 4. Both of these points addressed as per reviewer 2 comment 4.

3.COMMENT TO THE AUTHOR:

We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

RESPONSE: Funding information has been corrected. There are no specific grant numbers to reference as the funding was through a scholarship award from both entities described and not specific grant funding.

4.COMMENT TO THE AUTHOR:

Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

RESPONSE: Caption information has now been included for supporting information at the end of the manuscript and cited in the text as Table in S1 Table, as per requirements indicated in the above link. See tracked changes throughout for citing and at the end of manuscript page 110 of tracked changed manuscript for captions.

REVIEWER 1

The authors present an extensive systematic review of interventions aiming to increase referrals to, and uptake of, genetic counseling and testing in oncology for breast, ovarian, and tumor screen-positive colon and uterine cancers. The summary tables represent an extraordinary amount of work, and there is clearly a high level of rigor in adhering to current standards for implementation science

and reporting of systematic reviews.

My minor comments are as follows:

1. COMMENT TO THE AUTHOR:

1. Line 69/70: There are already established clinical guidelines for GT for colon/uterine cancer; I don't think they are "emerging".

RESPONSE: We agree with the reviewer that clinical guidelines are established for GT for colon/uterine cancer. We have edited lines 69-70 to read “Established clinical guidelines for directing access to GT for endometrial and colorectal cancers exist in the USA, UK and Australia”

2. COMMENT TO THE AUTHOR:

Line 88-89: The statement that "GT access is via referral to genetics services"; in many localities (particularly in the US) this is not the case; colorectal surgeons and oncologists and GYN oncologists have been ordering GT directly without referral to genetics clinics for many years.

RESPONSE: We agree with the reviewer that direct access to GT in the USA has been available through surgeons and oncologists for many years. We have edited lines 89-94 to indicated direct access to GT is available and that Australia has only recently introduced this testing policy change in 2020. See track changes lines 89-94.

3. COMMENT TO THE AUTHOR:

Similarly for line 96/97: "GT is now being introduced..."-- GT has in fact been ongoing for nearly two decades; while there is quite a lot of heterogeneity in access and implementation and processes, I don't believe it is accurate to say that it is "now being introduced". At least in the US, the NCCN guidelines have had recommendations for routine testing of certain patient populations for many years.

RESPONSE: We agree with the reviewer that recommendations for routine testing for certain cancers has been available in the US for many years. To reflect the difference in timeframes in Australia where direct access to GT for CRC and EC patient populations has just been introduced in 2020, we have edited lines 98-104 to indicated how learning from other jurisdictions mainstreaming strategies can inform CRC and EC mainstreaming in Australia. See track changes lines 98-104.

4. COMMENT TO THE AUTHOR:

Lines 133-161: It may be that the formatting and use of bullet points did not translate well into the manuscript, but the inclusion criteria should be stated more clearly and with more attention to grammar. It partly reads as a set of bullet point criteria, but starts out as though it will read as a sentence- this is confusing to the reader.

RESPONSE:The formatting of the inclusion criteria section has been improved for clarity, grammar, sentence structure and the use of numbers and bullet points to stratify the criteria. See tracked changed manuscript lines 137-170.

5. COMMENT TO THE AUTHOR:

Lines 165-166: The sentence does not make sense-- I think you meant to say "Additionally, * a study was excluded* if the outcomes..... "

RESPONSE: We thank the reviewer for highlighting the need to clarify this sentence. We have edited as suggested above, see track changed manuscript lines 173-174.

6. COMMENT TO THE AUTHOR:

The results section overall is very comprehensive, but the text paragraphs summarizing each grouping is fairly dry, and does not really add much in the way of practical information to the reader. While the details are nicely presented in the tables, I think that readers who are looking to understand "which interventions have been most effective, and might they apply to my clinic" would like to see additional observations about specific interventions here. For example, the authors might note when a specific type of intervention (e.g. pathology report language; physician education) was a component of multiple studies showing an effect, or similar color; otherwise this section has little information to guide a reader who is a health care provider looking for evidence that a particular intervention might be effective. I appreciate that an implementation science audience would likely disagree with my suggestion though!

RESPONSE: The results section now includes more detailed description of the specific components of complex interventions that have shown a positive effect on outcomes. See tracked changed manuscript for detailed intervention component descriptions lines 344-358, 364-370,374-377,387-405. At the end of the results sections describing complex interventions lines 408-410 and 459-462 note when there is commonality in intervention components that showed a positive effect on outcomes.

7. COMMENT TO THE AUTHOR:

Similarly the use of p values in the majority of the results text is not as helpful as effect sizes; a p-value by itself is not informative and most journals are moving away from emphasizing p-values out of context.

RESPONSE: The results section now includes effect sizes and confidence intervals along with p values to detail better the potential effects of complex intervention types on outcomes. See tracked changed manuscript lines 344-358, 364-370,374-377,387-405. This information is also in Table 4 and S4 Table

8. COMMENT TO THE AUTHOR:

I don't see a clear justification for why a positive genetic test result is a desired outcome- in practical terms, a completed test result has value whether it is positive or negative. For example, a woman with ovarian cancer who undergoes testing and does not have a BRCA1/2 mutation now knows that iPARP therapy is not likely to be useful. In studies of family members undergoing cascade testing, those who test negative for the familial mutation are released from high risk screening-- that is extremely valuable. While some studies certainly reported on mutation rates, the way this is presented in this manuscript implies that positive tests are a desirable outcome that "should be increased", in clinical practice this is not the case.

RESPONSE: We agree that in practice a positive or negative genetic test results informs patient care. To re-focus the reader on the effects of interventions on GC referral and completion and GT completion lines 337-338 have been edited to remove “and minimally on patients identified with hereditary cancer” to remove implying a positive test result is a desired outcome. Additionally, throughout the results the focus on interventions effects on GC referral, completion and GT completion are reported and less so on positive mutation rate detection. See tracked changed manuscript lines 344-358, 364-370,374-377,387-405. However, as you mention mutation detection rates or identifying hereditary cancer has been reported as an outcome in 56% of included studies and remains listed in Tables 3 and 4 as an outcome reported.

COMMENT TO THE AUTHOR:

9) Line 467- should say "except" instead of "exempt"

RESPONSE:

We thank the reviewer for highlighting the need to edited this sentence. See track changed manuscript lines 476 for the correct use of the word “except”.

10. COMMENT TO THE AUTHOR:

Lines 567-571- Given the wide variety of practice settings and heterogeneity in oncology clinics around the world, I don't know that it is fair to imply that there are uncertainties about the "true effects of interventions...". While single site studies do limit generalizability, they are in fact very helpful for informing possible interventions that might be effective *at similar clinics*. For example, a clinic intervention that trains nurses to do pre-test consent and sees an increase in the proportion of ovarian cancer patients who complete genetic testing prior to starting treatment would be highly valuable for other clinics who do not have an on-site genetics clinic but do have nurses who have access to genetics training, while other clinics who have on-site "embedded" genetic counselors in their gyn clinic might not have a use for that particular intervention. In other words, heterogeneity is not necessarily a bad thing. I note that this may be more of a fact for US-based oncology clinics vs clinics in systems with universal health care where there is a more uniform approach.

RESPONSE: We thank the reviewer for this helpful and valid point regarding the positive aspects of heterogeneity in practice settings. We have edited lines 576-583 to recognise the limitations on generalisability of single site urban hospital settings and acknowledged that implementation lessons can still be garnered for similar clinic settings. We have deleted reference to the uncertainties of the true effects of the intervention as we agree this is not possible to prove. See track changed manuscript lines 576-583.

REVIEWER 2

The authors completed a SR on integrating genetic testing into routine oncology care. This SR covers a relevant research question and the authors report on key outcomes that are especially important for researchers trying to implement genomic programs. Although well written and the methods are well documented, a few minor comments are suggested below to help enhance the analysis.

1. COMMENT TO THE AUTHOR:

Abstract:

• Line 43: what was the cutoff date? 2011-?

• Line 46: define complex intervention. Quantify “increase in access to genetic counseling and testing in routine oncology practice”. How much of an increase?

RESPONSE: We thank the reviewer for their comments and have edited line 43 to reflect that studies up to May 2020 were included. A complex intervention is defined as (multiple components) now place in brackets after the word complex to clarify. An average rate of increase in access to genetic counselling and test completion has been included in lines 48-49, see tracked changed manuscript.

2. COMMENT TO THE AUTHOR:

Background:

• Line 64: specify the type of genetic testing. Somatic vs germline testing.

• Line 111: provide an example of a single unit vs complex intervention

RESPONSE: Line 64 has been updated to specify “cancer germline genetic testing (GT)…” See tracked changed manuscript line 65.

Lines 117-124 have been included to give more detail on defining a complex intervention and examples of a single unit versus complex intervention to demonstrate the difference.

3. COMMENT TO THE AUTHOR:

Methods

• Line 133: Although not required, it would be helpful to include timing/length of follow up as part of the inclusion/exclusion criteria.

• Line 193: double check how the tables/figures are numbered. Table 3 is mentioned here but Tables 1 and 2 were not mentioned prior to this.

• Line 201: how was the quality of RCTs assessed?

RESPONSE: Timing and length of follow up for studies with a control are reported in the Results under the quality appraisal section lines 271-274. We have not included in the inclusion criteria, as this factor was not used as an inclusion or exclusion item.

We thank the reviewer for highlighting the discrepancy in table numbering. We have deleted reference to Table 3 in the methods section line 237 and 240. Table numbering is now in order in the revised manuscript.

There were no eligible RCT found as per inclusion criteria in the review of studies, thus no reference to quality of RCT is included in the quality apprasial section. Mainly observational and qualitative studies were included and quality assessed

4. COMMENT TO THE AUTHOR:

Results:

• Line 277: I like how the studies were mapped to outcomes and CFIR constructs. One challenge in implementing programs is knowing which outcomes and constructs to use and the optimal combination of them. These outcomes and constructs are reported individually, but what would be helpful from a practice standpoint is knowing the combination of constructs that studies implemented and seeing how that impacted outcomes. Perhaps the CFIR constructs could be included in Table 4?

RESPONSE: All of the framework mapping results (Outcomes and CFIR) are now included in Table 4 to show which outcomes mapped to the frameworks. See tracked changes in Table 4. All of these framework mapping are also included in Table in S4 Table

• It’s a bit difficult to follow all the tables. Perhaps to simplify this, a diagram outlining how the studies were mapped to Proctor and CFIR could be diagrammed and mention of which table the results are in could be referenced in the figure. Just a thought to help the reader know which table to reference for specific information.

RESPONSE:Now that all framework mapping has been included in Table 4 we think that this will help the reader to follow the framework mapping results instead of having to go to the supplemental material

Tables:

• Is there a table where the study design is summarized? This would be helpful to know in tables such as Table 4.

RESPONSE: The study design are now included at the end of Table 2 and Table 4 in the Study Quality and design column.

• Table 1: I’m still confused about what a “complex intervention type” is. Is “Education” considered complex because there were 4 implementation strategies that were involved in a study? And what about the single units? Is there a list of these somewhere?

RESPONSE: Complex intervention is defined in more detail in lines 117-124 with an example of a single unit versus multicomponent interventions. An example of a single unit intervention is from Cohen et al43 that use one component - Genetics attendance at an MDT tumour board meeting in gynaecology oncology. The remainder of the intervention studies included used complex intervention types with multiple components.

Supplemental materials:

• All titles for tables and figures should start with “Supplemental”.

RESPONSE: All tables and figures now begin with Supplemental (S), see track changes in Supplemental material

None of the named authors have a conflict of interest, financial or otherwise.

Many thanks for considering our revised manuscript for publication. We look forward to learn of the outcome

Sincerely,

Rosie O Shea, BSc, MSc

Senior Genetic Counsellor

PhD Candidate, Faculty of Medicine and Health

University of Sydney

Sydney, Australia

Tel: +61 447733582

Email: rosie.oshea@sydney.edu.au

https://orcid.org/0000-0002-9186-1644

Decision Letter 1

Alvaro Galli

6 Apr 2021

Health system interventions to integrate genetic testing in routine oncology services : a systematic review

PONE-D-20-35958R1

Dear Dr. O' Shea,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Alvaro Galli

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: The authors did a great job addressing my comments (as well as the comments from the other reviewer). No further revisions are needed at this time. This is a valuable systematic review that adds to the literature in a meaningful way.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Acceptance letter

Alvaro Galli

15 Apr 2021

PONE-D-20-35958R1

Health system interventions to integrate genetic testing in routine oncology services: a systematic review

Dear Dr. O'Shea:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Alvaro Galli

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Search strategy Medline, Embase, PsychINFO (ovid) up to 26.05.20*.

    (PDF)

    S2 Table. Search strategy CINAHL (EBSCO) up to 26.05.20*.

    (PDF)

    S3 Table. Inclusion and exclusion criteria for routine genetic testing integration intervention studies in oncology.

    (PDF)

    S4 Table. Complex interventions to increase genetic counselling, testing and identification of hereditary in ovarian, breast, colorectal and endometrial cancer.

    (PDF)

    S5 Table. Assessment of risk of bias of included cohort studies.

    (PDF)

    S6 Table. Assessment of risk of bias of included case series.

    (PDF)

    S1 File. References: Included studies.

    (PDF)

    S2 File. Definitions.

    (DOCX)

    S1 Checklist

    (DOC)

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES