Skip to main content
BMC Health Services Research logoLink to BMC Health Services Research
. 2021 Jun 2;21:542. doi: 10.1186/s12913-021-06489-y

Comparing models of delivery for cancer genetics services among patients receiving primary care who meet criteria for genetic evaluation in two healthcare systems: BRIDGE randomized controlled trial

Kimberly A Kaphingst 1,2,, Wendy Kohlmann 1, Rachelle Lorenz Chambers 3, Melody S Goodman 4, Richard Bradshaw 5, Priscilla A Chan 3, Daniel Chavez-Yenter 1,2, Sarah V Colonna 1,6, Whitney F Espinel 1, Jessica N Everett 3,7, Amanda Gammon 1, Eric R Goldberg 8, Javier Gonzalez 9, Kelsi J Hagerty 1, Rachel Hess 10, Kelsey Kehoe 1, Cecilia Kessler 1, Kadyn E Kimball 1, Shane Loomis 11,12, Tiffany R Martinez 7, Rachel Monahan 3,7, Joshua D Schiffman 1,13, Dani Temares 3, Katie Tobik 1, David W Wetter 1,13, Devin M Mann 7, Kensaku Kawamoto 5, Guilherme Del Fiol 5, Saundra S Buys 1,14, Ophira Ginsburg 3,7; on behalf of the BRIDGE research team
PMCID: PMC8170651  PMID: 34078380

Abstract

Background

Advances in genetics and sequencing technologies are enabling the identification of more individuals with inherited cancer susceptibility who could benefit from tailored screening and prevention recommendations. While cancer family history information is used in primary care settings to identify unaffected patients who could benefit from a cancer genetics evaluation, this information is underutilized. System-level population health management strategies are needed to assist health care systems in identifying patients who may benefit from genetic services. In addition, because of the limited number of trained genetics specialists and increasing patient volume, the development of innovative and sustainable approaches to delivering cancer genetic services is essential.

Methods

We are conducting a randomized controlled trial, entitled Broadening the Reach, Impact, and Delivery of Genetic Services (BRIDGE), to address these needs. The trial is comparing uptake of genetic counseling, uptake of genetic testing, and patient adherence to management recommendations for automated, patient-directed versus enhanced standard of care cancer genetics services delivery models. An algorithm-based system that utilizes structured cancer family history data available in the electronic health record (EHR) is used to identify unaffected patients who receive primary care at the study sites and meet current guidelines for cancer genetic testing. We are enrolling eligible patients at two healthcare systems (University of Utah Health and New York University Langone Health) through outreach to a randomly selected sample of 2780 eligible patients in the two sites, with 1:1 randomization to the genetic services delivery arms within sites. Study outcomes are assessed through genetics clinic records, EHR, and two follow-up questionnaires at 4 weeks and 12 months after last genetic counseling contactpre-test genetic counseling.

Discussion

BRIDGE is being conducted in two healthcare systems with different clinical structures and patient populations. Innovative aspects of the trial include a randomized comparison of a chatbot-based genetic services delivery model to standard of care, as well as identification of at-risk individuals through a sustainable EHR-based system. The findings from the BRIDGE trial will advance the state of the science in identification of unaffected patients with inherited cancer susceptibility and delivery of genetic services to those patients.

Trial registration

BRIDGE is registered as NCT03985852. The trial was registered on June 6, 2019 at clinicaltrials.gov.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06489-y.

Keywords: Genetic services, Primary care, Health technology, Population health management

Background

Hereditary cancer syndromes affect patients’ risks of many common, adult-onset cancers [15]. Pathogenic variants (i.e., variants that increase cancer risk; PVs) in cancer predisposition genes can be identified in the germline of 7% of breast, 11–15% of ovarian [2, 68], 10% of colorectal [3, 9, 10], 4–11% of pancreas [11], and 12% of advanced prostate cancers unselected for age, family history, or ethnicity [12, 13]. Prior evidence supports individualizing cancer screening and prevention based on cancer risk for unaffected individuals without a personal history of cancer [1419].

Advances in genetics and sequencing technologies are allowing the identification of more individuals with an inherited cancer susceptibility who could benefit from tailored cancer screening and prevention recommendations. A growing number of genes have been associated with increased risks for breast, ovarian, colorectal, pancreas, and prostate cancers [7, 10, 11, 13, 2024]. Use of multi-gene panel testing can more than double the rate of detection of PVs compared to testing single genes [2528], and newer sequencing technologies are also expanding the tumor spectrum associated with particular genes. These factors are leading to a broader range of family histories being considered as an indication for genetic testing [29]. All these advances are leading to rapidly increasing numbers of unaffected patients who meet indications for genetic testing and highlight the need to develop novel ways to identify eligible patients and then deliver cancer genetics services. Our study, entitled Broadening the Reach, Impact, and Delivery of Genetic Services (BRIDGE), is addressing this gap.

Identification of unaffected individuals with hereditary cancer syndromes

Efforts to identify individuals with inherited cancer susceptibility have generally focused on first testing patients who have had cancer with subsequent testing of their unaffected at-risk relatives once a PV is found [3032]. However, this strategy misses families in which there is no living, affected relative to test, and may be an important barrier to accessing genetic services. Studies have begun to explore the feasibility of screening unaffected patients for inherited cancer susceptibility in primary care settings [3336]. In these settings, cancer family history information can be used to identify those most likely to carry a PV as well as to tailor screening regardless of whether a PV is identified [3743]. National guidelines recommend testing for unaffected individuals with a significant cancer family history [44], and the Affordable Care Act mandated coverage of genetic testing for hereditary breast/ovarian cancer for unaffected individuals with appropriate family history [45]. However, family history information is underutilized to stratify risk [4648], leading to missed opportunities for referral to genetic testing [49]. In one study, 37% of newly diagnosed breast cancer patients found to have PVs had a family history that warranted genetic testing prior to their diagnosis [50]. The National Health Interview Survey reported that only 9.5% of unaffected women with a family history of breast and ovarian cancer had discussed genetic testing with their healthcare provider, and only 2.7% had genetic testing [51].

Novel strategies are therefore needed to facilitate the use of family history information to identify unaffected individuals who may have inherited cancer susceptibility. Although some family history information is often collected in primary care settings, barriers to collecting or using this information in clinical practice include limited visit time; competing demands; reimbursement criteria; and providers’ training, knowledge and skills [47, 5256]. Primary care providers (PCPs) may not have specialized knowledge about genetics and genetic conditions or know who to refer for genetic services [57], and there may be limited availability of specialists outside of referral centers making the services difficult for many people to access, particularly those in rural areas. Many tools that are available to facilitate use of family history information in primary care require significant time and resources and were developed independent of workflow standards in clinics; as a result, widespread implementation of these tools has not occurred [48, 49]. System-level strategies, such as population health management, are needed to assist PCPs in identifying patients who may benefit from genetic services [58].

To address the need for a system-level population health management strategy, our team has developed an algorithm-based system to screen cancer family history information already available in the electronic health record (EHR) [59], and identify unaffected patients who receive primary care at the study sites and meet criteria for genetic evaluation for hereditary breast, ovarian, prostate, pancreas, and/or colorectal cancers [60, 61]. A pilot test conducted with 71 patients receiving primary care at University of Utah Health (UHealth) who were identified with the algorithm showed that the majority (62%) were successfully engaged through outreach from the cancer genetics team to consider genetics evaluation [62]. This algorithm forms the basis of a system-wide approach in the BRIDGE study to identify unaffected primary care patients meeting guidelines for genetic evaluation.

Models for delivery of cancer genetic services

Once unaffected individuals at risk for a hereditary cancer syndrome are identified, genetic services (e.g., genetic counseling, genetic testing, risk-reduction recommendations) need to be delivered. The number of trained genetic specialists is limited both in capacity and location, and more sustainable, and reimbursable, service delivery models are needed to accommodate an increasing patient volume [6365]. Therefore, the development and testing of innovative approaches to the delivery of cancer genetic services is essential.

Prior research has compared different delivery models for cancer genetic services [66]. A number of these studies have evaluated alternative modes of delivering pre- and post-test counseling by a genetic counselor [6769]. Studies comparing in-person and telephone counseling have found telephone counseling to be acceptable to patients, with no differences in knowledge, psychosocial outcomes, satisfaction, or patient-centered communication [66, 68, 70, 71]. However, uptake of genetic testing has been shown to be lower for telephone versus in-person counseling [68], and factors such as race/ethnicity, distress, and perceived risk may impact uptake of testing [72, 73]. Other studies have reported similar levels of knowledge, satisfaction, depression, and anxiety for in-person and video counseling [66, 70, 71, 74].

Fewer studies have explored supplementing genetic counselors with other models within the healthcare system [75, 76]. As referrals for hereditary cancer risk assessment increase [66, 70, 74, 77], models that direct genetic counseling time and resources to those patients with the greatest needs for in-person genetics care are warranted. Models are also needed that can reach rural and other underserved areas that may not be near genetics providers. Patient-directed approaches, in which patients seek the genetics information and services that they need, have promise as a service delivery model. One model of genetic testing that is patient-driven and has grown greatly in popularity is direct-to-consumer (DTC) genetic testing, in which consumers can order genetic testing directly and has minimal or no involvement from a clinician or genetic counselor [78]. While DTC approaches may increase access to genetic testing, it is unknown whether DTC genetic test results will be shared with primary care providers [79] or result in appropriate clinical management [8082]. Therefore, more effective genetic services delivery models may incorporate features of the DTC approach (e.g., patient-directed, increased access, accessible outside academic medical centers) while offering genetic testing within the healthcare system so that providers are aware of the results and have the support they need for using the results to individualize care.

Use of automated conversational agents (i.e., chatbots) may support a patient-directed genetic services delivery model for genetics education, decision making about genetic testing, and return of genetic test results. Chatbots have many advantages for patient education, including providing scripted education interactively, answering questions using natural language processing, chunking information into small segments that are easier to process, and allowing for choice in the amount of information received, consistent with adult learning recommendations [8385]. This technology is being used in a variety of healthcare contexts, including mental health care, health promotion, and facilitation of informed decision making related to prostate cancer screening [8690]. Chatbots are also being used in genetic services delivery such as collecting patient data, providing information, delivering results, and facilitating cascade testing of at-risk relatives [9195]. However, user responses to the technology need to be further investigated in the context of genetics, as there is a lack of research that has compared genetic services delivery through a chatbot to standard of care genetic services delivery models using a randomized design. Research on chatbots to date indicates that users would be receptive to use of this technology in health, although concerns related to accuracy, data privacy, and lack of empathy have been raised [95, 96]. Chatbots are therefore a promising technology for use in genetic services delivery, but additional research is needed to examine their efficacy and to investigate implementation outcomes [97] within healthcare systems.

Effects of genetic services delivery models across population subgroups

In examining the efficacy of genetic services delivery models, it is critical to explore how these effects may vary across population subgroups defined by factors such as race, ethnicity, and geographic location (i.e., rural/frontier vs. urban) to avoid worsening health disparities in access to care and health outcomes [98100]. Prior research has shown that individuals from minority racial and ethnic groups have decreased access to and utilization of genetic services [101104], even when cost barriers are minimized [105], and that race and ethnicity can modify the effects of genetic services delivery models. A randomized trial comparing in-person and telephone-based genetic counseling found that the effect of mode of delivery differed by race; women from minority groups who were assigned to telephone counseling were the least likely to complete genetic testing [72]. Less research has examined how geographic location may modify the effects of genetic services delivery models. Individuals in rural (< 100 persons per square mile) and frontier (< 7 persons per square mile) [106] areas in the U.S. have less access to care [107] and worse health outcomes [108112], In rural and frontier regions, clinics and hospitals can be hundreds of miles from patients’ homes, so rural and frontier residents have less access to specialty genetics care [56, 113, 114]. In addition, clinical sites in rural areas may not have providers with specialized genetics knowledge [115]. These prior findings indicate that exploring whether genetic services delivery models have similar effects across population subgroups is critical.

Aims of BRIDGE study

To address the research needs of developing system-wide population health management strategies to identify unaffected patients at risk for inherited cancer syndromes and delivering cancer genetic services effectively across population subgroups, we are conducting the BRIDGE randomized controlled trial (RCT) with patients who receive primary care at two large healthcare systems. The BRIDGE trial has the following specific aims:

  1. Identify unaffected patients receiving primary care who qualify for genetic risk assessment in two healthcare systems (UHealth and New York University Langone Health [NYULH]) using a clinical decision support algorithm to automatically evaluate family history of cancer through a population health management approach.

  2. Compare uptake of genetic counseling and testing for intervention (i.e., active outreach and automated, patient-directed education via a chatbot) vs. enhanced standard of care (i.e., active outreach followed by standard of care) genetic services delivery models among unaffected patients who receive primary care at each site.

  3. Compare adherence to clinical care recommendations and patient cognitive and affective responses for the genetic services delivery models.

The primary outcomes of the RCT will be uptake of genetic counseling, uptake of genetic testing, and, among those who receive genetic services, adherence to management recommendations from genetics providers. We hypothesize that uptake of genetic counseling and genetic testing will be equivalent between the two genetic services delivery models. We will also explore how race, ethnicity, and geographic location modify the effects of the cancer genetics services delivery models on these outcomes. In addition to the trial outcomes, we will assess implementation outcomes based on the RE-AIM (Reach, Efficacy, Adoption, Implementation, and Maintenance) framework (Table 1) [116, 117].

Table 1.

BRIDGE implementation outcomes

Dimension Metric
Reach (number of patients reached)

• Identification of patients who may have inherited cancer susceptibility (Aim 1)

• Identification of patients by race/ethnicity and rural/frontier vs. urban (i.e., representativeness) (Aim 1)

• Uptake of genetic counseling and genetic testing by race/ethnicity and rural/frontier vs. urban (Aim 2)

Efficacy (impact on clinical outcomes)

• Uptake of genetic counseling and genetic testing for genetic services delivery models (Aim 2)

• Adherence to cancer prevention and screening recommendations (Aim 3)

• Differences in impact of model by race/ethnicity and rural/frontier vs. urban (Aims 2 and 3)

Adoption (number of trial participants)

• Proportion of patients in patient-directed arm who complete pre-test education and request genetic testing (Aim 2)

• Proportion of patients in enhanced standard care arm who complete pre-test counseling and request genetic testing (Aim 2)

Implementation (fidelity to protocol)

• Patient response to patient portal messages (Aims 1 and 2)

• Completion of workflow by genetic counseling assistants and genetic counselors (Aim 2)

Maintenance (extent a program becomes institutionalized)

• Use of the clinical decision support algorithms to identify patients after trial enrollment is complete

• Continued use of genetic services delivery models after the trial is complete

Methods

Study overview

We are conducting a RCT to compare uptake of genetic counseling and testing and patient adherence to management recommendations for automated, patient-directed versus enhanced standard of care cancer genetics services delivery models. We are enrolling unaffected patients receiving primary care who are eligible for cancer genetic testing based on current National Comprehensive Cancer Network (NCCN) guidelines at two healthcare systems (UHealth and NYULH). We are enrolling patients through outreach to a randomly selected sample of 2780 patients (1280 at UHealth and 1500 at NYULH). Eligible patients are identified using an open clinical decision support (CDS) infrastructure designed to extract cancer family history information available in the EHR. Identified patients are randomized 1:1 at each site prior to outreach to the study arms: automated, patient-directed intervention genetic services delivery model and enhanced standard of care control genetic services delivery model (Fig. 1). The study design is based on patient-level randomization because the outreach and clinical care in both arms is delivered centrally through the genetics clinic in each system with minimal need for involvement by the primary care clinic or PCP. Study outcomes are assessed through the EHR and two follow-up questionnaires at about 4 weeks and 12 months after last genetic counseling contact. The trial has been approved as a single IRB protocol by the participating universities.

Fig. 1.

Fig. 1

Study flow diagram for BRIDGE protocol

Participants

We have created an open standards-based clinical decision support algorithm that identifies patients who receive primary care at the study sites and are eligible for genetics evaluation [62]. The algorithm utilizes structured cancer family history data available in the EHR [59] and identifies unaffected patients who meet modified 2018 NCCN guidelines for genetic testing for hereditary breast/ovarian and colorectal cancer syndromes based on their family history (Table 2). The platform was designed to be interfaced with different EHR systems via the Health Level Seven International Fast Healthcare Interoperability Resources (FHIR) standard and was deployed initially in the Epic® EHR in use at the UHealth healthcare system. UHealth is one of the largest healthcare systems in the Intermountain West region, providing care for 1.2 million residents of six states in a referral area encompassing more than 10% of the continental U. S with vast rural and frontier regions. We have adapted the algorithm for the NYULH system, which serves a large, diverse population in New York, including over 300 ambulatory sites and affiliate hospitals in Manhattan, Brooklyn, and Long Island.

Table 2.

Adapted criteria for genetic testing to identify eligible participants

FDR or SDR diagnosed with the following regardless of age: ovarian cancer, pancreas cancer
FDR or SDR diagnosed with the following < 50 years of age: breast cancer, colorectal cancer, endometrial cancer
Three or more relatives on the same side of the family diagnosed with the following clusters of cancer regardless of age:
 Breast cancer, ovarian cancer, pancreas cancer, prostate cancer
 Colorectal cancer, endometrial cancer, ovarian cancer, pancreas cancer, cancer of the urinary tract, brain, small intestine
 Melanoma, pancreas cancer
Ashkenazi Jewish ancestry and family history of breast cancer, ovarian cancer, pancreas cancer, prostate cancer

FDR first-degree relative, SDR second-degree relative

In addition to having a cancer family history meeting NCCN criteria for genetic evaluation, all patients identified as eligible for the trial are English- or Spanish-speaking, between the ages of 25 and 60 years, had a primary care appointment in one of the two participating healthcare systems in the previous 3 years, have not had a prior cancer diagnosis other than non-melanoma skin cancer, and have not had prior genetic counseling or testing related to hereditary cancer. We selected the 25–60 years age range because screening and prevention recommendations can be modified for those in this range with inherited cancer susceptibility or familial risk [118122]. For the study we are defining primary care as internal medicine and family medicine at both sites. In addition, because many patients (23%) in the UHealth system receive primary care through obstetrics/gynecology clinics, we will also select UHealth patients who have had a primary care appointment in these clinics in the previous 3 years. To be eligible for the trial, patients need to have an electronic patient portal (MyChart in Epic®) account because of its use for outreach in both study arms. Patients identified as meeting the algorithm who do not have an account are contacted by mail or telephone about creating one. Those who opt not to create an account are ineligible for the trial but are offered standard of care genetic services.

Procedures

The list of patients receiving primary care who are identified by the CDS algorithm as meeting criteria for genetic evaluation was entered into a population health registry in Epic® at each of the two sites, which allows the registry to be used for tracking eligible patients and managing outreach. The registry indicates to which arm the patient is randomized, with 1:1 randomization to the patient-directed or enhanced standard of care arm. Randomization was predetermined by the study biostatistician, who has no patient contact and is masked to patient condition. One week prior to outreach in either arm, a patient’s PCP is notified that the patient will be contacted. The subsequent procedures then vary between study arms as described below.

Enhanced standard of care arm

In the control enhanced standard of care arm, patients are first sent an electronic message through the MyChart patient portal indicating that genetic services are recommended for them. The message encourages patients to contact the genetics clinic within the appropriate healthcare system (UHealth or NYULH) to schedule a genetic counseling appointment. If the patient does not respond to the message, they receive a reminder patient portal message 1 week later and up to two follow-up telephone calls from a genetic counseling assistant (GCA). Procedures after this point follow standard workflow of the clinics. Interested patients are scheduled for a usual care pre-test genetic counseling appointment. These visits may be conducted by phone, telehealth, or in person at a designated time during clinic hours and with a certified genetic counselor following clinical standard of care. Patients who choose to proceed with genetic testing can give a sample of blood or saliva if seen in person. If counseled by telephone or telehealth, they are sent saliva collection kits which can be returned by mail; this service is offered by several commercial laboratories. All genetic test results are reviewed and returned by a genetic counselor either by phone or in person, based on patient preference. A copy of the results and letter with tailored cancer screening recommendations prepared by a genetic counselor are returned to the PCP. Patients who do not respond to initial outreach attempts are sent a final electronic message letting them know how to access genetic services in the future.

Automated, patient-directed arm

In the intervention automated, patient-directed arm, patients are first sent an electronic message through the MyChart patient portal indicating that genetic services are recommended for them. The message includes a link with instructions to complete the pre-test education chat with the chatbot through the online platform. If the patient does not complete the chat, they receive a reminder patient portal message 1 week later and up to two follow-up telephone calls from a GCA. Following the completion of the pre-test education chat, a transcript is added into the patient’s EHR as an outreach encounter to document the education received. A GCA contacts each patient who completes the chat to review their decision about testing and complete a comprehensive family history. If the patient opts to proceed with testing, the GCA explains the genetic testing process and payment options and places the genetic testing order. The encounter is documented in the EHR using a clinic note template that is signed by a genetic counselor.

Patients in this arm who opt to have genetic testing are sent a saliva collection kit as described above. If the genetic sample is not returned to the lab within 30 days of order, the patient receives up to one reminder phone call and two electronic messages through the patient portal. All genetic test results are reviewed by a genetic counselor. Patients with negative results receive an electronic message in the patient portal which contains a link to a negative return of results chat with the chatbot. Transcripts of completed negative return of results chats are added to the patient’s EHR to document the encounter. Patients with PVs or variants of uncertain significance (VUS) have results returned by a genetic counselor via a telephone or telehealth visit. All patient test results (i.e., positive, VUS, negative) are uploaded to the patient portal along with a letter of tailored screening recommendations written by the genetic counselor. The patient’s PCP is also sent a copy of all documentation via Epic.

Both chats in the automated, patient-directed arm (i.e., pre-test genetic education and negative return of results) utilize the Invitae technical platform and chatbot interface and were scripted for the BRIDGE study by an interdisciplinary team of genetic counselors, genetic counseling assistants, communication scientists, and research staff. The chat content was developed through an iterative process of review of recorded genetic counseling encounters and feedback by certified genetic counselors in order to most closely represent key content delivered during in-person genetic counseling appointments. The pre-test education chat is introduced by a short video from a lead genetic counselor at each site and then provides educational content about heritability of cancer, genetic testing process, multi-gene panel tests, and possible genetic testing outcomes. The negative return of result chat informs the patient of their negative results and educates the patient about what these results mean for their long-term care. For both chats, patients move through a core set of information and then may request additional information on topics they choose. Both chats also provide the patient with the opportunity to ask questions in a free-text format. The platform utilizes a question bank so that the chatbot can respond automatically to most inquiries with a response pre-scripted by the research team, using natural language processing to determine the most appropriate response. If the system cannot match an answer to the patient’s question, the platform forwards the question to the GCA for follow up.

Patients from both arms who decide not to test receive a letter summarizing their risks and recommendations based on the available personal and family history information. In addition, patients from both arms are offered the option to schedule follow-up appointments in the genetics clinics, and these contacts and appointments are tracked.

Genetic testing

All genetic testing is performed at a Clinical Laboratory Improvement Act (CLIA)-certified commercial laboratory and, for NYULH patients, New York State approved laboratory. Patients receive a pan-cancer, multigene panel test for cancer susceptibility genes that includes approximately 34–36 genes. As in clinical practice, the choice of laboratory and specific multigene panel test is based on the patient’s need, services provided, and the patient’s insurance/financial status. Testing is billed to insurance, or patients can opt to self pay. Patients who are uninsured or lack coverage for genetic testing can also be assisted in applying for aid through programs offered by the laboratories. The out-of-pocket cost of genetic testing is typically between $0–$250 based on prior clinical experience, with most paying less than $100.

Measures

In order to collect data for the trial and implementation outcomes for participants who receive genetic counseling, we use a combination of questionnaires and abstraction of EHR data.

Questionnaires

Patients who complete pre-test counseling in either arm are asked to complete two follow-up questionnaires, with different versions for those who did and did not opt for genetic testing. The first follow-up questionnaire is administered about 4 weeks after the last genetic counseling contact and the second is administered 12 months after the last contact. As shown in Table 3, the 4-week follow-up questionnaire assesses perceptions of genetic services, decision regret, cancer risk perceptions, genetic knowledge, numeracy, and sociodemographic characteristics. For those who have testing, we also assess cognitive (i.e., recall, comprehension), affective (i.e., test-related distress, uncertainty, positive reactions), and communication (i.e., family, provider) responses. The 12-month follow-up questionnaire assesses cancer screening and prevention behaviors, genetic discrimination, eHealth literacy, genetic self-efficacy, and sources of health information. For those who have testing, we also assess retention, risk perceptions, and communication about test results at 12 months. Patients may complete follow-up questionnaires online, by telephone, or by mail. Online questionnaires are administered via REDCap, which has a HIPAA-compliant interface. For any patients who would like to complete the questionnaires by telephone, a research coordinator masked to their individual test results administers the questionnaire. Patients receive a $10 electronic gift card as an incentive for each questionnaire. The sources of the validated items used in the questionnaires are indicated in Table 3. The questionnaires were tested as part of a pilot study at the University of Utah prior to the launch of the RCT. Questionnaires can be found as Supplemental materials.

Table 3.

Items included in 4-week and 12-month follow-up questionnaires

Construct Item description Asked only of those completing testing Assessment point(s)
4-week 12-month
Perceptions of genetic services
 Satisfaction with genetic counseling 6 items to assess participant satisfaction with the process and content of genetic counseling [123] X
 Perceptions of genetic counseling 4 items assessing perceptions of genetic counseling and interactions with genetic counselor [124] X
 Perceptions of clarity and helpfulness of information 2 items assessing perceptions of understandability and helpfulness of information received during genetic counseling [125] and 2 items on ability to ask questions X
 Financial aspects of genetic testing 3 items assessing perceptions of affordability of genetic testing and insurance and billing concerns X
Cognitive responses
 Recall and interpretation 6 items assessing whether participants recalled their genetic test result and how they interpreted that result in terms of cancer risks [126] X X X
 Perceptions of genetic test results 3 items assessing perceptions of clarity, time spent thinking about results, and surprise with results [125] X X X
 Perceived utility 7 item measure assessing perceived utility of genetic test results [127] X X
 Decision regret 5 item measure assessing regret related to decision to receive genetic testing or not [128] X
 Cancer risk perceptions 6 items assessing absolute and relative risk perceptions for breast, colon, and (if female) ovarian cancer X X
 Genetic knowledge 16 item measure assessing genetic knowledge related to multigene panel testing [129] X
Emotional responses
 Distress, uncertainty, and positive experiences 21 item measure with three subscales (i.e., distress, uncertainty, positive experiences) assessing multidimensional impact of genetic test results [130] X X
Behavioral responses
 Cancer screening 14 items assessing use of different cancer screening tests in past year X
 Surgical decisions 1 item assessing surgical procedures to reduce risk of cancer X
 Cancer prevention 11 items assessing use of cancer prevention approaches in past year X
Communication
 Communication with health care providers 2 items assessing whether patient has discussed genetic test results with primary care or other health care provider [125] X X X
 Communication with family members 2 items assessing whether patient has discussed genetic test results with family members [125] X X X
Patient characteristics
 Sociodemographic characteristics Assessing educational attainment, race, ethnicity, marital status, household income, zip code, health insurance status, and having a primary care provider X
 Diagnosis with cancer 1 item assessing diagnosis with cancer in past year X
 Genetic testing 1 item assessing use of other genetic testing in past year X
 Genetic discrimination 1 item assessing experiences of discrimination following genetic testing X X
 Numeracy 6 item measure assessing subjective numeracy ability and preferences [131] X
 Health literacy 3 items assessing patients’ subjective health literacy [132] X
 eHealth literacy 8 item measure assessing patient’s eHealth literacy [133] X
 Genetic self-efficacy 3 item measure assessing patients’ confidence in their ability to assess and discuss genetic risk information [134] X
 Health information seeking 5 items assessing health information seeking through different media and interpersonal channels [135, 136] X
 Health information orientation 13 items assessing patients’ perceived importance of health [137] X
 Impacts of coronavirus 10 items assessing the financial, health, and psychological impact of or diagnosis with the coronavirus (COVID-19) [138] X X

EHR data

Queries of structured data elements are used to abstract data from the EHR related to patients’ cancer family history and adherence to clinical management recommendations (e.g., breast MRI) at 12 months following genetic services. Data will be abstracted from the population health management registries at each site related to uptake of genetic counseling, uptake of genetic testing, and genetic test results.

Analysis

For the primary trial outcome analyses, we will first check randomization by comparing demographic characteristics between patients in the two arms using bivariate statistics (t-test, Wilcoxon Ranked-Sum test, chi-squared test, or Fisher’s exact test). We will examine descriptive statistics, and will use chi-squared tests (or the nonparametric Fisher’s Exact test) with a two-sided 0.05 significance level for univariate comparison of proportions to examine the association between study arm and the primary outcomes (i.e., uptake of genetic counseling, uptake of genetic testing, adherence to clinical recommendations). We will next build multilevel multivariable logistic regression models to examine the effect of study arm on the outcome controlling for clinic-level (clinic type, patient volume, patient composition, number of providers), provider-level (specialty, years in practice, gender), and patient-level (i.e., sociodemographic, clinical) variables. Although the study design utilizes patient-level randomization and genetic counseling services are delivered centrally at both study sites, we will examine the intra-class correlation (ICC) by clinic and provider. If a significant ICC is observed, the regression models will be extended to include random effects for clinic or provider, and fit using software for generalized mixed models. Covariates will be included in models if significant in unadjusted analyses or if significantly different between arms. Using the multivariable regression models with interaction terms, we will explore whether the effects of study arm on uptake of genetic testing is modified by race/ethnicity or rurality. We will conduct both site-specific analyses and overall trial analyses. Statistical significance will be assessed as p < 0.05; SAS 9.4 and/or Stata 16.1 will be used for analysis.

Power

Sample size (outreach to 1280 patients at UHealth and 1500 at NYULH) is based on pilot tests of both arms at the two study sites in order to enroll approximately the same number of patients at each site. With outreach to 640 patients per arm at UHealth and 750 at NYULH, we will achieve 80% power to detect equivalence for the uptake of genetic counseling outcome in site-specific analysis. For this analysis, the margin of equivalence, given in terms of the difference, extends from − 0.08 to 0.17. The actual difference is 0.11, and the reference group proportion is 0.18. This sample size will be sufficient to examine the uptake of genetic testing outcome as well. For that outcome, 523 patients per arm at each site achieves 80% power to detect equivalence. The margin of equivalence, given in terms of the difference, extends from − 0.04 to 0.11. The actual difference is 0.05, and the reference group proportion is 0.14.

Discussion

The BRIDGE trial is designed to address the need to develop system-wide population health management strategies to deliver cancer genetic services to unaffected primary care patients. The primary outcomes of the trial will be uptake of genetic counseling, uptake of genetic testing, and, among those who receive genetic services, adherence to management recommendations from genetics providers. We hypothesize that uptake of genetic counseling and genetic testing will be equivalent for the automated, patient-directed genetic services delivery model delivered by a chatbot compared with the enhanced standard of care models. We will also explore whether race, ethnicity, and rurality modify the effects of the cancer genetics services delivery models on these outcomes.

BRIDGE is addressing critical clinical needs of increasing hereditary cancer testing in appropriate populations and identifying individuals with inherited cancer susceptibility [139]. Innovative aspects of the trial include testing delivery of cancer genetic services via an automated chatbot for pre-test genetics education and return of negative genetic test results. While chatbots have been used previously in delivery of some genetic services, outcomes from this modality have not been compared with standard of care in a randomized trial. Utilization of chatbots to deliver some components of genetic services has a strong potential to increase volume and access to these services for patients receiving primary care. The patient population of unaffected primary care patients identified through an EHR-based algorithm is also novel, and tests a sustainable system-level population health management approach to identification and delivery of cancer genetics services. BRIDGE also has the advantage of being conducted at two sites (UHealth and NYULH) located in different regions of the country, which have clinical structures and patient populations that are unique from one another. This allows for the examination of multiple outcomes between two unique healthcare systems. The findings from the BRIDGE trial will therefore advance the state of the science in identification of unaffected patients at increased risk for cancer and delivery of genetic services to those patients.

Supplementary Information

Additional file 1. (363.9KB, zip)

Acknowledgements

We thank Michael Flynn, MD, for his invaluable advice on the study.

Abbreviations

BRIDGE

Broadening the Reach, Impact, and Delivery of Genetic Services

CDS

Clinical decision support

CLIA

Clinical Laboratory Improvement Act

DTC

Direct-to-consumer

EHR

Electronic health record

FHIR

Health Level Seven International Fast Healthcare Interoperability Resources

GCA

Genetic counseling assistant

ICC

Intra-class correlation

NCCN

National Comprehensive Cancer Network

NYULH

New York University Langone Health

PCP

Primary care provider

RCT

Randomized controlled trial

RE-AIM

Reach, Efficacy, Adoption, Implementation, and Maintenance

UHealth

University of Utah Health

VUS

Variant of uncertain significance

Authors’ contributions

KAK contributed to the conception and design of the work, and drafted the manuscript. WK contributed to the conception of the work and substantively revised the manuscript. RLC contributed to the conception of the work and substantively revised the manuscript. MSG contributed to the design of the work and substantively revised the manuscript. RB contributed to the creation of new software tools used in the work and substantively revised the manuscript. PAC contributed to the acquisition of data and revision of the manuscript. DCY contributed to the acquisition of data and revision of the manuscript. SVC contributed to the design of the work and substantively revised the manuscript. WFE contributed to the design of the work and substantively revised the manuscript. JNE contributed to the design of the work and substantively revised the manuscript. AG contributed to the acquisition of data and substantively revised the manuscript. ERG contributed to the design of the work and revision of the manuscript. JG contributed to the creation of new software tools used in the work and reviewed the manuscript. KJH contributed to the acquisition of data and substantively revised the manuscript. RH contributed to the design of the work and substantively revised the manuscript. KK1 contributed to the acquisition of data and reviewed the manuscript. CK contributed to the acquisition of data and substantively revised the manuscript. KEK contributed to the acquisition of data, drafted the figure, and substantively revised the manuscript. SL contributed to the creation of new software tools used in the work and reviewed the manuscript. TRM contributed to the creation of new software tools used in the work and reviewed the manuscript. RM contributed to the acquisition of data and reviewed the manuscript. JDS contributed to the design of the work and reviewed the manuscript. DT contributed to the acquisition of data and reviewed the manuscript. KT contributed to the acquisition of data and reviewed the manuscript. DWW contributed to the design of the work and reviewed the manuscript. DMM contributed to the design of the work and substantively revised the manuscript. KK2 contributed to the design of the work, creation of new software tools, and substantively revised the manuscript. GDF contributed to the design of the work, creation of new software tools, and substantively revised the manuscript. SSB contributed to the conception and design of the work and substantively revised the manuscript. OG contributed to the conception and design of the work and substantively revised the manuscript. All authors read and approved the final manuscript.

Funding

Research reported in this publication was supported by the National Cancer Institute of the National Institutes of Health, USA under award number U01CA232826. As part of the grant review process, the study protocol underwent peer review by the funding body. The funders have no role in data collection, analysis or interpretation, writing of the report, or decision to submit a report for publication. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Availability of data and materials

Not applicable. This protocol paper does not contain any data.

Declarations

Ethics approval and consent to participate

The study is approved as a single IRB protocol by the University of Utah Institutional Review Board, consistent with current U.S. National Institutes of Health policy for multi-site randomized controlled trials (NOT-OD-16-094). The New York University IRB agreed to rely upon the University of Utah IRB as the single IRB for the trial. Eligible individuals receive a study invitation letter with a link to an IRB-approved consent cover letter and a questionnaire. Individuals review the consent cover letter first and then indicate their consent to participate in the trial by completing the questionnaire. The trial has an approved waiver of documentation of consent so a signature is not required.

Consent for publication

Not applicable. The manuscript does not contain any individual person’s data.

Competing interests

JDS is co-founder and shareholder in ItRunsInMyFamily.com, and co-founder and shareholder in PEEL Therapeutics, Inc.

KK2 reports honoraria, consulting, sponsored research, licensing, or co-development outside the submitted work in the past 3 years with McKesson InterQual, Hitachi, Pfizer, Premier, Klesis Healthcare, RTI International, Mayo Clinic, the University of Washington, the University of California at San Francisco, MD Aware, and the U.S. Office of the National Coordinator for Health IT (via ESAC and Security Risk Solutions) in the area of health information technology. KK2 was also an unpaid board member of the non-profit Health Level Seven International health IT standard development organization, he is an unpaid member of the U.S. Health Information Technology Advisory Committee, and he has helped develop a number of health IT tools which may be commercialized to enable wider impact. None of these relationships have direct relevance to the manuscript but are reported in the interest of full disclosure.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.King M-C, Marks JH, Mandell JB. The New York breast Cancer study group. Breast and ovarian cancer risks due to inherited mutations in BRCA1 and BRCA2. Science. 2003;302(5645):643–646. doi: 10.1126/science.1088759. [DOI] [PubMed] [Google Scholar]
  • 2.Petrucelli N, Daly M, Pal T, et al. BRCA1- and BRCA2-associated hereditary breast and ovarian Cancer. In: Adam M, Ardinger H, Pagon R, et al., editors. GeneReviews. Seattle: University of Washington; 2016. [Google Scholar]
  • 3.Giardiello F, Allen J, Axilbund J, Boland C, Burke C, Burt R, Church JM, Dominitz JA, Johnson DA, Kaltenbach T, Levin TR, Lieberman DA, Robertson DJ, Syngal S, Rex DK, US Multi-Society Task Force on Colorectal Cancer Guidelines on genetic evaluation and management of lynch syndrome: a consensus statement by the US multi-society task force on colorectal Cancer. Gastroenterology. 2014;147(2):502–506. doi: 10.1053/j.gastro.2014.04.001. [DOI] [PubMed] [Google Scholar]
  • 4.Curras-Freixes M, Inglada-Perez L, Mancikova V, Montero-Conde C, Leton R, et al. Recommendations for somatic and germline genetic testing of single pheochoromocytoma and paraganglioma based on findings from a series of 329 patients. J Med Genet. 2015;52(10):647–656. doi: 10.1136/jmedgenet-2015-103218. [DOI] [PubMed] [Google Scholar]
  • 5.Brito J, Asi N, Bancos I, Gionfriddo M, Zeballos-Palacios C, et al. Testing for germline mutations in sporadic pheocromocytoma/paraganglioma: a systematic review. Clin Endocrinol. 2015;82(3):338–345. doi: 10.1111/cen.12530. [DOI] [PubMed] [Google Scholar]
  • 6.Judkins T, Leclair B, Bowles K, Gutin N, Trost J, McCulloch J, Bhatnagar S, Murray A, Craft J, Wardell B, Bastian M, Mitchell J, Chen J, Tran T, Williams D, Potter J, Jammulapati S, Perry M, Morris B, Roa B, Timms K. Development and analytical validation of a 25-gene next generation sequencing panel that includes the BRCA1 and BRCA2 genes to assess hereditary cancer risk. BMC Cancer. 2015;15(1):215. doi: 10.1186/s12885-015-1224-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.National Cancer Institute. Genetics of Breast and Gynecologic Cancers Rockville: National Cancer Institute; 2015 [Available from: http://www.cancer.gov/cancertopics/pdq/genetics/breast-and-ovarian/HealthProfessional/page3.
  • 8.Zhang S, Royer R, Li S, McLaughlin J, Rosen B, Risch H, et al. Frequencies of BRCA1 and BRCA2 mutations among 1,342 unselected patients with invasive ovarian cancer. Gynecol Oncol. 2011;121(2):353–357. doi: 10.1016/j.ygyno.2011.01.020. [DOI] [PubMed] [Google Scholar]
  • 9.Hampel H, Frankel W, Martin E, et al. Screening for the lynch syndrome (hereditary nonpolyposis colorectal cancer) N Engl J Med. 2005;352(18):1851–1860. doi: 10.1056/NEJMoa043146. [DOI] [PubMed] [Google Scholar]
  • 10.Yurgelun MB, Kulke MH, Fuchs CS, Allen BA, Uno H, Hornick JL, Ukaegbu CI, Brais LK, McNamara PG, Mayer RJ, Schrag D, Meyerhardt JA, Ng K, Kidd J, Singh N, Hartman AR, Wenstrup RJ, Syngal S. Cancer susceptibility gene mutations in individuals with colorectal cancer. J Clin Oncol. 2017;35(10):1086–1095. doi: 10.1200/JCO.2016.71.0012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Shindo K, Yu J, Suenaga M, Fesharakizadeh S, Cho C, Macgregor-Das A, Siddiqui A, Witmer PD, Tamura K, Song TJ, Navarro Almario JA, Brant A, Borges M, Ford M, Barkley T, He J, Weiss MJ, Wolfgang CL, Roberts NJ, Hruban RH, Klein AP, Goggins M. Deleterious germline mutations in patients with apparently sporadic pancreatic adenocarcinoma. J Clin Oncol. 2017;35(30):3382–3390. doi: 10.1200/JCO.2017.72.3502. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Madelker D, et al. Mutation detection in patients with advanced cancer by universal sequencing of cancer-related genes in tumor and normal DNA vs guideline-based germline testing. J Am Med Assoc. 2017;318(9):825–835. doi: 10.1001/jama.2017.11137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Pritchard CC, Mateo J, Walsh MF, De Sarkar N, Abida W, Beltran H, et al. Inherited DNA-repair gene mutations in men with metastatic prostate cancer. N Engl J Med. 2016;375(5):443–453. doi: 10.1056/NEJMoa1603144. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Hall MJ, Forman AD, Pilarski R, Wiesner G, Giri VN. Gene panel testing for inherited cancer risk. J Natl Compr Cancer Netw. 2014;12(9):1339–1346. doi: 10.6004/jnccn.2014.0128. [DOI] [PubMed] [Google Scholar]
  • 15.Hiraki S, Rinella ES, Schnabel F, Oratz R, Ostrer H. Cancer risk assessment using genetic panel testing: considerations for clinical application. J Genet Couns. 2014;23(4):604–617. doi: 10.1007/s10897-014-9695-6. [DOI] [PubMed] [Google Scholar]
  • 16.Kurian AW, Hare EE, Mills MA, Kingham KE, McPherson L, Whittemore AS, McGuire V, Ladabaum U, Kobayashi Y, Lincoln SE, Cargill M, Ford JM. Clinical evaluation of a multiple-gene sequencing panel for hereditary cancer risk assessment. J Clin Oncol. 2014;32(19):2001–2009. doi: 10.1200/JCO.2013.53.6607. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Maxwell KN, Wubbenhorst B, D'Andrea K, et al. Prevalence of mutations in a panel of breast cancer susceptibility genes in BRCA1/2-negative patients with early-onset breast cancer. Genet Med. 2015;17:630–8. [DOI] [PMC free article] [PubMed]
  • 18.Desmond A, Kurian AW, Gabree M, Mills MA, Anderson MJ, Kobayashi Y, Horick N, Yang S, Shannon KM, Tung N, Ford JM, Lincoln SE, Ellisen LW. Clinical actionability of multigene panel testing for hereditary breast and ovarian cancer risk assessment. JAMA Oncol. 2015;1(7):943–951. doi: 10.1001/jamaoncol.2015.2690. [DOI] [PubMed] [Google Scholar]
  • 19.Slavin TP, Niell-Swiller M, Solomon I, Nehoray B, Rybak C, Blazer KR, et al. Clinical application of multigene panels: challenges of next-generation counseling and cancer risk management. Front Oncol. 2015;5:208. doi: 10.3389/fonc.2015.00208. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Pennington KP, Swisher EM. Hereditary ovarian cancer: beyond the usual suspects. Gynecol Oncol. 2012;124(2):347–353. doi: 10.1016/j.ygyno.2011.12.415. [DOI] [PubMed] [Google Scholar]
  • 21.Domchek SM, Bradbury A, Garber JE, Offit K, Robson ME. Multiplex genetic testing for cancer susceptibility: out on the high wire without a net? J Clin Oncol. 2013;31(10):1267–1270. doi: 10.1200/JCO.2012.46.9403. [DOI] [PubMed] [Google Scholar]
  • 22.Mandelker D, Zhang L, Kemel Y, Stadler ZK, Joseph V, Zehir A, Pradhan N, Arnold A, Walsh MF, Li Y, Balakrishnan AR, Syed A, Prasad M, Nafa K, Carlo MI, Cadoo KA, Sheehan M, Fleischut MH, Salo-Mullen E, Trottier M, Lipkin SM, Lincoln A, Mukherjee S, Ravichandran V, Cambria R, Galle J, Abida W, Arcila ME, Benayed R, Shah R, Yu K, Bajorin DF, Coleman JA, Leach SD, Lowery MA, Garcia-Aguilar J, Kantoff PW, Sawyers CL, Dickler MN, Saltz L, Motzer RJ, O’Reilly EM, Scher HI, Baselga J, Klimstra DS, Solit DB, Hyman DM, Berger MF, Ladanyi M, Robson ME, Offit K. Mutation detection in patients with advanced Cancer by universal sequencing of Cancer-related genes in tumor and Normal DNA vs guideline-based Germline testing. JAMA. 2017;318(9):825–835. doi: 10.1001/jama.2017.11137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Pearlman R, Frankel W, Swanson B, et al. Prevalence and spectrum of germline cancer susceptibility gene mutations among patietns with early onset colorectal cancer. JAMA Oncol. 2017;3(4):464–471. doi: 10.1001/jamaoncol.2016.5194. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Stoffel E, Koeppe E, Everett J, et al. Germline genetic features of young individuals with colorectal cancer. Gastroenterology. 2018;154(4):897–905. doi: 10.1053/j.gastro.2017.11.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Kapoor N, Curcio L, Blakemore C, et al. Multigene panel testing detects equal rates of pathogenic BRCA1/2 mutations and has a higher diagnostic yield compared to limited BRCA1/2 analysis along in patients at risk for hereditary breast cancer. Ann Surg Oncol. 2015;22(10):3282–3288. doi: 10.1245/s10434-015-4754-2. [DOI] [PubMed] [Google Scholar]
  • 26.Ricker C, Culver JO, Lowstuter K, Sturgeon D, Sturgeon JD, Chanock CR, Gauderman WJ, McDonnell KJ, Idos GE, Gruber SB. Increased yield of actionable mutations using multi-gene panels to assess hereditary cancer susceptibility in an ethnically diverse clinical cohort. Cancer Genet. 2016;209(4):130–137. doi: 10.1016/j.cancergen.2015.12.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Susswein LR, Marshall ML, Nusbaum R, Vogel Postula KJ, Weissman SM, Yackowski L, Vaccari EM, Bissonnette J, Booker JK, Cremona ML, Gibellini F, Murphy PD, Pineda-Alvarez DE, Pollevick GD, Xu Z, Richard G, Bale S, Klein RT, Hruska KS, Chung WK. Pathogenic and likely pathogenic variant prevalence among the first 10,000 patients referred for next-generation cancer panel testing. Genet Med. 2016;18(8):823–832. doi: 10.1038/gim.2015.166. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Yurgelun MB, Allen B, Kaldate RR, Bowles KR, Judkins T, Kaushik P, Roa BB, Wenstrup RJ, Hartman AR, Syngal S. Identification of a variety of mutations in Cancer predisposition genes in patients with suspected lynch syndrome. Gastroenterology. 2015;149(3):604–613. doi: 10.1053/j.gastro.2015.05.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Giri VN, Knudsen K, Kelly W, et al. Role of genetic testing for inherited prostate cancer risk: Philadelphia prostate Cancer consensus conference 2017. J Clin Oncol. 2018;36(4):414–424. doi: 10.1200/JCO.2017.74.1173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Hampel H. Genetic counseling and cascade genetic testing in lynch syndrome. Familial Cancer. 2016;15(3):423–427. doi: 10.1007/s10689-016-9893-5. [DOI] [PubMed] [Google Scholar]
  • 31.Samini G, Bernardini M, Brody L, Caga-Anan C, Campbell I, Chenevix-Trench G. Traceback: a proposed framework to increase identification and genetic counseling of BRCA1 and BRCA2 mutation carriers through family-based outreach. J Clin Oncol. 2017;35(20):2329–2337. doi: 10.1200/JCO.2016.70.3439. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Katapodi M, Viassolo V, Caiata-Zufferey M, Nikolaidis C, Buhrer-Landolt R, Buerki N, et al. Cancer predisposition cascade screening for hereditary breast/ovarian cancer and lynch syndromes in Switzerland: study protocol. JMIR Res Prot. 2017;6(9):e184. doi: 10.2196/resprot.8138. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Dinh T, Rosner B, Atwood J, Boland C, et al. Health benefits and cost-effectiveness of primary genetic screening for lynch syndrome in the general population. Cancer Prev Res. 2011;4(1):9–22. doi: 10.1158/1940-6207.CAPR-10-0262. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Li Y, Arellano A, Bare L, et al. A multigene test could cost-effectively help extend life expectancy for women at risk of hereditary breast cancer. Value Health. 2017;20(4):547–555. doi: 10.1016/j.jval.2017.01.006. [DOI] [PubMed] [Google Scholar]
  • 35.Luba D, Disario J, Rock C, et al. Community practice implementation of a self-administered version of PREMM1,2,6 to assess risk for lynch syndrome. Clin Gastroenterol Hepatol. 2018;16(1):49–58. doi: 10.1016/j.cgh.2017.06.038. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Gou F, et al. Use of BRCA mutation test in the U.S. 2004-2014. Prev Med. 2017;52(6):702–9. [DOI] [PMC free article] [PubMed]
  • 37.Cropper C, Woodson AH, Arun B, Barcenas C, Litton J, Noblin S, Liu D, Park M, Daniels M. Evaluating the NCCN criteria for recommending BRCA1 and BRCA2 genetic testing in patients with breast cancer. J Natl Compr Cancer Netw. 2017;15(6):797–803. doi: 10.6004/jnccn.2017.0107. [DOI] [PubMed] [Google Scholar]
  • 38.Gilpin C, Carson N, Hunter A. A preliminary validation of a family history assessment form to select women at risk for breast or ovarian cancer for referral to a genetics center. Clin Genet. 2000;58(4):299–308. doi: 10.1034/j.1399-0004.2000.580408.x. [DOI] [PubMed] [Google Scholar]
  • 39.Parmigiani G, Chen S, Iversen E., Jr Validity of models for predicting BRCA1 and BRCA2 mutations. Ann Intern Med. 2007;147(7):441–450. doi: 10.7326/0003-4819-147-7-200710020-00002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Bellcross C, Lemke A, Paper L, et al. Evaluation of a breast/ovarian cancer genetics referral screening tool in a mammography population. Genet Med. 2009;11(11):783–789. doi: 10.1097/GIM.0b013e3181b9b04a. [DOI] [PubMed] [Google Scholar]
  • 41.Hoskins K, Zwaagstra A, Ranz M. Validation of a tool for identifying women at high risk for hereditary breast cancer in population-based screening. Cancer. 2006;107(8):1769–1776. doi: 10.1002/cncr.22202. [DOI] [PubMed] [Google Scholar]
  • 42.Ashton-Prolla P, Giacomazzi J, Schmidt A, et al. Development and validation of a simple questionnaire for the identification of hereditary breast cancer in primary care. BMC Cancer. 2009;9(1):283. doi: 10.1186/1471-2407-9-283. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Khoury MJ, Feero WG, Valdez R. Family history and personal genomics as tools for improving health in an era of evidence-based medicine. Am J Prev Med. 2010;39(2):184–188. doi: 10.1016/j.amepre.2010.03.019. [DOI] [PubMed] [Google Scholar]
  • 44.U.S. Preventive Services Task Force Risk assessment, genetic counseling, and genetic testing for BRCA-related cancer: recommendation statement. Am Fam Physician. 2020;101(4):233–238. [PubMed] [Google Scholar]
  • 45.Centers for Medicare & Medicaid Services. Affordable Care Act Implementation FAQs - Set 12 Baltimore: Centers for Medicare & Medicaid Services. https://www.cms.gov/CCIIO/Resources/Fact-Sheets-and-FAQs/aca_implementation_faqs12. Accessed 1 Mar 2021.
  • 46.Acheson LS, Weisner GL, Zyzanski SJ, Goodwin MA, Stange KC. Family history-taking in community family practice: implications for genetic screening. Genet Medicine. 2000;2(3):180–185. doi: 10.1097/00125817-200005000-00004. [DOI] [PubMed] [Google Scholar]
  • 47.Fuller M, Myers M, Webb T, Tabangin M, Prows C. Primary care providers' responses to patient-centered family history. J Genet Couns. 2010;19(1):84–96. doi: 10.1007/s10897-009-9264-6. [DOI] [PubMed] [Google Scholar]
  • 48.Valdez R, Yoon PW, Qureshi N, Green RF, Khoury MJ. Family history in public health practice: a genomic tool for disease prevention and health promotion. Annu Rev Public Health. 2010;31(1):69–87. doi: 10.1146/annurev.publhealth.012809.103621. [DOI] [PubMed] [Google Scholar]
  • 49.Ginsburg O, Ashton-Prolla P, Cantor A, Mariosa D, Brennan P. The role of genomics in global cancer prevention. Nat Rev Clin Oncol. 2020; ePub before press. [DOI] [PubMed]
  • 50.Grindedal E, Herabm C, Karsrud I, et al. Current guidelines for BRCA testing of breast cancer patietns are insufficient to detect all mutation carriers. BMC Cancer. 2017;17(1):438. doi: 10.1186/s12885-017-3422-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Hull L, Haas J, Simon S, et al. Provider discussions of genetic tests with U.S. womend at risk for BRCA mutation. Am J Prev Med. 2018;54(2):221–228. doi: 10.1016/j.amepre.2017.10.015. [DOI] [PubMed] [Google Scholar]
  • 52.Acheson L. Fostering applications of genetics in primary care: what will it take? Genet Med. 2003;5(2):63–65. doi: 10.1097/01.GIM.0000056946.67707.67. [DOI] [PubMed] [Google Scholar]
  • 53.Rich EC, Burke W, Heaton CJ, Haga S, Pinsky L, Short P, et al. Reconsidering the family history in primary care. J Gen Intern Med. 2004;19(3):273–280. doi: 10.1111/j.1525-1497.2004.30401.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Green RF, Olney RS. Connecting generations: family history an important tool in pediatrics, public health. AAP News. 2007;28:26. [Google Scholar]
  • 55.Kelly KM, Ferketich AK, Sturm AC, Porter K, Sweet K, Kemp K, Schwirian P, Westman JA. Cancer risk and risk communication in urban, lower-income neighborhoods. Prev Med. 2009;48(4):392–396. doi: 10.1016/j.ypmed.2009.01.009. [DOI] [PubMed] [Google Scholar]
  • 56.Kelly KM, Love MM, Pearce KA, Porter K, Barron MA, Andrykowski M. Cancer risk assessment by rural and Appalachian family medicine physicians. J Rural Health. 2009;25(4):372–377. doi: 10.1111/j.1748-0361.2009.00246.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Delikurt T, Williamson G, Anastasiadou V, Skirton H. A systematic review of factors that act as barriers to patient referral to genetic services. Eur J Hum Genet. 2015;23(6):739–745. doi: 10.1038/ejhg.2014.180. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Mikat-Stevens NA, Larson IA, Tarini BA. Primary-care providers' perceived barriers to integration of genetics services: a systematic review of the literature. Genet Med. 2015;17(3):169–176. doi: 10.1038/gim.2014.101. [DOI] [PubMed] [Google Scholar]
  • 59.Mowery DL, Kawamoto K, Bradshaw R, Kohlmann W, Schiffman JD, Weir C, Borbolla D, Chapman WW, del Fiol G. Determining onset for familial breast and colorectal cancer from family history comments in the electronic health record. AMIA Jt Summits Transl Sci Proc. 2019;2019:173–181. [PMC free article] [PubMed] [Google Scholar]
  • 60.Gupta S, Provenzale D, Llor X, Halverson AL, Grady W, Chung DC, Haraldsdottir S, Markowitz AJ, Slavin Jr TP, Hampel H, Ness RM, Weiss JM, Ahnen DJ, Chen LM, Cooper G, Early DS, Giardiello FM, Hall MJ, Hamilton SR, Kanth P, Klapman JB, Lazenby AJ, Lynch PM, Mayer RJ, Mikkelson J, Peter S, Regenbogen SE, Dwyer MA, Ogba N. Genetic/familial high-risk assessment: colorectal, version 2.2019: featured updates to the NCCN guidelines. J Natl Compr Cancer Netw. 2019;17(9):1032–1041. doi: 10.6004/jnccn.2019.0044. [DOI] [PubMed] [Google Scholar]
  • 61.Daly MB, Pilarski R, Yurgelun MB, Berry MP, Buys SS, Dickson P, Domchek SM, Elkhanany A, Friedman S, Garber JE, Goggins M, Hutton ML, Khan S, Klein C, Kohlmann W, Kurian AW, Laronga C, Litton JK, Mak JS, Menendez CS, Merajver SD, Norquist BS, Offit K, Pal T, Pederson HJ, Reiser G, Shannon KM, Visvanathan K, Weitzel JN, Wick MJ, Wisinski KB, Dwyer MA, Darlow SD. Genetic/familial high-risk assessment: breast, ovarian, and pancreatic, version 1.2020: featured updates to the NCCN guidelines. J Natl Compr Cancer Netw. 2020;18(4):380–391. doi: 10.6004/jnccn.2020.0017. [DOI] [PubMed] [Google Scholar]
  • 62.Del Fiol G, Kohlmann W, Bradshaw R, Weir C, Flynn M, Hess R, et al. Standards-based clinical decision support platform to manage patients who meet guideline-based criteria for genetic evaluation of familial cancer. J Clin Oncol Clin Cancer Inform. 2020;4:1–9. doi: 10.1200/CCI.19.00120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Hoskovec JM, Bennett RL, Carey ME, DaVanzo JE, Dougherty MJ, Hahn SE, et al. Projecting the supply and demand for certified genetic counselors: a workforce study. J Genet Couns. 2018;27(1):16–20. doi: 10.1007/s10897-017-0158-8. [DOI] [PubMed] [Google Scholar]
  • 64.Attard C, Carmany E, Trepanier A. Genetic counselor workflow study: the times are they a-changin? J Genet Couns. 2019;28(1):130–140. doi: 10.1002/jgc4.1041. [DOI] [PubMed] [Google Scholar]
  • 65.Maiese D, Keehn A, Lyon M, Flannery D, Watson M. Current conditions in medical genetics practice. Genet Med. 2019;21(8):1874–1877. doi: 10.1038/s41436-018-0417-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Buchanan A, Rahm A, Williams J. Alternate service delivery models in cancer genetic counseling: a mini-review. Front Oncol. 2016;6:120. doi: 10.3389/fonc.2016.00120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Kinney AY, Steffen LE, Brumbach BH, Kohlmann W, Du R, Lee JH, et al. Randomized noninferiority trial of telephone delivery of BRCA1/2 genetic counseling compared with in-person counseling: 1-year follow-up. J Clin Oncol. 2016;34(24):2914–24. doi: 10.1200/JCO.2015.65.9557. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Schwartz MD, Valdimarsdottir HB, Peshkin BN, Mandelblatt JS, Nusbaum R, Huang A-T, Chang Y, Graves K, Isaacs C, Wood M, McKinnon W, Garber J, McCormick S, Kinney AY, Luta G, Kelleher S, Leventhal KG, Vegella P, Tong A, King L. Randomized noninferiority trial of telephone versus in-person genetic counseling for hereditary breast and ovarian cancer. J Clin Oncol. 2014;32(7):618–626. doi: 10.1200/JCO.2013.51.3226. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Sutphen R, Davila B, Shappell H, Holtje T, Vadaparampil S, Friedman S, Toscano M, Armstrong J. Real world experience with cancer genetic counseling via telephone. Familial Cancer. 2010;9(4):681–689. doi: 10.1007/s10689-010-9369-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.McCuaig J, Armel S, Care M, Volenik A, Kim R, Metcalfe K. Next-generation service delivery: a scoping review of patient outcomes associated with alternative models of genetic counseling and genetic testing for hereditary cancer. Cancers. 2018;10(11):435. doi: 10.3390/cancers10110435. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Voils C, Venne V, Weidenbacher H, Sperber N, Datta S. Comparison of telephone and televideo modes for delivery of genetic counseling: a randomized trial. J Genet Couns. 2018;27(2):339–348. doi: 10.1007/s10897-017-0189-1. [DOI] [PubMed] [Google Scholar]
  • 72.Butrick M, Kelly S, Peshkin BN, Luta G, Nusbaum R, Hooker GW, Graves K, Feeley L, Isaacs C, Valdimarsdottir HB, Jandorf L, DeMarco T, Wood M, McKinnon W, Garber J, McCormick SR, Schwartz MD. Disparities in uptake of BRCA1/2 genetic testing in a randomized trial of telephone counseling. Genet Med. 2015;17(6):467–475. doi: 10.1038/gim.2014.125. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Steffen L, Du R, Gammon A, Mandelblatt J, Kohlmann W, Lee J, et al. Genetic testing in a population-based sample of breast and ovarian cancer survivors from the REACH randomized trial: cost barriers and moderators of counseling mode. Cancer Epidemiol Biomark Prev. 2017;26(12):1772–1780. doi: 10.1158/1055-9965.EPI-17-0389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Cohen S, Huziak R, Gustafson S, Grubs R. Analysis of advantages, limitations, and barriers of genetic counseling service delivery models. J Genet Couns. 2016;25(5):1010–1018. doi: 10.1007/s10897-016-9932-2. [DOI] [PubMed] [Google Scholar]
  • 75.Green MJ, Peterson SK, Baker MW, Friedman LC, Harper GR, Rubinstein WS, et al. Use of an educational computer program before genetic counseling for breast cancer susceptibility: Effects on duration and content of counseling sessions. Genet Med. 2005;7(4):221–229. doi: 10.1097/01.gim.0000159905.13125.86. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Green MJ, Peterson SK, Baker MW, Harper GR, Friedman LC, Rubinstein WS, Mauger DT. Effect of a computer-based decision aid on knowledge, perceptions, and intentions about genetic testing for breast cancer susceptibility: a randomized controlled trial. JAMA. 2004;292(4):442–452. doi: 10.1001/jama.292.4.442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Trepanier A, Allain D. Models of service delivery for cancer genetic risk assessment and counseling. J Genet Couns. 2014;23(2):239–253. doi: 10.1007/s10897-013-9655-6. [DOI] [PubMed] [Google Scholar]
  • 78.Keshavan M. Key players in the direct-to-consumer lab testing market: MedCityNews. 2016. [Google Scholar]
  • 79.van der Wouden C, Carere D. Maitland-van der zee a. consumer perceptions of interactions with primary care providers after direct-to-consumer personal genomic testing. Ann Intern Med. 2016;164(8):513–522. doi: 10.7326/M15-0995. [DOI] [PubMed] [Google Scholar]
  • 80.Burke W, Trinidad S. The deceptive appeal of direct-to-consumer genetics. Ann Intern Med. 2016;164(8):564–565. doi: 10.7326/M16-0257. [DOI] [PubMed] [Google Scholar]
  • 81.Tandy-Connor S, Guiltinan J, Kremply K, LaDuca H, Reineke P, Gutierrez S, et al. False-positive results released by direct-to-consumer genetic tests highlight the importance of clinical confirmation testing for appropriate patient care. Genet Med. 2018;20(12):1515–1521. doi: 10.1038/gim.2018.38. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Hamilton J, Abdiwahab E, Edwards H, Fan M, Jdayani A, Breslau E. Primary care providers' cancer genetic-testing related knowledge, attitudes, and communication behaviors: a systematic review and research agenda. J Gen Intern Med. 2017;32(3):315–324. doi: 10.1007/s11606-016-3943-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Doak CC, Doak LG, Root JH. Teaching patients with low literacy skills. 2. Philadelphia: J.B. Lippincott Company; 1996. Teaching Patients with Low Literacy Skills. [Google Scholar]
  • 84.Mayer RE, Dow GT, Mayer S. Multimedia learning in an interactive self-explaining environment: what works in the design of agent-based microworlds. J Educ Psychol. 2003;95(4):806–813. doi: 10.1037/0022-0663.95.4.806. [DOI] [Google Scholar]
  • 85.Agency for Healthcare Research and Quality . Health literacy universal precautions toolkit. 2010. [Google Scholar]
  • 86.Bibault J-E, Chaix B, Nectoux P, Pienkowski A, Guillemase A, Brouard B. Healthcare ex Machina: are conversational agents ready for prime time in oncology? Clin Transl Rad Oncol. 2019;16:55–59. doi: 10.1016/j.ctro.2019.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Fitzpatrick K, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Mental Health. 2017;4(2):e19. doi: 10.2196/mental.7785. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Ly K, Ly A-M, Andersson G. A fully automated conversational agent for promoting mental wellbeing: a pilot RCT using mixed methods. Internet Interv. 2017;10:39–46. doi: 10.1016/j.invent.2017.10.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Owens O, Felder T, Tavakoli A, Revels A, Friedman D, Hughes-Halbert C, Hébert JR. Evaluation of a computer-based decision aid for promoting informed prostate cancer screening decisions among African American men: iDecide. Am J Health Promot. 2018;33(2):267–278. doi: 10.1177/0890117118786866. [DOI] [PubMed] [Google Scholar]
  • 90.Pereira J, Diaz O. Using health chatbots for behavior change: a mapping study. J Med Syst. 2019;43(5):135. doi: 10.1007/s10916-019-1237-1. [DOI] [PubMed] [Google Scholar]
  • 91.Gordon E, Babu D, Laney D. The future is now: technology’s impact on the practice of genetic counseling. Am J Med Genet. 2018;178(1):15–23. doi: 10.1002/ajmg.c.31599. [DOI] [PubMed] [Google Scholar]
  • 92.Biesecker B. Genetic counseling and the central tenets of practice. Cold Spring Harbor Perspect Med. 2020;10(3):a038968. [DOI] [PMC free article] [PubMed]
  • 93.Flannery D. Challenges and opportunities for effective delivery of clinical genetic services in the U.S. healthcare system. Curr Opin Pediatr. 2018;30(6):740–745. doi: 10.1097/MOP.0000000000000693. [DOI] [PubMed] [Google Scholar]
  • 94.Rashkin M, Bowes J, Dunaway K, Dhaliwal J, Loomis E, Riffle S, et al. Genetic counseling, 2030: an on-demand service tailored to the needs of a price conscious, genetically literate, and busy world. J Genet Couns. 2019;28(2):456–465. doi: 10.1002/jgc4.1123. [DOI] [PubMed] [Google Scholar]
  • 95.Schmidlen T, Schwartz M, Diloreto K, Kirchner H, Sturm A. Patient assessment of chatbots for the scalable delivery of genetic counseling. J Genet Couns. 2019;28(6):1166–1177. doi: 10.1002/jgc4.1169. [DOI] [PubMed] [Google Scholar]
  • 96.Nadarzynski T, MIles O, Cowie A, Ridge D. Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: a mixed methods study. Digital Health. 2019;5:1–12. doi: 10.1177/2055207619871808. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Roberts MC, Kennedy AE, Chambers DA, Khoury MJ. The current state of implementation science in genomic medicine: opportunities for improvement. Genet Med. 2017;19(8):858–863. doi: 10.1038/gim.2016.210. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98.Institute of Medicine . Unequal treatment: understanding racial and ethnic disparities in health Care. Washington, DC: National Academy Press; 2002. [Google Scholar]
  • 99.Halbert C, Harrison B. Genetic counseling among minority populations in the era of precision medicine. Am J Med Genet. 2018;178(1):68–74. doi: 10.1002/ajmg.c.31604. [DOI] [PubMed] [Google Scholar]
  • 100.Pierle J, Mahon S. Genetic service delivery models: exploring approaches to care for families with hereditary cancer risk. Clin J Oncol Nurs. 2019;23(1):60–67. doi: 10.1188/19.CJON.60-67. [DOI] [PubMed] [Google Scholar]
  • 101.Hall M, Olopade OI. Confronting genetic testing disparities: knowledge is power. J Am Med Assoc. 2005;293(14):1783–1785. doi: 10.1001/jama.293.14.1783. [DOI] [PubMed] [Google Scholar]
  • 102.Hall MJ, Olopade OI. Disparities in genetic testing: thinking outside the BRCA box. J Clin Oncol. 2006;24(14):2197–2203. doi: 10.1200/JCO.2006.05.5889. [DOI] [PubMed] [Google Scholar]
  • 103.Fisher E, Pratt R, Esch R, Kocher M, Wilson KR, Lee W, et al. The role of race and ethnicity in views toward and participation in genetic studies and precision medicine research in the United States: a systematic review of qualitative and quantitative studies. Mol Genet Gen Med. 2019;8(2):e1099. [DOI] [PMC free article] [PubMed]
  • 104.McCarthy AM, Bristol M, Domchek SM, Groeneveld PW, Kim Y, Motanya UN, et al. Health care segregation, physician recommendation, and racial disparities in BRCA1/2 testing among women with breast cancer. J Clin Oncol. 2016;34(22):2610–2618. doi: 10.1200/JCO.2015.66.0019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Alford SH, McBride CM, Reid RJ, Larson EB, Baxevanis AD, Brody LC. Participation in genetic testing research varies by social group. Public Health Gen. 2011;14(2):85–93. doi: 10.1159/000294277. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 106.Defining rural population. Available from: https://www.hrsa.gov/rural-health/about-us/definition/index.html. Accessed 26 Feb 2021.
  • 107.Caldwell JT, Ford CL, Wallace SP, Wang MC, Takahashi LM. Intersection of living in a rural versus urban area and race/ethnicity in explaining access to health care in the United States. Am J Public Health. 2016;106(8):1463–1469. doi: 10.2105/AJPH.2016.303212. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108.Bhuyan SS, Wang Y, Opoku S, Lin G. Rural-urban differences in acute myocardial infarction mortality: evidence from Nebraska. J Cardiovasc Dis Res. 2013;4(4):209–213. doi: 10.1016/j.jcdr.2014.01.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 109.Weaver KE, Geiger AM, Lu L, Case LD. Rural-urban disparities in health status among US cancer survivors. Cancer. 2013;119(5):1050–1057. doi: 10.1002/cncr.27840. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 110.Blake K, Moss J, Gaysynsky A, Srinivasan S, Croyle R. Making the case for investment in rural cancer control: an analysis of rural cancer incidence, mortality, and funding trends. Cancer Epidemiol Biomark Prev. 2017;26(7):992–997. doi: 10.1158/1055-9965.EPI-17-0092. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 111.Henley S, Anderson R, Thomas C, Massetti G, Peaker B, Richardson L. Invasive cancer incidence, 2004-2013, and deaths, 2006-2015, in nonmetropolitan and metropolitan counties - United States. MMWR. 2017;66(14):1–13. doi: 10.15585/mmwr.ss6614a1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 112.Zahnd W, James A, Jenkins W, Izadi S, Fogleman A, Steward D, et al. Rural-urban differences in cancer incidence and trends in the United States. Cancer Epidemiol Biomark Prev. 2018;27(11):1265–1274. doi: 10.1158/1055-9965.EPI-17-0430. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.George R, Kovak K, Cox SL. Aligning policy to promote cascade genetic screening for prevention and early diagnosis of heritable diseases. J Genet Couns. 2015;24(3):388–399. doi: 10.1007/s10897-014-9805-5. [DOI] [PubMed] [Google Scholar]
  • 114.Villegas C, Haga S. Access to genetic counselors in the southern United States. J Personalized Med. 2019;9(3):33. doi: 10.3390/jpm9030033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115.Radford C, Prince A, Lewis K, Pal T. Factors which impact the delivery of genetic risk assessment services focused on inherited cancer genomics: expanding the role and reach of certified genetics professionals. J Genet Couns. 2014;23(4):522–530. doi: 10.1007/s10897-013-9668-1. [DOI] [PubMed] [Google Scholar]
  • 116.Glasgow R, Klesges L, Dzewaltowski D, Estabrooks P, TM V. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006;21(5):688–694. doi: 10.1093/her/cyl081. [DOI] [PubMed] [Google Scholar]
  • 117.Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–1327. doi: 10.2105/AJPH.89.9.1322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 118.National Comprehensive Cancer Network . Breast Cancer Screening and Diagnosis Version I.2017. 2017. [Google Scholar]
  • 119.National Comprehensive Cancer Network . Genetic/Familial High-Risk Assessment: Colorectal Version 3.2017. 2017. [DOI] [PubMed] [Google Scholar]
  • 120.National Comprehensive Cancer Network . Genetic/familial high-risk assessment: breast/ovarian, Version I 2018. 2018. [Google Scholar]
  • 121.National Comprehensive Cancer Network . Colorectal Cancer Screening Version 2.2017. 2017. [Google Scholar]
  • 122.National Comprehensive Cancer Network . Prostate Cancer Early Detection Version 2.2017. 2017. [Google Scholar]
  • 123.DeMarco T, Peshkin B, Mars B, Tercyak K. Patient satisfaction with cancer genetic counseling: a psychometric anaysis of the genetic counseling satisfaction scale. J Genet Couns. 2004;13(4):293–304. doi: 10.1023/B:JOGC.0000035523.96133.bc. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 124.Peshkin BN, Kelly S, Nusbaum RH, Similuk M, DeMarco TA, Hooker GW, et al. Patient perceptions of telephone vs. in-person BRCA1/BRCA2 genetic counseling. J Genet Couns. 2015;25:472–482. doi: 10.1007/s10897-015-9897-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 125.Kaphingst KA, McBride CM, Wade CH, Baxevanis AD, Reid RJ, Larson EB, et al. Patients' understanding of and responses to multiplex genetic susceptibility test results. Genet Med. 2012;14(7):681–687. doi: 10.1038/gim.2012.22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 126.Lumish HS, Steinfeld H, Koval C, Russo D, Levinson E, Wynn J, Duong J, Chung WK. Impact of panel gene testing for hereditary breast and ovarian cancer on patients. J Genet Couns. 2017;26(5):1116–1129. doi: 10.1007/s10897-017-0090-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 127.Roberts JS, Gornick MC, Carere DA, Uhlmann WR, Ruffin MT, Green RC. Direct-to-consumer genetic testing: user motivations, decision making, and perceived utility of results. Public Health Genomics. 2017;20(1):36–45. doi: 10.1159/000455006. [DOI] [PubMed] [Google Scholar]
  • 128.Brehaut J, O'Connor A, Wood T, Hack T, Siminoff L, Gordon E, et al. Validation of a decision regret scale. Med Decis Mak. 2003;23(4):281–292. doi: 10.1177/0272989X03256005. [DOI] [PubMed] [Google Scholar]
  • 129.Underhill-Blazey M, Stopfer J, Chittenden A, Nayak MM, Lansang K, Lederman R, Garber J, Gundersen DA. Development and testing of the KnowGene scale to assess general genetic knowledge related to multigene panel testing. Patient Educ Couns. 2019;102(8):1558–1564. doi: 10.1016/j.pec.2019.04.014. [DOI] [PubMed] [Google Scholar]
  • 130.Cella D, Hughes C, Peterman A, Chang C-H, Peshkin BN, Schwartz MD, Wenzel L, Lemke A, Marcus AC, Lerman C. A brief assessment of concerns associated with genetic testing for cancer: the multidimensional impact of Cancer risk assessment (MICRA) questionnaire. Health Psychol. 2002;21(6):564–572. doi: 10.1037/0278-6133.21.6.564. [DOI] [PubMed] [Google Scholar]
  • 131.Fagerlin A, Zikmund-Fisher BJ, Ubel PA, Jankovic A, Derry HA, Smith DM. Measuring numeracy without a math test: development of the subjective numeracy scale. Med Decis Mak. 2007;27(5):672–680. doi: 10.1177/0272989X07304449. [DOI] [PubMed] [Google Scholar]
  • 132.Chew LD, Griffin JM, Partin MR, Noorbaloochi S, Grill JP, Snyder A, Bradley KA, Nugent SM, Baines AD, VanRyn M. Validation of screening questions for limited health literacy in a large VA outpatient population. J Gen Intern Med. 2008;23(5):561–566. doi: 10.1007/s11606-008-0520-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 133.Norman CD, Skinner HA. eHEALS: the eHealth literacy scale. J Med Internet Res. 2006;8(4):e27. doi: 10.2196/jmir.8.4.e27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 134.Parrott R, Silk K, Krieger JR, Harris T, Condit C. Behavioral health outcomes associated with religious faith and media exposure about human genetics. Health Commun. 2004;16(1):29–45. doi: 10.1207/S15327027HC1601_3. [DOI] [PubMed] [Google Scholar]
  • 135.Hesse BW, Nelson DE, Kreps GL, Croyle RT, Arora NK, Rimer BK, Viswanath K. Trust and sources of health information: the impact of the internet and its implications for health care providers: findings from the first health information National Trends Survey. Arch Intern Med. 2005;165(22):2618–2624. doi: 10.1001/archinte.165.22.2618. [DOI] [PubMed] [Google Scholar]
  • 136.Nelson DE, Kreps GL, Hesse BW, Croyle RT, Willis G, Arora NK, Rimer B, Vish Viswanath K, Weinstein N, Alden S. The health information National Trends Survey (HINTS): development, design, and dissemination. J Health Commun. 2004;9(5):443–460. doi: 10.1080/10810730490504233. [DOI] [PubMed] [Google Scholar]
  • 137.Dutta-Bergman M. Trusted online sources of health information: differences in demographics, health beliefs, and health-information orientation. J Med Internet Res. 2003;5(3):e21. doi: 10.2196/jmir.5.3.e21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 138.Conway LG, Woodard SR, Zubrod A. Social psychological measurements of COVID-19: coronavirus perceived threat, government response, impacts, and experiences questionnaires. 2020. [Google Scholar]
  • 139.National Cancer Institute . Cancer Moonshot Blue Ribbon Panel Report 2016. Bethesda: National institutes of health, National Cancer Institute; 2016. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1. (363.9KB, zip)

Data Availability Statement

Not applicable. This protocol paper does not contain any data.


Articles from BMC Health Services Research are provided here courtesy of BMC

RESOURCES