Skip to main content
Springer logoLink to Springer
. 2020 Jun 23;183(1):9–21. doi: 10.1007/s10549-020-05741-z

A systematic review of communication interventions to help healthcare professionals discuss genetic testing for breast cancer

Rachel Starkings 1,, Valerie Shilling 1, Valerie Jenkins 1, Lesley Fallowfield 1
PMCID: PMC7376076  PMID: 32577939

Abstract

Purpose

This systematic review examined educational training interventions for healthcare professionals (HCPs) discussing genetic testing and risk for hereditary breast cancer. There was a particular focus on the presence, and content, of communication elements within these packages.

Methods

Searches were run via CINAHL, EMBASE, PUBMED, and PsychInfo in February 2019 to identify training interventions available to HCPs with reference to communication skills. Studies were assessed for quality, with relevant intervention and outcome data extracted and synthesized. This review followed the Preferred Reporting Items for Systematic Review and Meta-analyses (PRISMA) statement and was registered on the PROSPERO database (CRD42019124010).

Results

Of 3,988 items, seven papers, two of which were linked, were eligible for inclusion. There was a mix of randomized and single arm studies with web-based and face-to-face interventions. Content included an overview of genetics, hereditary and familial background, and recommended practice techniques. Outcomes focused on communication, self-efficacy, knowledge, and satisfaction. Interventions were designed for genetic counselors, physicians, primary care physicians (PCPs), medical students, and nurses. None of the papers featured oncologists or surgeons.

Conclusions

This review revealed an overall lack of publications which evaluated interventions to assist HCPs discussing hereditary breast cancer risk and testing. Studies failed to operationalize which ‘communication skills’ they included, nor did they consistently report randomization, outcome measures, or analysis.

Discussing the need for, and management of, genetic testing for inherited cancer risk with individuals and their families can be challenging. As genetic testing in breast cancer becomes more common, the provision of specific communication-based training programs, with reference to genetic testing, risk assessments, and counseling skills is warranted.

Electronic supplementary material

The online version of this article (10.1007/s10549-020-05741-z) contains supplementary material, which is available to authorized users.

Keywords: Breast cancer, Communication, Education, Genetic counseling, Genetic testing, Systematic review

Introduction

A generally greater uptake of cancer risk assessments, availability of direct-to-consumer tests, and growing insurance coverage for these services has led to increasing demand for genetic services [1, 2]. This is particularly evident regarding hereditary breast cancer, which reportedly comprises ≈5% of all breast cancer presentations, and where BRCA1 and 2 mutations put an individual at higher individual risk of additional cancers [36].

The call for accessible genetic services has grown exponentially since the identification of BRCA1 (1994) and BRCA2 genes (1995). Furthermore, publicity surrounding high-profile celebrity cases (e.g., Angelina Jolie) significantly increased public awareness of the genetic risk to cancer [3, 79]. However, such demand generally exceeds the availability of counseling services [911]. Consequently, many different healthcare providers (HCPs) may be involved in discussions about the need for genetic testing, the consequences of a test result for an individual, and the ensuing implications for other family members [10]. Genetic counselors or geneticists, primary care physicians making genetic referrals, specialist breast care nurses, oncologists, or surgeons may all have a significant role in explaining the issues surrounding testing with individuals and their families [3, 5, 8, 12, 13]. The timing and format of these conversations can impact the value they have for individuals and the overall health system [4]. For example, a primary care physician conducting an early risk assessment appropriately for someone worried about their own risk might well be sufficient and ease the pressure on genetic services [3, 14].

Providing genetic risk assessment, testing, and counseling necessitates an appropriate knowledge base and good communication skills [15] including the ability to build rapport, while providing a clear explanation of risk, empathy, and a genuinely client-centered approach [1618]. Rather than being prescriptive, the counselor needs to provide guidance and support thereby reinforcing an individual’s autonomy [19].

Genetic counseling has historically consisted of two main components, a pre- and post-test discussion. The pre-test session outlines information about the test and its outcomes, the provision of informed consent, and a discussion about family history and risk assessment [2022]. If the patient proceeds with testing, the post-test session builds on pre-test information while providing the test result itself [20]. Some patients may decline testing or there may not be a clinical need to proceed. Other methods of counseling are being used to provide services for a growing population with geographical diversity, such as telephonic sessions, group introductions, and pre- and post-test sessions delivered by different health professionals (e.g., a genetic counselor only seeing high-risk patients for a post-test consultation) [23].

Individual responses to test results vary, be they positive, negative, or a variant of uncertain significance (VUS). Effective counseling should then pre-empt and prepare a counselee for each of these outcomes with appropriate psychosocial support [17, 21]. In order to do this, HCPs need commensurate levels of genetic knowledge and interpersonal skills to help an individual navigate complex ethical, familial, and legal issues [5, 24]. Not only do individuals have varying information needs, but HCPs need to be able to interpret and clearly convey the risk information, and corresponding referral and management options [19, 20, 25, 26]. Consultations that are vague, overly complex, jargonistic, or are dominated by the clinician are deemed the most unsatisfactory [19, 26, 27]. Both members of the public and HCPs may have poor numeracy and struggle to understand risk-based information [19, 28]. This confusion can prohibit engagement and lead to conversations that result in misinformed decision making [15, 26]. Communication should then be both process and content-focused, providing correct information with relevant interpersonal skills.

These conversations play an important role in informing not only an individual’s own choices about treatment and surveillance, but potentially those of other members of their family [4, 7, 2931]. Unfortunately, there is evidence that HCPs without specific genetic training often lack confidence and knowledge about the referral pathway, the genetic background of inheritance, or how to speak to individuals about genetic testing and risk assessment [11, 24, 3234]. There are also concerns that without appropriate guidance, individuals may struggle to manage the psychological burden of testing and the future implications of any results [4, 35].

There has been considerable research around aids and interventions for the counselee [5, 24, 30, 36], along with exploration of the genetic counseling process and dialogue [18, 37]. However, training interventions directed at HCPs communicating risk and genetic based information are rare and less well evaluated.

Our systematic review examined the published literature to identify if, and how, communication skills were being included in educational materials for HCPs discussing hereditary breast cancer. As noted, good communication involves both process and content-based work. Reference to ‘communication skills’ within this paper then refers to a combination of both. Understanding this landscape can inform future training programs as a broader group of HCPs become involved in conversations about genetic testing for hereditary mutations relevant to breast cancer risk.

Methods

The review is registered on the PROSPERO database (CRD42019124010) and was conducted following the Preferred Reporting Items for Systematic Review and Meta-analyses (PRISMA) statement.

Our specific objectives were to (a) identify published educational interventions available for HCPs discussing genetic testing in relation to breast cancer risk, (b) understand the components that make up these programs, including how communication skills were operationalized/defined, and (c) synthesize reported outcomes of intervention efficacy as dictated by the programs themselves. We consider ‘HCP’ to include genetic counselors/geneticists, medical students, nurses, oncologists, primary care providers (PCPs), and surgeons. This array of disciplines allows for the evolving model of HCPs who might conduct genetic conversations. We did not specify a control arm as the emphasis for this review was to understand the current landscape of available materials. We anticipated studies to report on outcomes such as HCP confidence and competence along with including their own working model or definition of communication skills.

Eligibility

Studies were included if they were published between 1995 and February 2019, with the earlier parameter selected in line with the discovery of the BRCA genes. We anticipated a small and disparate body of literature and as such were deliberately inclusive in our criteria to maximize the number of eligible studies identified; papers were eligible if they reported an educational intervention conveying genetic information. These studies did not have to report solely on testing within breast cancer, as they could be embedded within a larger suite of training. However, they did need to directly reference breast cancer genetic material. We also included papers discussing the development of these interventions.

We excluded studies that purely reported population-based testing or outcomes, including patient or public understanding of genetic testing, and those that only discussed analytic components of an assay or clinical outcomes associated with genetic test results, e.g., chemotherapy outcomes. Finally, we omitted papers that aimed to educate the public or patients on genetic testing, did not include any information relevant to hereditary breast cancer, were not available in English, or were conference abstracts/letters/editorials.

Procedure

Our search terms were grouped into four categories for healthcare professionals, communication, interventions, and the population (Supplement 1).

Terms were combined with Boolean operators and searched using EMBASE, CINAHL, PUBMED, and PsycINFO. Searches were saved into an EndNote X7 library and duplicates were removed using the in-built feature, coupled with a hand search.

Once duplicates were removed, titles and abstracts were screened by two authors (RS, VS) for relevance. The remaining items were independently screened for their eligibility before confirming the final selection of papers for forward and backward searching. Those articles identified through forward/backward citation searching were confirmed against the eligibility criteria before being added to the final selection (Fig. 1).

Fig. 1.

Fig. 1

The PRISMA 2009 flow diagram

Analysis

Data were extracted by one author (RS) and reviewed both for accuracy and completeness by a second (VS). The type of data extracted captured basic information about the article, the population, participant retention, the intervention itself including methods used, and the overall results.

Quality assessment was carried out for each study using the Effective Public Health Practice Project Quality Assessment Tool for Quantitative Studies (EPHPP) [38]. This tool was selected for its use in public health, with less reliance on statistical outcomes. The assessment comprised six components (selection bias, study design, confounders, blinding, data collection method, and withdrawals/dropouts), which were scored as ‘weak’, ‘moderate’, or ‘strong’. Papers were given a global rating using the same scale. While the review outcomes focused on intervention content, having a quality assessment tool allowed for standardized comparisons to be made across papers. Two reviewers (RS/VS) completed these assessments independent of one another before discussing and confirming global ratings.

Results

The initial search returned 3,988 items, of which 1,588 were duplicates. The remaining 2,400 papers were reviewed by title and abstract for relevance, with eight items then screened against eligibility criteria. Of these, three were found to be pertinent with a further four identified through subsequent forward and backward citation searching. Seven papers meeting the inclusion criteria were included with two linked publications, reporting on the same study but focusing on different outcomes [39, 40]. These will be referred to separately for the purposes of discussing methods and outcomes.

Sample characteristics

The final seven papers involved a range of HCP audiences, including PCPs [3941], nurses [4244], physicians [42, 43], genetic counselors [42], and medical students [45]. Three (four papers) of the six interventions used a randomized study design [3941, 44]. Table 1 summarizes the extracted data from each study.

Table 1.

Intervention characteristics and outcomes

Author, Year, Country Population N Objectives Training Content Outcomes Key results
Randomized
Bell, 2014a, USA PCPs

3442 approached

155 enrolled

77 intervention

78 control

121 completed

60 intervention

61 control

To explore whether an educational intervention was more effective than a control at:

-Improving risk assessment for hereditary BC

-Discussing genetic testing/counseling including ELSI

Intervention: 6 h web-based curriculum covering:

-Background of genetic testing

-Risk assessment

-Practice behaviors

-Communication skills

-Intervention employed clinical cases/tutorials on epidemiology and ELSI

Control

Carried out self-directed learning covering clinical genetics, ELSI, doctor–pt interaction and clinical reasoning

Outcomes collected approximately 1 month after training

SP visits were conducted and analyzed using qualitative appraisal of topics and questions covered by the PCP

Participant differences No significant grp differences in demographics, years of experience or experience with inherited BC

Results:

Arms did not significantly differ on counseling behaviors, soliciting personal history, or discussing ELSI

Intervention arm more likely to discuss benefits of counseling (37/60.7% control, 47/78.3% intervention, p 0.05), encourage SP to make decisions after genetic counseling (13/21.3% control, 23/38.3% intervention, p 0.05), ask about male relatives with prostate cancer (p 0.006), and discuss increased risk of cancer for male relatives (1/1.6% control, 12/ 20% intervention, p 0.001)

Intervention grp significantly less likely to ask about Ashkenazi Jewish heritage (21/34.4% control, 8/13.3% intervention, (p 0.01)

When asked “what would you do”, intervention grp significantly less likely to respond definitively that they would get tested (33/54.1% control, 20/33.3% intervention, p 0.03), and more likely to say it was the SP’s decision (n.s.)

Houwink, 2014, The Netherlands GPs

2100 approached

88 enrolled

46 intervention

42 control

56 completed

38 intervention

18 control

Aim of improving

-Recall of details about hereditary cancer

-Recognition of pts at risk of inheritance

-Pedigree drawing

-Discussing hereditary risks, including management and ethical issues

-Identification of pts for referral of risk assessment

-Explaining the possibilities and limitations of oncogenetic testing

-Knowing when to contact a genetic specialist

Intervention

Training featured:

-Hereditary forms of cancer

-Discussion with pts who had a history of BRCA testing

-Role-play of scenarios

Control:

Did not receive any additional training; this was offered later

All participants received a visit from an SP at baseline, 1, & 3 months post intervention

Intervention grp only Questionnaires on applicability of gained knowledge and satisfaction with training. Latter questionnaire asked whether participants would recommend training and if it was relevant to practice

Participant differences:

Grps did not differ significantly on age, sex, years, or type of experience or pre-test performance

Results

SPs Significant between grp performance difference of 0.19 (p < 0.0005) 1 month post intervention, not present at baseline or 3 months post

Further regression analysis covarying for pre-test score, using the control grp score as reference, revealed a moderate effect size at 1 month post (standardized regression coefficient = 0.34) which was reduced, though still moderate, at 3 months (standardized regression coefficient = 0.28)

Applicability

Questionnaire completed by 17/38 participants; 65% reported applying their learnt skills monthly, 35% weekly

Satisfaction

Questionnaire completed by 18/38

Average response to both questions was 4.4/5

Average global grade for course was 7.7/10

Masny, 2008, USA

Nurses: 80% from a community setting

20% from a cancer center

Unk approached

41 enrolled

20 intervention

21 control

25 completed, unk by arm

Program aimed to improve:

-Understanding of clinical cancer genetics

-Knowledge of genetic assessment, syndromes and pedigrees

-Communication of testing benefits and limitations

-Evaluation of ELSI and psychosocial issues for individuals and their family

-Integrate knowledge of risk estimation models

-Development of follow up plans

Apply skills to disclosure

-Utilization of a mentor service to improve critical thinking and counseling skills

Intervention

Training covered:

-Review of molecular cancer genetics

-Cancer risk assessment

-Benefits and limitations of genetic technologies

-Case studies illustrating psychosocial and ELSI concerns

-Cancer risk estimation

-Medical management for high-risk breast/ovarian carriers

-Pre- and post-test counseling including decisional support

-Overview of mentorship and professional development

Control

Same training but mentorship delayed 3 to 6 months from course completion

Mentorship program assessed on increased networking skills, self-efficacy and provided support for continued learning

Changes to networking and self-efficacy assessed by questionnaire at baseline, 3, and 6 months

Mentorship activity documented via a log with a telephone interview between participants and health educators to discuss the experience

Participant differences

Grps did not differ on education, working with, or experience of, a Cancer Risk Assessment program

Results

Analyses are combined for control and intervention arms

There was a significant improvement in self-efficacy for the entire grp including: explanation of genetic concepts, assessment of cancer risk, development of differential syndrome list, interpretation and disclosure of results, discussion of cancer screening, chemoprevention and prophylactic surgery (all p < 0.05 with an average mean change across domains of .91 on a scale of 1–5)

There was an increase in networking between genetic nurses and counselors from 17 participants at baseline to 33 at 6 months

Participants felt there was benefit to the mentoring program

Wilkes, 2017a, USA See Bell 2014

Self-efficacy

28 items; 20 capturing self-efficacy for genetically related skills or knowledge, pre and post intervention, both grps

Knowledge

43 items covering breast/ovarian cancer genetics, genetic testing, SDM, ELSI, venous thromboembolism, and perinatal/pediatric genetic testing. Pre and post intervention, both grps

Program assessment

Grps assessed curriculum on a number of features

Pre- and Post-intervention objective structured video exercises (OSVE)

6 videos assessing clinical thinking, judgment, and intended behaviors

SP visit

This SP was a woman at risk for inherited BC visiting about 5 weeks after the intervention. This was recorded, transcribed, and coded

Participant differences

No significant between grp differences for demographics, years of practice, or experience with inherited BC

Results:

92% of intervention participants viewed all of the content, control participants an average of 87%

Self-efficacy

Clinical skills efficacy and genetic knowledge, both assessed on a scale of 1–5, improved in both arms p < 0.01, with significant between grp differences (p 0.02 for both). Clinical skills self-efficacy: Intervention: 3.0 (2.8 – 3.1)—> 3.8 (3.6–3.9) Δ = 0.8 (0.6–0.9); Control: 3.0 (2.9–3.2)—> 3.6 (3.5–3.7) Δ = 0.6 (0.4–0.7). Genetic knowledge: Intervention: 2.4 (2.3 – 2.6)—> 3.4 (3.3–3.6) Δ = 1.0 (0.9–1.1); Control: 2.5 (2.4—2.6)—> 3.3 (3.1–3.4) Δ = 0.8 (0.6–0.9)

Knowledge

Both arms significantly improved their cumulative knowledge, knowledge about BRCA genetics, BC, ELSI, and ethics in the pediatric setting, all reported as % correct (Average mean change for intervention: 17.50, for control: 8.25, p < .05 for all within and between grp comparisons aside from ethics in the pediatric setting—between grp p 0.08)

Significant improvement in the intervention grp only was seen for knowledge about genetic testing (67.9—> 80.0, p < 0.01 for within [intervention only] and between) and general genetics/VTE (65.5—> 86.9, p < 0.01 for within [intervention only] and between)

Neither grp improved in SDM

Program assessment

Intervention grp significantly more likely to rate the course highly and recommend to colleagues (p < .0001 for both, no further detail available)

OSVE

Both grps improved significantly (Intervention 11.4—> 14.2 p < 0.01; Control 11.2–> 13.8 p < 0.01 for both) without significant between grp differences. Possible scores ranged from 0–40

SP visits

SPs tended to score the intervention arm more highly on their communication skills, offering options for care, being encouraged to ask questions, feeling listened to and having enough time

Participants in general asked about 20% of the personal and family history questions but did not spend as much time on psychosocial concerns

Not randomized, with a control
McGovern, 2010, USA 3rd year medical students

Unk approached

136 enrolled on SP program

121 completed

63 controls completed 6-month assessment. Unclear how many controls completed baseline assessment

To assess SP program at improving medical students’ assessment and communication of genetic information and risk

All students received an orientation lecture including information about cancer genetics, BRCA, surveillance options, risks and benefits of testing, ELSI, and pedigree analysis. A sub-set of these students took part in an SP program

Intervention

Students met with SP twice: pre-disclosure and disclosure

Students were expected to capture a pedigree, medical history, discuss testing options, and deliver a result with explanation of its meaning and implications for treatment and family concerns

Skill level

5-point Likert scale to self-assess skill levels for:

-taking medical and family histories

-drawing a pedigree

-assessing and communicating genetic risks

All students completed this prior to orientation lecture and 6 months after the program. Students in the SP program also completed this prior to each visit

SP checklist

SPs completed a checklist about the student’s communication skills following each visit

Knowledge test

8-item test given before the 2nd SP visit

Student evaluation

Students evaluated SP program after each visit on a 5-point Likert scale for clarity of instruction, realism, adequacy of time, usefulness of the exercise, and any areas to improve their own skills

Participant differences

Not included

Results

Skill level

On a 5-point scale, skill levels improved in the intervention grp between baseline and prior to SP1 on drawing a pedigree (1.6—> 3.6; p < 0.01) and assessing genetic risk (1.3–> 2.7; p < 0.05); and between prior to SP1 and prior to SP2 on obtaining medical history (3.3—> 4.1; p < 0.05), assessing genetic risk (2.7–> 4.3; p < 0.01), and communicating risk (2.4–> 3.8; p < 0.01)

Significant differences in skill levels were reported between the intervention and control grps at 6 months on drawing a pedigree (4.2, 2.4; p < 0.01), assessing genetic risk (3.7, 1.9; p < 0.01), and communicating risk (3.9, 2.2; p < 0.05); however, this analysis is problematic as baseline scores for control grp are not reported

SP checklist

These assessments demonstrated that students had good contracting, communicating, and closure skills with 90% eliciting a family history at the 1st encounter

Only 60% explored how the SP could use the results or provided any visual aids

In the 2nd encounter, 96% were able to communicate medical risks and management options but only 60% could explain the risk of cancer or address emotional concerns

Student evaluation

90% of participants agreed that the program was useful in identifying areas for improvement with 95% noting improved confidence

No comparator
Blazer, 2005, USA Genetic counselors, masters level advanced nurse practitioners, physicians

Unk approached

40 enrolled

29 completed

-Demonstrate knowledge of relevant genetic and oncology principles

-Assess personal and family history for pedigree analysis

-Recognize features of hereditary cancer syndromes

-Apply risk assessment and testing strategies

-Recommend risk-appropriate surveillance and prevention

-Communicate ELSI and psychological issues

-Participate in MDT of practitioners

Course covered basic genetic material including a wet lab, oncology content, cancer risk counseling skills with mock risk assessments and practice sessions, and hereditary cancer syndromes

Participants attended a 2-week on-site training program

Course was delivered using workshops, journal clubs, MDT attendance, wet labs, practice counseling sessions, and a cancer genetic conference

Knowledge test

40 true/false items pre and post course covering cancer genetics, oncology, cancer syndrome recognition, cancer risk assessment, genetic testing, and ELSI

Professional development and practice outcomes survey

A checklist of prescribed post-course activities was completed 6 months after course completion with a clinical practice survey completed after a year

Participant satisfaction

CME evaluation of each module was attached to the final exam

Knowledge

There was a significant knowledge gain from 65 to 80% correct post intervention (t(39) = 6.67; p < .0.001)

Professional development

35 (80%) of participants completed and returned this evaluation at 6 months. All respondents had completed their designated reading assignments and some presented the information to other professionals

Of the 29 participants who responded to the 1-year post-course survey, 7 had, or were in the process, of setting up a new genetic risk assessment practice

22 (76%) said the course had improved their professional self-efficacy and 18 (62%) said the course improved their ability and confidence

Participant satisfaction

95% of respondents said they continued to use and benefit from the course material

Lee, 2013, Korea Doctors, nurses, and 1 ‘other medical professional’

Unk approached

35 enrolled

33 and 30 completed the final awareness and knowledge test, respectively

To assess the effect of genetic counseling education on HCP knowledge, awareness, and counseling skills for pts at high risk for HBOC

3-day training event with lectures on cancer genetics, hereditary BC, HBOC of the Korean population, genetic testing and interpretation, ELSI, and pre- and post-test counseling

Hands on practice sessions for risk assessment, pedigree drawing, and counseling

Participants completed pre- and post-course 49 true/false knowledge questions along with questionnaires capturing:

AW—awareness of genetic counseling education

AK—confidence in ability to perform counseling

AS—confidence in counseling practice

Overall knowledge scores improved significantly at post-test with 30 responders (37.40 ± 4.64—> 40.20 ± 2.52; maximum possible score 49, p = 0.002) with significant improvement in the areas of hereditary BC syndromes (5.58 ± 1.32—> 7.68 ± 0.77; p < 0.0001 9 items), pre-test counseling (10.0 ± 1.05–> 11.0 ± 0.98; p 0.001 12 items), and genetic testing & interpretation (3.20 ± 0.92–> 3.93 ± 0.25; p 0.001 4 items)

Cancer genetics and post-test counseling were significantly worse (3.97 ± 1.16–> 3.20 ± 0.71; p 0.006 5 items and 9.66 ± 1.79–> 8.80 ± 1.45; p 0.02 12 items, respectively)

For the 33 participants who completed the awareness and confidence questionnaires, there was significant improvement across all 3 categories (AW 2 items: 3.87 ± 0.55—> 4.72 ± 0.37 t 8.963, AK 7 items: 3.13 ± 0.87—> 4.35 ± 0.52 t 9.819, AS 9 items: 3.18 ± 0.76—> 4.27 ± 0.53 t 8.727, all p < 0.001)

Of 12 participants who provided feedback, 6 identified the importance of communication skills. Most respondents wanted more educational programs about counseling practice

ELSI ethical, legal, and social issues, GP general practitioner, PCP primary care physician, SDM shared decision making, SP standardized patient

aBell and Wilkes are linked papers reporting on the same study. The Bell paper focuses on the quantitative information stemming from the SP assessment, while Wilkes features self- and assessor-reported outcomes

Intervention characteristics

One intervention utilized a web-based platform [39, 40], with the remaining five adopting face-to-face approaches [4145] of traditional lecture formats [4145], counseling role play scenarios [4144], risk assessment practice [4244], lab experience [42], patient discussions [41], and mentorship [44].

The training focused on topics such as communication/counseling skills [3945], genetic testing principles [39, 40, 4245], psychosocial and ethical, legal, and social issues (ELSI) [39, 40, 4345], hereditary cancers/BRCA [4143, 45], and risk assessment [39, 40, 44].

Interventions provided face-to-face were either completed in one day [41], over multiple days up to two weeks [4244], or a longer expanse of time [45]. The web-based intervention took six hours to complete [39, 40].

Outcomes

Across the papers, the most common outcome assessed was communication skills but there was a lack of specificity as to what this comprised [3941, 43, 45]. There was an inconsistency as to whether communication outcomes referenced process work or the correct dissemination of information. For those studies that used standardized patients (SPs) to assess candidate performance, both elements of communication skills were referenced [39, 40, 45]. In one intervention, counseling skills were assessed before and after the training using a knowledge test, including items about the competences required during counseling and for disclosure of test results. Skills relating to counseling prior to genetic testing significantly improved, while those concerning test results significantly decreased post intervention [43]. While practice sessions were included within the intervention, there was an absence of information as to the specific communication elements imparted. Other studies captured communication skills via knowledge or efficacy measures, again without clear detail on content [42, 44].

Self-efficacy and confidence were reported as outcomes in four studies [40, 4345]. This was sometimes described as confidence in counseling practice [43] or clinical skills efficacy [40]. In other studies, self-efficacy was broadened to include concepts such as assessing risk, drawing a pedigree, obtaining a medical history, interpreting results, and discussing screening [44, 45]. In general, self-efficacy scores significantly improved between pre and post intervention [40, 4345]. Two papers with a comparator arm [40, 45] reported significant between group differences; however, only one reported post-intervention scores for both groups rendering it impossible to assess the true impact of the intervention [45].

Similarly, knowledge was assessed in four studies with tests covering topics such as genetic testing, shared decision making, ELSI, cancer genetics, and hereditary syndromes including breast cancer [40, 42, 43, 45]. One study compared knowledge scores pre and post attendance in both the intervention and control arms [40]. While neither arm improved on shared decision making, both had significant improvements in overall knowledge and subsets of BRCA genetics, breast cancer, and ELSI, with further significant improvements in the intervention arm for understanding genetic test ordering and general genetics. Two papers report significant gains in overall knowledge [42] [43]. One further study used a knowledge test but did not provide the scores within the current paper [45].

Four papers reported participant satisfaction with the training program [4042, 45], often evaluated at the end of the program apart from one that assessed clarity of instruction, realism, and overall usefulness following each SP visit [45]. In another study, 95% of participants cited continued use and benefit from the course material [42]. A further paper noted that 12/35 attendees completed course feedback; most wanted more counseling practice with six individuals highlighting the importance of communication skills [43].

Quality assessment

All studies were given a ‘weak’ global rating on the EPHPP (two or more of the six categories scored as ‘weak’), though studies did receive some ‘moderate’ and ‘strong’ scores in individual categories. No study outlined randomization procedures. Only one received a ‘moderate’ score for selection bias as there was enough information to assume the intervention group were similar to the target population [45]. Two studies reported group differences, or confounders, between the intervention and comparator at baseline [40, 41]. Another two described both the reliability and validity of their measures [40, 42], with reliability mentioned in a further two reports [39, 43] and validity by one other [41].

The quality assessment for drop-out and withdrawal rates presented a range of scores with three papers receiving a ‘weak’ rating due to a lack of transparency of baseline numbers or low completion rates [41, 42, 45], three a ‘moderate’ rating owing to the amount of drop outs [39, 40, 44], and one paper received a ‘strong’ rating [43].

Discussion

This systematic review identified seven published papers featuring six interventions provided to HCPs communicating risk-based information about hereditary breast cancer. The participants were various groups of HCPs but primarily PCPs [3941] and nurses [4244]. The use of SPs was prominent across interventions to simulate that of a real clinical encounter. This provided participants with an opportunity to practice counseling skills, often resulting in improved self-reported efficacy and confidence. Within those studies that reported participant satisfaction, it was clear that individuals felt they had benefitted from their training and were keen to engage with more materials.

There was however a lack of detail about the specific communication behaviors included in training. From the descriptions provided, it was unclear how much the studies discussed the content of what to include in conversations versus the process of conveying that information. In line with genetic counseling models, which we used to inform our understanding of which communication skills were most likely to be included in training courses, we anticipated reference to both the correct dissemination of information alongside interpersonal skills such as empathic understanding and chunking and checking information [15, 20, 21, 23]. Successful genetic counseling conversations require not only an ability to explain risk in a manner that aids understanding but also rapport and empathy [15, 18]. Consultations should therefore incorporate components of genetic counseling, education, and psychosocial well-being [21]. While these topics may have been covered within the educational programs, they were not specifically referenced or reported. This review set out to understand the communication elements within HCP training programs, particularly the presence of both process and content-based skills. However, a lack of clear definition within the studies precluded a true assessment of their presence and impact.

Given the implications of genetic conversations, there is a need for interventions which address HCP confidence and skill when navigating these complex issues [5, 29, 31, 32]. This is especially true as more responsibility is given to a wider population of HCPs to engage in this dialogue. There was a dearth of reported interventions for oncologists or surgeons who may be the first point of contact for an individual. Previous systematic reviews have been conducted looking at groups of HCPs in isolation, such as PCPs [46]. However, as genetic consultations are being carried out in various ways, and often with different types of clinician working together (e.g., oncologist and geneticist), the focus in this review was on clinicians as a whole to reflect this changing landscape and a diverse MDT [23]. In addition, the lack of relevant published papers, and the overall weak quality scores, in this review indicates a need for robust evaluation of these training programs built on recommendations from the genetic counseling field.

Research recommendations

A lack of definition across the studies for what constituted counseling skills demonstrates a need for future research to clearly operationalize this concept from the outset. There is a clear need for future training and assessment to focus on the process of communication [16, 19]. Our results suggest this could be beneficial as it was not clear from the interventions whether or not ‘good’ communication was characterized solely by the correct transmission of factual information or the actual process and engagement. The use of a framework or inclusion of specific communication tools would add clarity to what is currently an ambiguous understanding.

The psychosocial support provided to individuals during a genetic consultation is just as important as knowledge exchange [18, 20, 26] yet only two studies reported on a general lack of discussion between HCP and SP about these concerns [40, 45]. As these elements are a key feature of risk-based testing and decision making, it is important for future work to be more explicit as to how training targets the ability to communicate in this way.

While the client–HCP interaction is paramount, it is also necessary to explore interdisciplinary communication. This is especially so as more genetic testing information is provided via a team approach. While our findings demonstrate training materials are available, we did not identify any published interventions that were available for multi-disciplinary teams (MDTs). For example, genetic referral pathways may include surgical, nursing, and oncology input and yet training was not available in one setting, which can help ensure consistent communication. To that end, we have secured funding to develop a training program in this area, which will be informed by this systematic review.

Practice implications

While the predominant outcomes of this review relate to future research, there are still practice implications to be gleaned. With a lack of published training targeting a complete MDT, it is important for colleagues to work together to understand how genetic information is being relayed to avoid confusion or contradiction.

This review suggests that some studies convey measurable benefits for HCPs, many of whom desire to undertake further counseling training. More evidence-based interventions may then assist HCPs when talking with individuals who potentially carry gene mutations.

Study limitations

We identified only those papers published in peer-reviewed journals and there may be further information in gray literature and conference abstracts/editorials/letters. Our focus on published material was to understand the training programs which had been evaluated in some way. There may be other interventions available for HCPs that have gone unreported. In hindsight there may have been limitations to using the EPHPP tool. While this is a good quality assessment measure, the nature of the papers inherently leant themselves to receive lower scores primarily due to non-randomization and lack of control arms. However, we felt it was important to use a tool to help standardize our assessments without prior knowledge of the types of studies our searches would find.

Conclusion

This systematic review set out to explore what published training interventions were available for HCPs discussing genetic testing and hereditary risk for breast cancer. This process demonstrated a lack of formally evaluated training programs. All seven papers reported on communication outcomes with particular use of an SP. Other outcomes such as knowledge, confidence/self-efficacy, and program satisfaction were captured. However, what is evident is a lack of consistent training materials used, with demonstrable paucity of support specifically for oncologists/surgeons.

There is increasing demand for genetic services within breast cancer, either to identify inherited risk or to personalize treatment options. In response to this, there is a commensurate need to ensure those HCPs tasked with helping individuals navigate the complex world of genetic breast cancer testing are well versed in conveying risk-based information.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Acknowledgements

This work was supported by a grant to Professor Dame Lesley Fallowfield from the Breast Cancer Research Foundation.

Compliance with ethical standards

Conflicts of interest

All authors declare that they have no conflict of interest.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Tandy-Connor S, Guiltinan J, Krempely K, LaDuca H, Reineke P, Gutierrez S, Gray P, Tippin Davis B. False-positive results released by direct-to-consumer genetic tests highlight the importance of clinical confirmation testing for appropriate patient care. Genet Med. 2018;20(12):1515–1521. doi: 10.1038/gim.2018.38. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Francke U, Dijamco C, Kiefer AK, Eriksson N, Moiseff B, Tung JY, Mountain JL. Dealing with the unexpected: consumer responses to direct-access BRCA mutation testing. PeerJ. 2013;1:e8. doi: 10.7717/peerj.8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.McAllister M, O'Malley K, Hopwood P, Kerr B, Howell A, Evans DGR. Management of women with a family history of breast cancer in the North West Region of England: training for implementing a vision of the future. J Med Genet. 2002;39(7):531–535. doi: 10.1136/jmg.39.7.531. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Meisel SF, Fraser LSM, Side L, Gessler S, Hann KEJ, Wardle J, Lanceley A. Anticipated health behaviour changes and perceived control in response to disclosure of genetic risk of breast and ovarian cancer: a quantitative survey study among women in the UK. BMJ Open. 2017 doi: 10.1136/bmjopen-2017-017675. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Jbilou J, Halilem N, Blouin-Bougie J, Amara N, Landry R, Simard J. Medical genetic counseling for breast cancer in primary care: a synthesis of major determinants of physicians' practices in primary care settings. Public Health Genomics. 2014;17(4):190–208. doi: 10.1159/000362358. [DOI] [PubMed] [Google Scholar]
  • 6.Beitsch PD, Whitworth PW, Hughes K, Patel R, Rosen B, Compagnoni G, Baron P, Simmons R, Smith LA, Grady I, Kinney M, Coomer C, Barbosa K, Holmes DR, Brown E, Gold L, Clark P, Riley L, Lyons S, Ruiz A, Kahn S, MacDonald H, Curcio L, Hardwick MK, Yang S, Esplin ED, Nussbaum RL. Underdiagnosis of hereditary breast cancer: are genetic testing guidelines a tool or an obstacle? J Clin Oncol. 2019;37(6):453–460. doi: 10.1200/jco.18.01631. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Matsen CB, Lyons S, Goodman MS, Biesecker BB, Kaphingst KA. Decision role preferences for return of results from genome sequencing amongst young breast cancer patients. Patient Educ Couns. 2019;102(1):155–161. doi: 10.1016/j.pec.2018.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Eccles BK, Copson E, Maishman T, Abraham JE, Eccles DM. Understanding of BRCA VUS genetic results by breast cancer specialists. BMC Cancer. 2015;15(1):936–944. doi: 10.1186/s12885-015-1934-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Green MJ, Peterson SK, Baker MW, Harper GR, Friedman LC, Rubinstein WS, Mauger DT. Effect of a computer-based decision aid on knowledge, perceptions, and intentions about genetic testing for breast cancer susceptibility: a randomized controlled trial. JAMA. 2004;292(4):442–452. doi: 10.1001/jama.292.4.442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Milliron KJ, Griggs JJ. Advances in genetic testing in patients with breast cancer, high-quality decision making, and responsible resource allocation. J Clin Oncol. 2019;37(6):445–447. doi: 10.1200/jco.18.01952. [DOI] [PubMed] [Google Scholar]
  • 11.Green MJ, Peterson SK, Baker MW, Friedman LC, Harper GR, Rubinstein WS, Peters JA, Mauger DT. Use of an educational computer program before genetic counseling for breast cancer susceptibility: effects on duration and content of counseling sessions. Genet Med. 2005;7(4):221–229. doi: 10.1097/01.GIM.0000159905.13125.86. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Gaff C, Aittomäki K, Williamson R. Oncology nurse training in cancer genetics. J Med Genet. 2001;38(10):691–695. doi: 10.1136/jmg.38.10.691. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Cragun D, Besharat AD, Lewis C, Vadaparampil ST, Pal T. Educational needs and preferred methods of learning among Florida practitioners who order genetic testing for hereditary breast and ovarian cancer. J Cancer Educ. 2013;28(4):690–697. doi: 10.1007/s13187-013-0525-6. [DOI] [PubMed] [Google Scholar]
  • 14.Miller SM, Fleisher L, Roussi P, Buzaglo JS, Schnoll R, Slater E, Raysor S, Popa-Mabe M. Facilitating informed decision making about breast cancer risk and genetic counseling among women calling the NCI's Cancer Information Service. J Health Commun. 2005;10(Suppl 1):119–136. doi: 10.1080/07366290500265335. [DOI] [PubMed] [Google Scholar]
  • 15.Witt MM, Jankowska KA. Breaking bad news in genetic counseling-problems and communication tools. J Appl Genet. 2018;59(4):449–452. doi: 10.1007/s13353-018-0469-y. [DOI] [PubMed] [Google Scholar]
  • 16.Biesecker BB, Peters KF. Process studies in genetic counseling: Peering into the black box. Am J Med Genet. 2001;106(3):191–198. doi: 10.1002/ajmg.10004. [DOI] [PubMed] [Google Scholar]
  • 17.Trepanier A, Ahrens M, McKinnon W, Peters J, Stopfer J, Grumet SC, Manley S, Culver JO, Acton R, Larsen-Haidle J, Correia LA, Bennett R, Pettersen B, Ferlita TD, Costalas JW, Hunt K, Donlon S, Skrzynia C, Farrell C, Callif-Daley F, Vockley CW. Genetic cancer risk assessment and counseling: recommendations of the national society of genetic counselors. J Genet Couns. 2004;13(2):83–114. doi: 10.1023/b:jogc.0000018821.48330.77. [DOI] [PubMed] [Google Scholar]
  • 18.Lobb E, Butow P, Meiser B, Tucker K, Barratt A. How Do Geneticists and Genetic Counselors Counsel Women from High-Risk Breast Cancer Families? Journal of Genetic Counseling. 2001;10(2):185–199. doi: 10.1023/a:1009447932274. [DOI] [Google Scholar]
  • 19.Paul J, Metcalfe S, Stirling L, Wilson B, Hodgson J. Analyzing communication in genetic consultations–a systematic review. Patient Educ Couns. 2015;98(1):15–33. doi: 10.1016/j.pec.2014.09.017. [DOI] [PubMed] [Google Scholar]
  • 20.Rich TA, Salazar M. Genetic risk assessment, counseling and testing. Surg Oncol Clin N Am. 2009;18(1):19–38. doi: 10.1016/j.soc.2008.08.004. [DOI] [PubMed] [Google Scholar]
  • 21.Riley BD, Culver JO, Skrzynia C, Senter LA, Peters JA, Costalas JW, Callif-Daley F, Grumet SC, Hunt KS, Nagy RS, McKinnon WC, Petrucelli NM, Bennett RL, Trepanier AM. Essential elements of genetic cancer risk assessment, counseling, and testing: updated recommendations of the National Society of Genetic Counselors. J Genet Couns. 2012;21(2):151–161. doi: 10.1007/s10897-011-9462-x. [DOI] [PubMed] [Google Scholar]
  • 22.Vadaparampil ST, Malo TL, Nam KM, Nelson A, de la Cruz CZ, Quinn GP. From observation to intervention: development of a psychoeducational intervention to increase uptake of BRCA genetic counseling among high-risk breast cancer survivors. J Cancer Educ. 2014;29(4):709–719. doi: 10.1007/s13187-014-0643-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Buchanan AH, Rahm AK, Williams JL. Alternate service delivery models in cancer genetic counseling: a mini-review. Front Oncol. 2016;6:120–120. doi: 10.3389/fonc.2016.00120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Rupert DJ, Squiers LB, Renaud JM, Whitehead NS, Osborn RJ, Furberg RD, Squire CM, Tzeng JP. Communicating risk of hereditary breast and ovarian cancer with an interactive decision support tool. Patient Educ Couns. 2013;92(2):188–196. doi: 10.1016/j.pec.2013.04.008. [DOI] [PubMed] [Google Scholar]
  • 25.Rubinelli S, Schulz PJ, Hartung U. “Your risk is low, because …”: argument-driven online genetic counselling. Argument & Computation. 2010;1(3):199–214. doi: 10.1080/19462166.2010.504884. [DOI] [Google Scholar]
  • 26.Joseph G, Lee R, Pasick RJ, Guerra C, Schillinger D, Rubin S. Effective communication in the era of precision medicine: a pilot intervention with low health literacy patients to improve genetic counseling communication. Eur J Med Genet. 2018 doi: 10.1016/j.ejmg.2018.12.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Hovick SR, Tan N, Morr L, Senter L, Kinnamon DD, Pyatt RE, Toland AE. Understanding BRCA mutation carriers' preferences for communication of genetic modifiers of breast cancer risk. J Health Commun. 2019;24(4):377–384. doi: 10.1080/10810730.2019.1604912. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Franklin L, Plaisant C, Minhazur Rahman K, Shneiderman B. TreatmentExplorer: an interactive decision aid for medical risk communication and treatment exploration. Interact Comput. 2014;28(3):238–252. doi: 10.1093/iwc/iwu043. [DOI] [Google Scholar]
  • 29.Silverman TB, Vanegas A, Marte A, Mata J, Sin M, Ramirez JCR, Tsai W-Y, Crew KD, Kukafka R. Study protocol: a cluster randomized controlled trial of web-based decision support tools for increasing BRCA1/2 genetic counseling referral in primary care. BMC Health Serv Res. 2018;18(1):633–644. doi: 10.1186/s12913-018-3442-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Katapodi MC, Jung M, Schafenacker AM, Milliron KJ, Mendelsohn-Victor KE, Merajver SD, Northouse LL. Development of a web-based family intervention for BRCA carriers and their biological relatives: acceptability, feasibility, and usability study. JMIR Cancer. 2018;4(1):e7. doi: 10.2196/cancer.9210. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Légaré F, Robitaille H, Gane C, Hébert J, Labrecque M, Rousseau F. Improving decision making about genetic testing in the clinic: an overview of effective knowledge translation interventions. PLoS ONE. 2016;11(3):e0150123. doi: 10.1371/journal.pone.0150123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Padamsee TJ, Wills CE, Yee LD, Paskett ED. Decision making for breast cancer prevention among women at elevated risk. Breast Cancer Res. 2017;19(1):34–45. doi: 10.1186/s13058-017-0826-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Vadaparampil ST, Scherr CL, Cragun D, Malo TL, Pal T. Pre-test genetic counseling services for hereditary breast and ovarian cancer delivered by non-genetics professionals in the state of Florida. Clin Genet. 2015;87(5):473–477. doi: 10.1111/cge.12405. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Douma KFL, Smets EMA, Allain DC. Non-genetic health professionals’ attitude towards, knowledge of and skills in discussing and ordering genetic testing for hereditary cancer. Fam Cancer. 2016;15(2):341–350. doi: 10.1007/s10689-015-9852-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Augestad MT, Hoberg-Vetti H, Bjorvatn C, Sekse RJ. Identifying Needs: a Qualitative Study of women's Experiences Regarding Rapid Genetic Testing for Hereditary Breast and Ovarian Cancer in the DNA BONus Study. J Genet Couns. 2017;26(1):182–189. doi: 10.1007/s10897-016-9996-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Dorval M, Bouchard K, Chiquette J. Systematic review of educational tools used during the BRCA1/2 genetic testing process. Per Med. 2014;11(1):113–124. doi: 10.2217/pme.13.94. [DOI] [PubMed] [Google Scholar]
  • 37.Dunlop KL, Barlow-Stewart K, Butow P, Heinrich P. A Model of professional development for practicing genetic counselors: adaptation of communication skills training in oncology. J Genet Couns. 2011;20(3):217–230. doi: 10.1007/s10897-010-9340-y. [DOI] [PubMed] [Google Scholar]
  • 38.Thomas BH, Ciliska D, Dobbins M, Micucci S. A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions. Worldviews Evid Based Nurs. 2004;1(3):176–184. doi: 10.1111/j.1524-475X.2004.04006.x. [DOI] [PubMed] [Google Scholar]
  • 39.Bell RA, McDermott H, Fancher TL, Green MJ, Day FC, Wilkes MS. Impact of a randomized controlled educational trial to improve physician practice behaviors around screening for inherited breast cancer. J Gen Intern Med. 2015;30(3):334–341. doi: 10.1007/s11606-014-3113-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Wilkes MS, Day FC, Fancher TL, McDermott H, Lehman E, Bell RA, Green MJ. Increasing confidence and changing behaviors in primary care providers engaged in genetic counselling. BMC Med Educ. 2017;17(1):163–174. doi: 10.1186/s12909-017-0982-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Houwink EJ, Muijtjens AM, van Teeffelen SR, Henneman L, Rethans JJ, van der Jagt LE, van Luijk SJ, Dinant GJ, van der Vleuten C, Cornel MC. Effectiveness of oncogenetics training on general practitioners' consultation skills: a randomized controlled trial. Genet Med. 2014;16(1):45–52. doi: 10.1038/gim.2013.69. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Blazer KR, MacDonald DJ, Ricker C, Sand S, Uman GC, Weitzel JN. Outcomes from intensive training in genetic cancer risk counseling for clinicians. Genet Med. 2005;7:40–47. doi: 10.1097/01.GIM.0000151154.27612.49. [DOI] [PubMed] [Google Scholar]
  • 43.Lee J, Cho HJ, Yoo H-W, Park SK, Yang JJ, Kim S-W, Kang E, Ahn S-H, Lee S-J, Suh YJ, Kim SY, Kim E-K, Moon NM, Lee MH, Korean Hereditary Breast Cancer Research Group KBCS The effects of a genetic counseling educational program on hereditary breast cancer for korean healthcare providers. J Breast Cancer. 2013;16(3):335–341. doi: 10.4048/jbc.2013.16.3.335. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Masny A, Ropka ME, Peterson C, Fetzer D, Daly MB. Mentoring nurses in familial cancer risk assessment and counseling: lessons learned from a formative evaluation. J Genet Couns. 2008;17(2):196–207. doi: 10.1007/s10897-007-9140-1. [DOI] [PubMed] [Google Scholar]
  • 45.McGovern MM, Johnston M, Brown K, Zinberg R, Cohen D. Use of standardized patients in, undergraduate medical genetics education. Teach Learn Med. 2006;18(3):203–207. doi: 10.1207/s15328015tlm1803_3. [DOI] [PubMed] [Google Scholar]
  • 46.Hamilton JG, Abdiwahab E, Edwards HM, Fang M-L, Jdayani A, Breslau ES. Primary care providers' cancer genetic testing-related knowledge, attitudes, and communication behaviors: A systematic review and research agenda. J Gen Intern Med. 2017;32(3):315–324. doi: 10.1007/s11606-016-3943-4. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials


Articles from Breast Cancer Research and Treatment are provided here courtesy of Springer

RESOURCES