Skip to main content
JMIR Nursing logoLink to JMIR Nursing
. 2022 Jan 25;5(1):e31380. doi: 10.2196/31380

Web-Based Training for Nurses on Using a Decision Aid to Support Shared Decision-making About Prenatal Screening: Parallel Controlled Trial

Alex Poulin Herron 1,2, Titilayo Tatiana Agbadje 1, Sabrina Guay-Bélanger 1, Gérard Ngueta 1,3, Geneviève Roch 1,2,4,5, François Rousseau 4,6, France Légaré 1,4,7,
Editor: Elizabeth Borycki
Reviewed by: Maryam Salimi, Dawn Stacey
PMCID: PMC8826152  PMID: 34874274

Abstract

Background

Nurses play an important role in supporting pregnant women making decisions about prenatal screening for Down syndrome. We developed a web-based shared decision-making (SDM) training program for health professionals focusing on Down syndrome screening decisions.

Objective

In this study, we aim to assess the impact of an SDM training program on nurses’ intention to use a decision aid with pregnant women deciding on prenatal screening for Down syndrome.

Methods

In this 2-arm, parallel controlled trial, French-speaking nurses working with pregnant women in the province of Quebec were recruited by a private survey firm. They were allocated by convenience either to the intervention group (web-based SDM course that included prenatal screening) or to the control group (web-based course focusing on prenatal screening alone, with no SDM content). The primary outcome was the intention to use a decision aid. Secondary outcomes were psychosocial variables of intention, knowledge, satisfaction, acceptability, perceived usefulness, and reaction to the pedagogical approach. All outcomes were self-assessed through web-based questionnaires, including the space for written comments. We used 2-tailed Student t test and Fisher exact test to compare continuous and categorical variables between groups, respectively.

Results

Of the 57 participants assessed for eligibility, 40 (70%) were allocated to the intervention (n=20) or control group (n=20) and 36 (n=18 in each) completed the courses. The mean age of the participants was 41 (SD 9) years. Most were women (39/40, 98%), White (38/40, 95%), clinical nurses (28/40, 70%), and had completed at least a bachelor’s degree (30/40, 75%). After the intervention, the mean score of intention was 6.3 (SD 0.8; 95% CI 5.9-6.7) for the intervention group and 6.0 (SD 1.2; 95% CI 5.42-6.64) for the control group (scale 1-7). The differences in intention and other psychosocial variable scores between the groups were not statistically significant. Knowledge scores for SDM were significantly higher in the intervention group (79%, 95% CI 70-89 vs 64%, 95% CI 57-71; P=.009). The intervention was significantly more acceptable in the intervention group (4.6, 95% CI 4.4-4.8 vs 4.3, 95% CI 4.1-4.5; P=.02), and reaction to the pedagogical approach was also significantly more positive in the intervention group (4.7, 95% CI 4.5-4.8 vs 4.4, 95% CI 4.2-4.5; P=.02). There was no significant difference in overall satisfaction (or in perceived usefulness). Furthermore, 17 participants (9 in the intervention group and 8 in the control group) provided written comments on the intervention.

Conclusions

This study focuses on web-based nursing education and its potential to support pregnant women’s decision-making needs. It shows that nurses’ intention to use a decision aid to enhance SDM in prenatal care is high, with or without training, but that their knowledge about SDM can be improved with web-based training.

International Registered Report Identifier (IRRID)

RR2-10.2196/17878

Keywords: shared decision-making, prenatal screening, training, nurses, nursing, behavioral intention, trisomy, Down syndrome, continuing professional development, continuing education, medical education, decision aid, screening, prenatal, pediatrics

Introduction

Background

In Quebec, prenatal screening for trisomy 21 (Down syndrome) during prenatal follow-up is offered to all pregnant women as part of the state-run health care services, as well as in a few private clinics [1]. Pregnant women face several possible options: whether to take the test, and if so, which one (biochemical test, fetal DNA, or nuchal translucency ultrasound) [2,3]. Prenatal screening is a value-laden decision, and the probabilistic nature of the evidence makes it a difficult decision for expecting parents. It is also complex because new difficult decisions may arise if the results of screening indicate a high probability of Down syndrome in the fetus—that is, whether to perform a more invasive procedure to confirm or deny the screening results (which includes risks of miscarriage) and, ultimately, whether to continue or terminate the pregnancy, given that prenatal treatment options are not available [4].

Faced with the complex nature of this decision, future parents must not only be informed of the evidence regarding the tests but also be supported by the health care team so that their preferences and values are considered in the decision-making process [5]. Thus, shared decision-making (SDM) seems to be the most appropriate approach for setting out the possible options in the most objective and concrete way, fostering informed consent and empowering parents [6-8]. SDM improves the health care experiences of both patients and health professionals and leads to better health care processes, patient experience and outcomes, and optimal health spending [9-12]. To implement SDM in clinical practice, several approaches have been proposed in the literature, including interactive skills workshops for health professionals and implementation of SDM tools known as decision aids (DAs) [13,14]. DAs are tools used by health care professionals to assist patients in their decision-making by providing information on treatment or screening options and their associated benefits and harms and by clarifying their values and preferences regarding the decision to be made [15].

In Canada, prenatal care requires the collaboration and coordination of many health care providers [16,17]. Nurses play an essential role, especially in the province of Quebec. One of their roles is to initiate laboratory examinations and diagnostic tests, such as prenatal screening [18]. Thus, they are in a strategic position to implement SDM as they accompany pregnant women and their families in decision-making about prenatal screening [18,19]. Owing to their close and trusting relationship with patients, their intimate understanding of their community environment, their understanding of biology, and their communication skills, nurses could be powerful allies in implementing SDM in prenatal care [20]. Most SDM implementation studies focus on physicians [21], but with the transformation of health care systems, nurses are increasingly involved in clinical decision-making, and their crucial role urgently needs acknowledgment [22]. Patients themselves have expressed that nurses could play a significant role in SDM; they could provide information and support as well as communicate with other clinicians [23]. Moreover, many studies highlight that an interprofessional approach to SDM, in the context of team-based health care, has benefits for SDM implementation [24-28]. Investigating nursing training in SDM not only gives us an underexplored perspective but could also inform us about the complexities involved in interprofessional SDM.

However, for nurses to implement SDM in prenatal care, they must acquire the skills to apply this approach in their practice. Web-based continuing professional development (CPD) increased 10-fold from 2002 to 2008 in the United States and has been accelerating ever since [29,30]. The continuing education needs of remote rural practices and, more recently, COVID-19 social distancing rules and health cuts have driven developers of CPD to provide more web-based courses [31,32]. Although the effect of web-based courses on clinical practice is still not clear [33], some evaluations show that they are just as effective as in-person courses [34].

Objective

Therefore, we seek to assess the impact of a web-based SDM training program on nurses’ intention to use a DA with pregnant women facing a decision about prenatal screening for Down syndrome.

Methods

Overview

We used the CONSORT-EHEALTH (Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth) checklist (version 1.6.1) as a reporting guideline (except for items related to randomization) to report this study (Multimedia Appendix 1). This checklist suggests information to include when reporting eHealth or mobile health trials (not only web-based or internet-based interventions and DAs but also social media, serious games, DVDs, mobile apps, and certain telehealth applications) [35]. We also used the guidelines for reporting nonrandomized pilot and feasibility studies proposed by Lancaster and Thabane [36].

Study Design

This study was a 2-arm, parallel controlled trial with pre–post measures. Participants were conveniently allocated to two parallel groups: (1) an intervention group exposed to a 3-hour web-based course on SDM, including SDM for prenatal screening, or (2) a control group exposed to a 3-hour web-based course on prenatal screening alone with no SDM content.

Changes to Methods

Initially, this study was planned as a randomized controlled trial. Through a misunderstanding, however, the private firm who performed the recruitment used convenience allocation, and there was no randomization allocation. No content changes were made to the interventions, and no software malfunctions occurred during the interventions.

Research Approval

This project was approved by the ethics committee of the Centre Hospitalier Universitaire de Québec-Université Laval (MP-20-2019-4571). All stages of this research project were conducted in accordance with the rules of ethics. Further details on ethics can be found in the protocol by Poulin Herron et al [37].

Study Population

Inclusion criteria for nurses were that they (1) were involved in prenatal screening decision-making or prenatal screening processes in the province of Quebec; (2) spoke and wrote French; (3) were active in professional practice during the year of data collection (eg, hospitals and community clinics); and (4) had sufficient internet skills, as all procedures were web-based, requiring a minimum of ability and equipment to enter and navigate through the course. There were no exclusion criteria.

Procedures and Recruitment

Participants were recruited through a web-based approach by a private polling firm that operates an internet panel. Recruitment made use of (1) a pre-existing list of nurses held by the polling firm; (2) social media; and (3) the human resources departments of two regional health authorities, the Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale and the Centre intégré de santé et de services sociaux de Chaudière-Appalaches. Recruitment and enrollment took place on web. The procedures are described in detail in a previously published protocol [37].

Allocation

The allocation of participants to the trial groups was performed after collecting the sociodemographic data. The private firm performed the allocation by convenience, as the nurses entered the study. Participants were not blinded throughout the study but were also not told which arm (intervention or control) they were allocated.

Study Interventions

Overview

The SDM course was created by members and collaborators of the Canada Research Chair in Shared Decision Making and Knowledge Translation with help from education counselors from Université Laval and supported by the PEGASUS (Personalized Genomics for Prenatal Abnormalities Screening Using Maternal Blood) program, a pan-Canadian program. Nurse with expertise in this field created a prenatal screening course without SDM content. The mode of delivery was asynchronous and web-based.

Both programs, hosted on the Université Laval platform, could be completed in approximately 3 hours. More information about the programs can be found in the protocol by Poulin Herron et al [37]. Some participants required technical assistance with regard to the study questions (eg, about when the course is considered complete or when they should answer the postintervention questionnaire), but no technical problems arose related to the course or the platform. Multimedia Appendix 2 provides a report of both programs according to the TIDieR (Template for Intervention Description and Replication items) [38].

Intervention Group: Web-Based Course on SDM and Down Syndrome Prenatal Screening

The intervention consisted of a web-based self-study course titled Formation en ligne – La prise de décision partagée pour le test de dépistage prénatal de la trisomie 21 (Shared Decision-Making About Prenatal Screening for Down Syndrome). The course aimed to integrate SDM into prenatal care by focusing on the use of a DA. It was divided into four main modules: (1) SDM, (2) Down syndrome prenatal screening, (3) DAs, and (4) communication between health care professionals and patients. Course development was based on the SDM model [39] and its central concepts [14,39]. These include assessment with the patient and health care professional that there is a decision to be made, exploration of the options available and their pros and cons, discussion about patients’ preferences, support of the patient by health care professionals in their decision-making, and discussion surrounding the decision to be made. The course depicted a DA and included a video of a clinical encounter in which the DA was used by a clinician with expecting parents. The DA was created by our research team [40] using the International Patient Decision Aids Standards [41]. The model used in the course was in paper format. Its core element is the decision of whether to undergo prenatal screening for Down syndrome. It describes Down syndrome; presents the various prenatal tests and their benefits, harms, and consequences; and provides an exercise for users to clarify their values regarding the options. Multimedia Appendix 3 includes screenshots of the training content.

Control Group: Web-Based Course on Down Syndrome Prenatal Screening

The control group course was titled Formation sur le dépistage prénatal de la trisomie 21 (prenatal screening for Down syndrome) and focused on prenatal screening alone (without SDM content such as determining decision points or using a DA). In the control program, the topic of SDM in module 1 of the intervention arm was replaced with “Context and history of prenatal screening.” The topic of DAs in module 3 of the intervention arm was replaced with “Consent in prenatal screening.” There were no DA and SDM simulation videos.

Data Collection

For each study arm, data were collected before and after the nurses completed the courses. All outcomes were self-reported. No postintervention data were collected from the participants who discontinued the intervention. The Kirkpatrick and Kirkpatrick [42] model was used as an overall guide to evaluate the effectiveness of the course, as it has proven useful in guiding the evaluation of training for the health care provider [43]. This model comprises four levels: (1) reaction, (2) learning, (3) behavioral change, and (4) organizational performance (results). Level 1 (reaction) measures how participants react to training (eg, satisfaction). Level 2 (learning) analyzes whether they understood the training (eg, increase in knowledge). Level 3 (behavior) looks at whether they are using what they learned at work (eg, behavior change), and level 4 (results) determines whether the material has a positive impact on the organization [42]. Details on the rationale for the questionnaire guides (Multimedia Appendix 4 summarizes the data collection questionnaire after the training) and further explanations can be found in the protocol by Poulin Herron et al [37]. Data collection took place entirely on web. Participants received CAD $400 (US $315) for their participation.

Primary Outcome

The primary outcome was the intention of nurses to use a DA in clinical practice with pregnant women facing a decision about prenatal screening for Down syndrome. Intention was chosen as the primary outcome because of the literature supporting intention as a strong predictor of behavior [44-46]. Intention is defined as the degree to which a person has formulated conscious plans to perform or not perform some specified future behavior, that is, the subjective probability that they will perform the behavior [47]. According to the integrated model of the theory of planned behavior for health care providers by Godin [46], their intention to change their behavior can be predicted by four variables: social influence, beliefs about capabilities, moral norms, and beliefs about consequences, as well as by individual and environmental characteristics. The intention to use a DA could act as a proxy for level 3 in the Kirkpatrick and Kirkpatrick [42] model, that is, a proxy for changes in behavior. Thus, although nurses’ mid- or long-term behavior was not evaluated in this study, we assumed that their intention to use a DA in clinical practice with pregnant women could predict their future SDM behavior in clinical practice after receiving the training and once the DA is implemented in clinical settings. Further details on the rationale for the choice of primary outcome can be found in the protocol by Poulin Herron et al [37].

Intention was measured before the intervention (before the course) and after the intervention (within 24-72 hours after completing the course). It was assessed using the CPD-Reaction questionnaire [48], which measures intention (and its psychosocial variables) to change a behavior after completing a CPD activity. The tool is based on the theory of planned behavior [46,49] and Triandis theory [50]. This validated questionnaire has an acceptable internal consistency for each construct, with a Cronbach α ranging from .77 to .85 [45]. Intention (questions 1 and 7 of the questionnaire) was measured on a 7-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree).

Secondary Outcomes

Secondary outcomes included the psychosocial variables of behavioral intention as evaluated with the CPD-Reaction questionnaire, that is, social influence, beliefs about capabilities, moral norms, and beliefs about consequences. These constructs were also measured on a 7-point Likert scale, from 1 (score indicating a weak determinant) to 7 (score indicating a strong determinant). Question 2, on social influence, or the percentage of one’s colleagues who use DAs, is on a 5-point Likert scale from 1 (0%-20%) to 5 (81%-100%) [48].

Knowledge (level 2 in the Kirkpatrick and Kirkpatrick [42] model) was measured using a 20-item questionnaire designed by the research team and focused on 4 topics: Down syndrome (2 items), prenatal screening (7 items), SDM (7 items), and ethics (4 items). The questions had from 2 to 5 possible answers, with both true-or-false–type answers and multiple-choice answers. As the knowledge questionnaire did not use Likert scales, the knowledge score was evaluated as a percentage with a maximum knowledge score of 100%.

To measure nurses’ overall impression (level 1 in the Kirkpatrick and Kirkpatrick [42] model) of the web-based course in which they were enrolled, we assessed their satisfaction, acceptability, and perceived usefulness of the course, and reaction to its pedagogical approach. We used the questionnaire by Körner et al [26] to assess satisfaction with the content (5 items), with the trainers (6 items), and overall satisfaction. We used the Giangreco [51] questionnaire to assess the perceived usefulness of the program. We assessed acceptability using a 5-item questionnaire based on the Kirkpatrick and Kirkpatrick [42] guidelines for evaluating reactions to educational programs. Finally, we assessed the reaction to the pedagogical approach using a 9-item questionnaire based on both the Kirkpatrick and Kirkpatrick [42] guidelines and the University of Connecticut School of Medicine’s continuing medical education evaluation form [52]. All 4 level 1 variables were assessed using a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree).

In open fields, we also collected written comments on how to improve training and sociodemographic data. No changes to trial outcomes were made after the trial commenced.

Data Management

All data collected were kept on the polling firm’s secure server for 10 years. Following data collection, the firm sent a deidentified database of all data collected in a Microsoft Excel file (version 2019) and a SAS (version 9.4) file to the research team. An identification number was given to each participant to deidentify and track them throughout the study. The research team saved these data on the secure server of regional health authorities.

Sample Size

To detect an average difference in our primary outcome (intention to use a DA), it was estimated that a sample size of 36 nurses (n=18 per group) would be sufficient, with an error of 0.05, a size effect of 0.8, and a power of 80%. This sample size was based on a similar study assessing intention to use a DA for Down syndrome screening among midwives, a profession closely allied with nursing [53].

Data Analysis

Analyses were performed at the individual level. We used the 2-tailed Student t test and Fisher exact test [54] to compare continuous and categorical variables between groups (mean intention to use the DA in both groups, knowledge and overall impressions). The difference in scores was estimated by subtracting the preintervention score from the postintervention score. This pre–post measure of change followed a normal distribution and was used in the regression model as a response variable without any transformation. The exposure factor under study was the intervention (vs the control group). The identification of confounding factors was carried out using the 10% method [55], and variables whose removal from the full model (ie, including exposure factor and all potential covariates) resulted in a change of ≥10% in the effect of the intervention were retained as confounding variables in the final model. To compare the mean values of secondary outcomes between the 2 groups after the intervention, analyses of covariance models were performed to control for confounding factors. For all analyses, SAS was used, and a statistical significance level of .05 was defined. No imputation techniques were used to deal with attrition or missing values, as the sample size of this study could not handle such an analysis. Finally, we conducted a content analysis of written comments. All results are presented as mean scores or percentages with 95% CIs in parentheses.

Results

Participant Characteristics

Data were collected from September 2019 to late January 2020. A total of 57 potentially eligible nurses were assessed for this trial, of whom 40 were allocated to either the control group or the intervention group. Two participants per group (total n=4) discontinued participation in the study (ie, they did not complete the full module). The trial ended when 18 nurses in each group completed the course and the postintervention questionnaire (Figure 1).

Figure 1.

Figure 1

Participant flow diagram.

Baseline Data

The mean age of the participants was 41 (SD 9) years. Only one male enrolled, and all participants were cisgender people. Most participants had completed at least a bachelor’s degree (26/40, 65%), resided in urban regions (19/40, 47.5% in the Capitale-Nationale and 9/40, 22.5% in Chaudière-Appalaches), were White (38/40, 95%), earned between CAD $60,000 and CAD $99,999 (US $46,885 and US $78,144) (30/40, 75%), were clinical nurses (university vs college-trained; 28/40, 70%), and worked full-time (35/40, 87.5%) either in a hospital (19/40, 47.5%) or a local community health center (7/40, 35%). The number of pregnant women the nurses had seen in the past month varied: 45% (18/40) had seen from 1 to 20, 15% (6/40) had seen from 21 to 40, 15% (6/40) had seen from 41 to 80, and 18% (7/40) had seen ≥81. Moreover, 3 nurses (7.5%) had not seen any pregnant women in the past month (Table 1). The intervention and control groups did not statistically differ with respect to demographic data.

Table 1.

Participants’ sociodemographic characteristics.


Total (n=40) Intervention (n=20) Control (n=20)
Age (years), mean (SD) 40.7 (9.4) 39.5 (9.8) 41.8 (9.1)
Biological sex, n (%)

Male 1 (2.5) 1 (5) 0

Female 39 (97.5) 19 (95) 20 (100)

Other 0 (0) 0 0
Gender, n (%)

Male 1 (2.5) 1 (5) 0

Female 39 (97.5) 19 (95) 20 (100)

Other 0 (0) 0 0
Formal educationa, n (%)

College (CEGEP) 9 (22.5) 5 (12.5) 4 (20)

University—bachelor 26 (65) 14 (70) 12 (60)

University—master 4 (10) 0 4 (20)

University—doctorate 0 (0) 0 0

Other 1 (2.5) 1 (5) 0
Residencya, n (%)

Capitale-nationale 19 (47.5) 10 (50) 9 (45)

Chaudières-Appalaches 9 (22.5) 4 (20) 5 (25)

Laval 3 (7.5) 1 (5) 2 (10)

Montréal 4 (10) 1 (5) 3 (15)

Bas-Saint-Laurent 1 (2.5) 1 (5) 0

Abitibi-Téminscamingue 1 (2.5) 1 (5) 0

Gaspésie and Îles-de-la-madeleine 1 (2.5) 1 (5) 0

Center-du-Québec 1 (2.5) 0 1 (5)

Other 1 (2.5) 1 (5) 0
Ethnicitya, n (%)

White 38 (95) 19 (95) 19 (95)

Racialized minority 2 (5) 1 (5) 1 (5)
Salarya (CAD $), n (%)

<CAD $29,999 (US $23,444) 1 (2.5) 0 1 (5)

CAD $30,000–$59,999 (US $23,445–$46,884) 5 (12.5) 3 (15) 2 (10)

CAD $60,000–$99,999 (US $46,885–$78,144) 30 (75) 15 (75) 15 (75)

≥CAD $100,000 (US $78,145) 4 (10) 2 (10) 2 (10)
Job titlea,b, n (%)

Nurse 11 (27.5) 8 (40) 3 (15)

Clinical nurse 28 (70) 12 (60) 16 (80)

Nurse practitioner 1 (2.5) 0 1 (5)
Job statusa, n (%)

Preventive withdrawal or maternity leave 1 (2.5) 0 1 (5)

Full-time 35 (87.5) 19 (95.5) 16 (80)

Part-time 3 (7.5) 1 (5) 2 (10)

Retired 1 (2.5) 0 1 (5)
Work settings

Hospital 19 (47.5) 8 (40) 11 (55)

Family medicine group 1 (2.5) 0 1 (5)

Local community services centers 14 (35) 7 (35) 7 (35)

Other 6 (15) 5 (25) 1 (5)
Estimated number of pregnant women seen in the last month

0 3 (7.5) 1 (5) 2 (10)

1-5 7 (17.5) 6 (30) 1 (5)

6-20 11 (27.5) 6 (30) 5 (25)

21-40 6 (15) 2 (10) 4 (20)

41-80 6 (15) 3 (15) 3 (15)

≥81 7 (17.5) 2 (10) 5 (25)

aTo simplify the table, we did not present all the subvariables for the sociodemographic variables marked with “a.” Subvariables not presented in the table contained no data. For the formal education variable, the subvariables not presented in the table are none completed, primary school, secondary school, and professional study diploma. One participant marked other on their form, referring to a university certificate. The work setting was not found to be a confounding factor. For the variable residency, the subvariables not presented are Saguenay-Lac-Saint-Jean, Mauricie, Estrie, Outaouais, Côte-Nord, Nord-du-Québec Lanaudières, Montérégie, Laurentides, and I do not know. For the variable ethnicity, subvariables not presented are Latino-American (Mexico, Chili, Costa Rica, etc), Arab (Middle East, Maghreb, etc), Sud-Asia (India, Bangladesh, Pakistan, Sri Lanka, etc), South-east Asia (Vietnam, Cambodia, Malaysia, Laos, etc), West Asia (Iran, Afghanistan, etc), Chinese, Filipino, Korean, Japanese, Other, and I do not know. For the variable salary, subvariables not presented are I do not know and I prefer not to answer. For the variable job title, the subvariable not presented is none of the above. For the variable job status, the subvariables that are not presented in the table are student, no job/studies, and none of the above. Other types of work settings referred to private clinics, nursing stations, First Nations services, or federal (as opposed to provincial) services.

bThe difference between nurses and clinical nurses is their education level, proper to the province of Quebec; clinical nurses have a bachelor’s degree, and nurses have a college degree; both have similar scope of practice, with distinctions in regard to care complexity, coordination and clinical supervision.

Primary Outcome: Intention

Before the intervention, the mean intention score was 6.2 (SD 0.9; 95% CI 5.8-6.7) for the intervention group and 5.9 (SD 1.4; 95% CI 5.2-6.5) for the control group. The minimum and maximum scores were 1 and 7, respectively. After the intervention, the mean intention score was 6.3 (SD 0.8; 95% CI 5.9-6.7) for the intervention group and 6.0 (SD 1.2; 95% CI 5.4-6.6) for the control group (Table 2). Between the pre- and postintervention stage, the difference in intention score was 0.1 (95% CI −0.5 to 0.6) for the intervention group and 0.1 (95% CI −0.8 to 1.1) for the control group. Before the intervention, the difference in intention score between the intervention and control groups was 0.3 (95% CI −0.4 to 1.1). After the intervention, the difference in intention score between intervention and control groups was 0.3 (95% CI −0.4 to 1.0). The intra- and intergroup differences observed were not statistically significant. After adjustment for confounding variables, the pre–post change in intention scores did not vary significantly among the exposure groups (0.2, 95% CI −1.0 to 1.4; P=.74).

Table 2.

Continuing Professional Development–Reaction construct scores.


Before intervention After intervention P value

Total (n=40) Intervention (n=20) Control (n=20) Total (n=36) Intervention (n=18) Control (n=18)
Intention .82

Values, mean (SD; 95% CI) 6.1 (1.2; 5.7-6.4) 6.2 (0.9; 5.8-6.7) 5.9 (1.4; 5.2-6.5) 6.2 (1.0; 5.8-6.5) 6.3 (0.8; 5.9-6.7) 6.0 (1.2; 5.4-6.6)

Values, median (IQR) 6.3 (5.5-7.0) 6.5 (5.5-7.0) 6.0 (5.5-7.0) 6.5 (5.8-7.0) 6.5 (6.0-7.0) 6.5 (5.5-7.0)
Social influence .15

Values, mean (SD; 95% CI) 3.4 (1.7; 2.9-4.0) 2.7 (1.6; 2-3.4) 3.8 (1.7; 2.9-4.6) 3.0 (1.4; 2.5-3.4) 2.7 (1.3; 2.1-3.4) 3.2 (1.5; 2.4-3.9)

Values, median (IQR) 3.1 (1.8-4.8) 2.5 (1.5-3.6) 4.3 (2.7-5.1) 2.5 (1.8-3.8) 2.3 (1.5-3.9) 2.7 (2.5-3.6)
Beliefs about capabilities .07

Values, mean (SD; 95% CI) 5.7 (1.0; 5.4-6.1) 6.1 (1.0; 5.7-6.5) 5.4 (1.0; 4.9-5.9) 5.8 (0.8; 5.5-6.1) 5.8 (0.8; 5.5-6.2) 5.8 (0.9; 5.4-6.2)

Values, median (IQR) 6.0 (5.0-6.7) 6.3 (5.0-6.8) 5.7 (4.7-6.3) 6.0 (5.3-6.3) 6.0 (5.3-6.3) 6.0 (5.3-6.3)
Moral norm .34

Values, mean (SD, 95% CI) 6.6 (0.6; 6.4-6.8) 6.9 (0.4; 6.7-7.0) 6.4 (0.7; 6.0-6.7) 6.5 (0.8; 6.2-6.7) 6.6 (0.9; 6.1-7.0) 6.4 (0.7; 6.0-6.7)

Values, median (IQR) 7.0 (6.0-7.0) 7.0 (6.8-7.0) 6.5 (6.0-7.0) 7.0 (6.0-7.0) 7.0 (6.5-7.0) 6.5 (6.0-7.0)
Beliefs about consequences .68

Values, mean (SD; 95% CI) 6.5 (0.6; 6.3-6.7) 6.8 (0.5; 6.6-7) 6.3 (0.7; 6-6.6) 6.6 (0.8; 6.4-6.9) 6.9 (0.4; 6.7-7.1) 6.3 (0.9; 5.9-6.8)

Values, median (IQR) 7.0 (6.0-7.0) 7.0 (6.5-7.0) 6.0 (6.0-7.0) 7.0 (6.5-7.0) 7.0 (7.0-7.0) 6.8 (6.0-7.0)

Secondary Outcomes

Other Constructs of the CPD-Reaction Questionnaire

Scores for social influences, beliefs about capabilities, moral norms, and beliefs about consequences are shown in Table 2. There were no statistically significant differences between the pre- and postintervention scores for any of these constructs.

Knowledge

Table 3 shows knowledge scores assessed after the intervention. The average score for the 7 knowledge questions about SDM was 79% (SD 18; 95% CI 70%-89%) in the intervention group and 64% (SD 14; 95% CI 57%-71%) in the control group. The mean difference between the 2 groups for knowledge about SDM was 15% (SD 16; 95% CI 4%-26%). This difference is statistically significant (P=.009). There was no statistically significant difference in the knowledge scores for the questions about Down syndrome, ethics, or prenatal screening.

Table 3.

Knowledge scores after the intervention (n=18).

Topics Intervention (n=18), mean (SD; 95% CI) Control (n=18), mean (SD; 95% CI) Mean difference (SD; 95% CI) P value
Shared decision-making (7 items; %) 79 (18; 70 to 89) 64 (14; 57 to 71) 15 (16; 4 to 26) .009
Down syndrome (2 items; %) 89 (21; 78 to 100) 78 (31; 62 to 93) 11 (27; −7 to 29) .21
Ethics (7 items; %) 68 (21; 58 to 78) 69 (22; 59 to 80) −1 (21; −16 to 13) .85
Prenatal screening (4 items; %) 74 (13; 67 to 80) 79 (15; 71 to 86) −5 (14; −14 to 5) .32

Participants’ Overall Impression of the Training

Table 4 shows scores of satisfaction (with content, with trainers, and overall satisfaction), acceptability, perceived usefulness, and reaction to the pedagogical approach. Item scores for participants’ impression of the training was based on a scale of 1 to 5. The mean score for acceptability of the training program was 4.6 (95% CI 4.4-4.8) in the intervention group and 4.3 (95% CI 4.1-4.5) in the control group. The difference in acceptability of training between the 2 groups was statistically significant (P=.02). The mean score of reaction to the pedagogical approach was 4.7 (95% CI 4.5-4.8) in the intervention group and 4.4 (95% CI 4.2-4.5) in the control group (ie, the intervention group reacted more positively). This difference in reaction between the 2 groups was statistically significant (P=.02). The between-group differences in scores of satisfaction and perceived usefulness were not statistically significant.

Table 4.

Overall impression of the course (scale of 1-5).


Intervention (n=18), Mean (SD; 95% CI) Control (n=18), Mean (SD; 95% CI) Mean difference (SD; 95% CI) P value
Satisfaction

Content 4.4 (0.9; 3.9 to 4.8) 4.2 (0.4; 4.02 to 4.4) 0.1 (0.7; −0.3 to 0.6) .53

Trainers 4.6 (1.0; 4.1 to 5.02) 4.2 (0.4; 4.1 to 4.4) 0.3 (0.7; −0.2 to 0.8) .21

Overall satisfaction 4.5 (1.0; 4.01 to 4.9) 4.2 (0.4; 4.05 to 4.4) 0.2 (0.7; −0.2 to 0.7) .31
Acceptability 4.6 (0.4; 4.4 to 4.8) 4.3 (0.4; 4.1 to 4.5) 0.3 (0.4; 0.1 to 0.6) .02
Perceived usefulness 4.6 (0.4; 4.4 to 4.8) 4.4 (0.5; 4.2 to 4.6) 0.2 (0.4; −0.1 to 0.5) .13
Reaction (pedagogical aspects) 4.7 (0.4; 4.5 to 4.8) 4.4 (0.4; 4.2 to 4.5) 0.3 (0.4; 0.04 to 0.5) .02

Written Comments

Overall, 17 participants (9 in the intervention group and 8 in the control group) provided feedback on the course. Most participants in the intervention group (6/9, 67%) described the training as excellent, perfect, practical, applicable, or relevant. One participant expressed comfort with the DA and the principle of SDM. One said that she would use the DA as soon as possible. Moreover, 2 participants emphasized the usefulness of the training, which they felt increased their knowledge and confidence and gave them the tools to better structure meetings with their patients:

I was a little uncomfortable bringing up this topic [talking about prenatal screening for Down syndrome]...this part of the information was more to discuss with the doctor...It will allow me to better structure my meetings and I feel much better equipped.

Participant 9

However, 2 nurses pointed out that, in practice, they lack the time to use such tools and that the rapid sequence of steps leading to prenatal screening affords future parents little time for reflection:

I work in a local community health centre [CLSC] with 5 consultations per day, where there’s little time allocated per client. For me it would be difficult to use this decision aid. However, if I had more time, I could, and I would find it practical and very useful.

Participant 25

In the control group, although some participants (5/8, 63%) were happy to have had the opportunity to do this course and found it interesting, 2 of them pointed out the difficulty in understanding the person who was speaking on the PowerPoint narration videos because of their rapid speech, unclear pronunciation, and changes in intonation (control intervention only). In addition, 3 of them said that the length of the first module and the length of documents to be consulted made the course longer than 3 hours.

Discussion

Principal Findings

We assessed the impact of an SDM course on nurses’ intention to use a DA with pregnant women facing the decision of prenatal screening for Down syndrome, as well as the nurses’ overall impressions of the SDM training. We found no statistically significant difference in intention scores between the intervention arm (SDM course) and the control arm (course on the screening program only). However, we found a statistically significant difference in knowledge about SDM, acceptability, and reaction to the pedagogical approach between the 2 arms. In written comments, nurses identified lack of time as a barrier to the use of the DA in clinical settings. These results lead us to make the following observations.

First, there was no difference in intention scores between the intervention and control groups. This was a comparative effectiveness study [56], as both arms presented an active intervention. Although the control arm developed by nurse experts in prenatal screening excluded an SDM focus, it covered ethical aspects of the decision and information on the importance of adapting prenatal care to each pregnant woman, a core value in the nursing profession [57,58]. Consequently, it is possible that there was not enough difference between the study arms in terms of generic decision support for prenatal care. Indeed, previous research has shown that of all health professions, genetic counselors have the highest SDM scores during prenatal consultations, even in the absence of SDM training [59,60]. In addition, we observed a ceiling effect with the primary outcome at baseline, which may have limited our ability to observe the effect of the intervention. Similar ceiling effects were seen in a study assessing change in behavioral intention after CPD activities [48] and in another study assessing the impact of a patient–professional coproduced digital educational intervention [61]. Our initial high scores may also be because of the training that Canadian nurses had already received. Nursing programs emphasize fundamental knowledge of relational approaches that influence health outcomes for individuals, families, and communities [57]. In fact, the essence of nursing is based on a deep understanding of the biopsychosocial aspects of patients and on advocating for them [62]. Finally, participants may have been subjected to social pressure to state that they intended to use a DA [49,63-65]. Thus, we do not have insight into the full set of factors that may have contributed to their intention (apart from the CPD-Reaction constructs), because the theories explain only part of the variance in intention [46].

Second, we found a statistically significant difference in scores for knowledge about SDM between the intervention and control groups but not for knowledge about the topics covered in both arms, such as prenatal screening and Down syndrome. Thus, the intervention arm (the SDM training program) did distinguish itself from transmitting knowledge about SDM. In addition, the intervention group found their course more acceptable and had a more positive reaction to its pedagogical approach than did the control group. This can be explained in part by the speakers, as participants in the control group expressed difficulties in understanding the speaker in their course. The course format may also have made a difference. The SDM course included a DA and a simulation video, which, especially in the context of web-based pedagogy and regardless of its content, may have been a more acceptable and effective format than the control course [37].

Third, we did not measure whether this high level of intention translated into behavior. Although intention is a strong predictor of behavior [46], the implementation of SDM in practice might depend on other external variables, such as organizational limitations [26]. Indeed, in their written comments, nurses mentioned that organizational barriers prevented them from using DAs in their clinical setting, regardless of their intention, and that they had little time to share decisions with their patients given the speed of lead up to prenatal screening procedures. Another organizational barrier that could defeat nurses’ best intentions may be related to the role they are assigned in interprofessional teams or their ability to collaborate with other professionals to ensure that SDM occurs [28]. The organizational environment and care pathways need to be adapted so that pregnant women and nurses can engage fully in SDM, which is already a good fit with nurses’ role in the health care system.

Limitations

This study has several limitations. First, in contrast with the planned study design, randomization allocation was not implemented. The private firm, unbeknownst to us, instead focused on ensuring a balanced number of participants in both arms by allocating them alternately to one group or the other. Nevertheless, the study was controlled and allowed us to compare the intervention and control groups. Second, nurses who agreed to participate in this trial may not be representative of all nurses involved in prenatal care in Quebec because of our web-based recruitment methods. For example, in this study, there was only 1 nurse practitioner who had a different scope of practice than other nurses. In addition, our findings may not be generalizable to nurses’ engagement in SDM in other areas of their practice, such as disease management. Prenatal care does not usually involve disease management, as pregnancy itself is not an illness. Third, these results cannot be generalized to other health professionals involved in prenatal care in Quebec, as studies show that each approaches the topic of SDM in a different way [16,53]. Training nurses using an interprofessional approach to SDM might encourage interprofessional interaction and information exchange about SDM [28]. Exploration of an interdisciplinary DA model will be examined in future research.

Conclusions

This study focuses on the potential of web-based nursing education to support pregnant women’s decision-making needs. We assessed nurses’ intention to use a DA to support prenatal screening decisions among pregnant women and their overall impressions regarding the training. This study showed that nurses’ intention to use a DA in prenatal care is already high, with or without training, but that their knowledge about SDM could be improved with training. Our results will inform future strategies for implementing SDM behaviors in this population. The study also suggested avenues for future evaluations of SDM training programs. The next steps will be to (1) update the program by incorporating the written comments received from the participants and (2) evaluate the impact of the course with all health professionals involved in prenatal care.

Acknowledgments

This study was embedded in the PEGASUS (Personalized Genomics for Prenatal Abnormalities Screening Using Maternal Blood) 2 project obtained as part of the 2017 Large-scale Applied Research Project Competition: Genomics and Precision Health. It is funded by the Génome Québec and Genome Canada. The authors would like to thank Louisa Blair for editorial support. APH was supported by the Tier 1 Canada Research Chair in Shared Decision Making and Knowledge Translation, the VITAM—Centre de recherche en santé durable and the Réseau de recherche en interventions en sciences infirmières du Québec and the Ordre régional des infirmières et infirmiers de Québec. FL holds the Tier 1 Canada Research Chair on Shared Decision Making and Knowledge Translation.

Abbreviations

CONSORT-EHEALTH

Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth

CPD

continuing professional development

DA

decision aid

PEGASUS

Personalized Genomics for Prenatal Abnormalities Screening Using Maternal Blood

SDM

shared decision-making

TIDieR

Template for Intervention Description and Replication items

Multimedia Appendix 1

CONSORT-eHEALTH checklist (V 1.6.1).

Multimedia Appendix 2

Report of both programs according to the Template for Intervention Description and Replication items.

Multimedia Appendix 3

Screenshots of the training content.

Multimedia Appendix 4

Data collection questionnaire after the training.

Footnotes

Conflicts of Interest: The authors of this paper are also the developers of the intervention. APH, TTA, and FL participated in the creation of the training program in designing and conducting the study. The other authors have no conflicts to declare.

References

  • 1.Programme québécois de dépistage prénatal. Publications du ministère de la Santé et des Services sociaux. [2021-12-27]. https://publications.msss.gouv.qc.ca/msss/document-002818/
  • 2.van den Berg M, Timmermans DR, Kleinveld JH, Garcia E, van Vugt JM, van der Wal G. Accepting or declining the offer of prenatal screening for congenital defects: test uptake and women's reasons. Prenat Diagn. 2005 Jan;25(1):84–90. doi: 10.1002/pd.1090. [DOI] [PubMed] [Google Scholar]
  • 3.Wilson KL, Czerwinski JL, Hoskovec JM, Noblin SJ, Sullivan CM, Harbison A, Campion MW, Devary K, Devers P, Singletary CN. NSGC practice guideline: prenatal screening and diagnostic testing options for chromosome aneuploidy. J Genet Couns. 2013 Feb;22(1):4–15. doi: 10.1007/s10897-012-9545-3. [DOI] [PubMed] [Google Scholar]
  • 4.Légaré F, St-Jacques S, Gagnon S, Njoya M, Brisson M, Frémont P, Rousseau F. Prenatal screening for Down syndrome: a survey of willingness in women and family physicians to engage in shared decision-making. Prenat Diagn. 2011 Apr;31(4):319–26. doi: 10.1002/pd.2624. [DOI] [PubMed] [Google Scholar]
  • 5.Tucker Edmonds B. Shared decision-making and decision support: their role in obstetrics and gynecology. Curr Opin Obstet Gynecol. 2014 Dec;26(6):523–30. doi: 10.1097/GCO.0000000000000120. [DOI] [PubMed] [Google Scholar]
  • 6.St-Jacques S, Grenier S, Charland M, Forest J, Rousseau F, Légaré F. Decisional needs assessment regarding Down syndrome prenatal testing: a systematic review of the perceptions of women, their partners and health professionals. Prenat Diagn. 2008 Dec;28(13):1183–203. doi: 10.1002/pd.2059. [DOI] [PubMed] [Google Scholar]
  • 7.Charles C, Gafni A, Whelan T. Shared decision-making in the medical encounter: what does it mean? (or it takes at least two to tango) Soc Sci Med. 1997 Mar;44(5):681–92. doi: 10.1016/s0277-9536(96)00221-3.S0277953696002213 [DOI] [PubMed] [Google Scholar]
  • 8.Simmons M, Hetrick S, Jorm A. Shared decision-making: benefits, barriers and current opportunities for application. Australas Psychiatry. 2010 Oct;18(5):394–7. doi: 10.3109/10398562.2010.499944. [DOI] [PubMed] [Google Scholar]
  • 9.Shay LA, Lafata JE. Where is the evidence? A systematic review of shared decision making and patient outcomes. Med Decis Making. 2015 Jan;35(1):114–31. doi: 10.1177/0272989X14551638. http://europepmc.org/abstract/MED/25351843 .0272989X14551638 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hamann J, Langer B, Winkler V, Busch R, Cohen R, Leucht S, Kissling W. Shared decision making for in-patients with schizophrenia. Acta Psychiatr Scand. 2006 Oct;114(4):265–73. doi: 10.1111/j.1600-0447.2006.00798.x.ACP798 [DOI] [PubMed] [Google Scholar]
  • 11.Hibbard JH, Greene J. What the evidence shows about patient activation: better health outcomes and care experiences; fewer data on costs. Health Aff (Millwood) 2013 Feb;32(2):207–14. doi: 10.1377/hlthaff.2012.1061.32/2/207 [DOI] [PubMed] [Google Scholar]
  • 12.Veroff D, Marr A, Wennberg DE. Enhanced support for shared decision making reduced costs of care for patients with preference-sensitive conditions. Health Aff (Millwood) 2013 Feb;32(2):285–93. doi: 10.1377/hlthaff.2011.0941.32/2/285 [DOI] [PubMed] [Google Scholar]
  • 13.Joseph-Williams N, Lloyd A, Edwards A, Stobbart L, Tomson D, Macphail S, Dodd C, Brain K, Elwyn G, Thomson R. Implementing shared decision making in the NHS: lessons from the MAGIC programme. BMJ. 2017 Apr 18;357:j1744. doi: 10.1136/bmj.j1744. http://www.bmj.com/lookup/pmidlookup?view=long&pmid=28420639 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Stiggelbout A, Pieterse A, De Haes J. Shared decision making: concepts, evidence, and practice. Patient Educ Couns. 2015 Oct;98(10):1172–9. doi: 10.1016/j.pec.2015.06.022.S0738-3991(15)30009-4 [DOI] [PubMed] [Google Scholar]
  • 15.Stacey D, Légaré F, Lewis K, Barry MJ, Bennett CL, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Thomson R, Trevena L. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2017 Apr 12;4:CD001431. doi: 10.1002/14651858.CD001431.pub5. http://europepmc.org/abstract/MED/28402085 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Chapitre 3 : Soins pendant la grossesse. Government of Canada. [2021-12-27]. https://www.canada.ca/fr/sante-publique/services/publications/vie-saine/soins-meres-nouveau-ne-lignes-directrices-nationales-chapitre-3.html .
  • 17.What Mothers Say: The Canadian Maternity Experiences Survey. Ottawa: Public Health Agency of Canada; 2009. [Google Scholar]
  • 18.Standards de pratique de l'infirmière: Soins de proximité en périnatalité. Ordre des infirmières et infirmiers du Québec. [2021-12-27]. https://www.oiiq.org/standards-de-pratique-pour-l-infirmiere-soins-de-proximite-en-perinatalite .
  • 19.Exam blueprint and specialty competencies: introduction - blueprint for the perinatal nursing certification. Canadian Nurses Association. [2021-12-27]. https://mycna.ca/-/media/nurseone/files/en/community-health_blueprint_e.pdf .
  • 20.Truglio-Londrigan M, Slyer JT. Shared decision-making for nursing practice: an integrative review. Open Nurs J. 2018;12:1–14. doi: 10.2174/1874434601812010001. http://europepmc.org/abstract/MED/29456779 .TONURSJ-12-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Légaré F, Ratté S, Gravel K, Graham ID. Barriers and facilitators to implementing shared decision-making in clinical practice: update of a systematic review of health professionals' perceptions. Patient Educ Couns. 2008 Dec;73(3):526–35. doi: 10.1016/j.pec.2008.07.018.S0738-3991(08)00350-9 [DOI] [PubMed] [Google Scholar]
  • 22.Registered nurses: stepping up to transform health care. Canadian Nurses Association. [2021-12-27]. https://tinyurl.com/2p942nwx .
  • 23.Joseph-Williams N, Elwyn G, Edwards A. Knowledge is not power for patients: a systematic review and thematic synthesis of patient-reported barriers and facilitators to shared decision making. Patient Educ Couns. 2014 Mar;94(3):291–309. doi: 10.1016/j.pec.2013.10.031.S0738-3991(13)00472-2 [DOI] [PubMed] [Google Scholar]
  • 24.Dogba MJ, Menear M, Brière N, Freitas A, Emond J, Stacey D, Légaré F. Enhancing interprofessionalism in shared decision-making training within homecare settings: a short report. J Interprof Care. 2020;34(1):143–6. doi: 10.1080/13561820.2019.1623764. [DOI] [PubMed] [Google Scholar]
  • 25.Keshmiri F, Rezai M, Tavakoli N. The effect of interprofessional education on healthcare providers' intentions to engage in interprofessional shared decision-making: perspectives from the theory of planned behaviour. J Eval Clin Pract. 2020 Aug;26(4):1153–61. doi: 10.1111/jep.13379. [DOI] [PubMed] [Google Scholar]
  • 26.Körner M, Ehrhardt H, Steger A, Bengel J. Interprofessional SDM train-the-trainer program "Fit for SDM": provider satisfaction and impact on participation. Patient Educ Couns. 2012 Oct;89(1):122–8. doi: 10.1016/j.pec.2012.04.008.S0738-3991(12)00166-8 [DOI] [PubMed] [Google Scholar]
  • 27.Légaré F, Stacey D, Gagnon S, Dunn S, Pluye P, Frosch D, Kryworuchko J, Elwyn G, Gagnon M, Graham ID. Validating a conceptual model for an inter-professional approach to shared decision making: a mixed methods study. J Eval Clin Pract. 2011 Aug 27;17(4):554–64. doi: 10.1111/j.1365-2753.2010.01515.x. doi: 10.1111/j.1365-2753.2010.01515.x.JEP1515 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Légaré F, Stacey D, Pouliot S, Gauvin F, Desroches S, Kryworuchko J, Dunn S, Elwyn G, Frosch D, Gagnon M, Harrison MB, Pluye P, Graham ID. Interprofessionalism and shared decision-making in primary care: a stepwise approach towards a new model. J Interprof Care. 2011 Jan 26;25(1):18–25. doi: 10.3109/13561820.2010.490502. http://europepmc.org/abstract/MED/20795835 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Sullivan L. A systematic review to compare the effectiveness of face-to-face versus online (including blended learning) delivery of CME/CPD for healthcare practitioners (HCPs) The University of Queensland. [2021-12-27]. https://espace.library.uq.edu.au/view/UQ:674199 .
  • 30.O'Brien Pott M, Blanshan AS, Huneke KM, Baasch Thomas BL, Cook DA. Barriers to identifying and obtaining CME: a national survey of physicians, nurse practitioners and physician assistants. BMC Med Educ. 2021 Mar 19;21(1):168. doi: 10.1186/s12909-021-02595-x. https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-021-02595-x .10.1186/s12909-021-02595-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Gravas S, Ahmad M, Hernández-Porras A, Furriel F, Alvarez-Maestro M, Kumar A, Lee K, Azodoh E, Mburugu P, Sanchez-Salas R, Bolton D, Gomez R, Klotz L, Kulkarni S, Tanguay S, Elliott S, de la Rosette J, Office of EducationSIU Board of Directors Impact of COVID-19 on medical education: introducing homo digitalis. World J Urol. 2021 Jun;39(6):1997–2003. doi: 10.1007/s00345-020-03417-3. http://europepmc.org/abstract/MED/32860535 .10.1007/s00345-020-03417-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Dean E. When COVID-19 started, the CPD almost stopped. Nurs Standard. 2020;35(9):33–5. doi: 10.7748/ns.35.9.33.s15. https://journals.rcni.com/nursing-standard/analysis/when-covid19-started-the-cpd-almost-stopped-ns.35.9.33.s15/abs . [DOI] [Google Scholar]
  • 33.Samuel A, Cervero RM, Durning SJ, Maggio LA. Effect of continuing professional development on health professionals' performance and patient outcomes: a scoping review of knowledge syntheses. Acad Med. 2021 Jun 01;96(6):913–23. doi: 10.1097/ACM.0000000000003899.00001888-202106000-00051 [DOI] [PubMed] [Google Scholar]
  • 34.Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA. 2008 Sep 10;300(10):1181–96. doi: 10.1001/jama.300.10.1181.300/10/1181 [DOI] [PubMed] [Google Scholar]
  • 35.Eysenbach G, CONSORT-EHEALTH Group CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011 Dec 31;13(4):e126. doi: 10.2196/jmir.1923. https://www.jmir.org/2011/4/e126/ v13i4e126 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Lancaster GA, Thabane L. Guidelines for reporting non-randomised pilot and feasibility studies. Pilot Feasibility Stud. 2019;5:114. doi: 10.1186/s40814-019-0499-1. https://pilotfeasibilitystudies.biomedcentral.com/articles/10.1186/s40814-019-0499-1 .499 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Poulin Herron A, Agbadje TT, Cote M, Djade CD, Roch G, Rousseau F, Légaré F. Web-based training for nurses on shared decision making and prenatal screening for down syndrome: protocol for a randomized controlled trial. JMIR Res Protoc. 2020 Oct 29;9(10):e17878. doi: 10.2196/17878. https://www.researchprotocols.org/2020/10/e17878/ v9i10e17878 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, Lamb SE, Dixon-Woods M, McCulloch P, Wyatt JC, Chan A, Michie S. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014 Mar 07;348:g1687. doi: 10.1136/bmj.g1687. [DOI] [PubMed] [Google Scholar]
  • 39.Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, Cording E, Tomson D, Dodd C, Rollnick S, Edwards A, Barry M. Shared decision making: a model for clinical practice. J Gen Intern Med. 2012 Oct 23;27(10):1361–7. doi: 10.1007/s11606-012-2077-6. http://europepmc.org/abstract/MED/22618581 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Agbadje TT, Rahimi SA, Côté M, Tremblay A, Diallo MP, Elidor H, Herron AP, Djade CD, Légaré F. Evaluation of a prenatal screening decision aid: a mixed methods pilot study. Patient Educ Couns. 2021 May 18; doi: 10.1016/j.pec.2021.05.025. (forthcoming)S0738-3991(21)00356-6 [DOI] [PubMed] [Google Scholar]
  • 41.Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, Barratt A, Barry M, Bernstein S, Butow P, Clarke A, Entwistle V, Feldman-Stewart D, Holmes-Rovner M, Llewellyn-Thomas H, Moumjid N, Mulley A, Ruland C, Sepucha K, Sykes A, Whelan T, International Patient Decision Aids Standards (IPDAS) Collaboration Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006 Aug 26;333(7565):417. doi: 10.1136/bmj.38926.629329.AE. http://europepmc.org/abstract/MED/16908462 .bmj.38926.629329.AE [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick's Four Levels of Training Evaluation. Alexandria, Virginia: ATD Press; 2016. [Google Scholar]
  • 43.Müller E, Strukava A, Scholl I, Härter M, Diouf NT, Légaré F, Buchholz A. Strategies to evaluate healthcare provider trainings in shared decision-making (SDM): a systematic review of evaluation studies. BMJ Open. 2019 Jun 21;9(6):e026488. doi: 10.1136/bmjopen-2018-026488. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=31230005 .bmjopen-2018-026488 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Armitage C, Conner M. Efficacy of the Theory of Planned Behaviour: a meta-analytic review. Br J Soc Psychol. 2001 Dec;40(Pt 4):471–99. doi: 10.1348/014466601164939. [DOI] [PubMed] [Google Scholar]
  • 45.Légaré F, Borduas F, Freitas A, Jacques A, Godin G, Luconi F, Grimshaw J, CPD-KT team Development of a simple 12-item theory-based instrument to assess the impact of continuing professional development on clinical behavioral intentions. PLoS One. 2014;9(3):e91013. doi: 10.1371/journal.pone.0091013. https://dx.plos.org/10.1371/journal.pone.0091013 .PONE-D-13-52423 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Godin G. Les Comportements Dans Le Domaine De La Santé. Montréal: Presses de l’Université de Montréal; 2012. [Google Scholar]
  • 47.Warshaw PR, Davis FD. Disentangling behavioral intention and behavioral expectation. J Experimental Soc Psychol. 1985 May;21(3):213–28. doi: 10.1016/0022-1031(85)90017-4. [DOI] [Google Scholar]
  • 48.Légaré F, Freitas A, Turcotte S, Borduas F, Jacques A, Luconi F, Godin G, Boucher A, Sargeant J, Labrecque M. Responsiveness of a simple tool for assessing change in behavioral intention after continuing professional development activities. PLoS One. 2017;12(5):e0176678. doi: 10.1371/journal.pone.0176678. https://dx.plos.org/10.1371/journal.pone.0176678 .PONE-D-16-28040 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Ajzen I. Action Control. Berlin, Heidelberg: Springer; 1985. From intentions to actions: a theory of planned behavior. [Google Scholar]
  • 50.Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008 Jul 16;3:36. doi: 10.1186/1748-5908-3-36. https://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-3-36 .1748-5908-3-36 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Giangreco A, Sebastiano A, Peccei R. Trainees' reactions to training: an analysis of the factors affecting overall satisfaction with training. Int J Human Resource Manag. 2009 Jan;20(1):96–111. doi: 10.1080/09585190802528417. [DOI] [Google Scholar]
  • 52.Community and continuing medical education. UConn Health. [2021-12-27]. https://health.uconn.edu/continuing-medical-education/overview/required-activity-forms/evaluation/
  • 53.Abbasgholizadeh Rahimi S, Lépine J, Croteau J, Robitaille H, Giguere AM, Wilson BJ, Rousseau F, Lévesque I, Légaré F. Psychosocial factors of health professionals' intention to use a decision aid for down syndrome screening: cross-sectional quantitative study. J Med Internet Res. 2018 Apr 25;20(4):e114. doi: 10.2196/jmir.9036. https://www.jmir.org/2018/4/e114/ v20i4e114 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Ironyt TZ, Pereirat CA. Exact tests for equality of two proportions: fisher v. bayes. J Stat Comput Simulation. 1986 Aug;25(1-2):93–114. doi: 10.1080/00949658608810926. [DOI] [Google Scholar]
  • 55.Grayson DA. Confounding confounding. Am J Epidemiol. 1987 Sep;126(3):546–53. doi: 10.1093/oxfordjournals.aje.a114687. [DOI] [PubMed] [Google Scholar]
  • 56.Sox HC, Goodman SN. The methods of comparative effectiveness research. Annu Rev Public Health. 2012 Apr;33:425–45. doi: 10.1146/annurev-publhealth-031811-124610. [DOI] [PubMed] [Google Scholar]
  • 57.National nursing education framework. Canadian Association of Schools of Nursing. [2021-12-27]. https://www.casn.ca/wp-content/uploads/2014/12/Masters-Framwork-FINAL-SB-Jan-2016.pdf,
  • 58.Newman MA, Sime AM, Corcoran-Perry SA. The focus of the discipline of nursing. ANS Adv Nurs Sci. 1991 Sep;14(1):1–6. doi: 10.1097/00012272-199109000-00002. [DOI] [PubMed] [Google Scholar]
  • 59.Birch PH, Adam S, Coe RR, Port AV, Vortel M, Friedman JM, Légaré F. Assessing shared decision-making clinical behaviors among genetic counsellors. J Genet Couns. 2018 Aug 14; doi: 10.1007/s10897-018-0285-x. (forthcoming)10.1007/s10897-018-0285-x [DOI] [PubMed] [Google Scholar]
  • 60.Vortel MA, Adam S, Port-Thompson AV, Friedman JM, Grande SW, Birch PH. Comparing the ability of OPTION(12) and OPTION(5) to assess shared decision-making in genetic counselling. Patient Educ Couns. 2016 Oct;99(10):1717–23. doi: 10.1016/j.pec.2016.03.024.S0738-3991(16)30146-X [DOI] [PubMed] [Google Scholar]
  • 61.Latif A, Waring J, Chen L, Pollock K, Solomon J, Gulzar N, Gulzar S, Anderson E, Choudhary S, Abbasi N, Wharrad HJ, Anderson C. Supporting the provision of pharmacy medication reviews to marginalised (medically underserved) groups: a before/after questionnaire study investigating the impact of a patient-professional co-produced digital educational intervention. BMJ Open. 2019 Sep 17;9(9):e031548. doi: 10.1136/bmjopen-2019-031548. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=31530620 .bmjopen-2019-031548 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Cook L, Peden A. Finding a focus for nursing: the caring concept. ANS Adv Nurs Sci. 2017;40(1):12–23. doi: 10.1097/ANS.0000000000000137. [DOI] [PubMed] [Google Scholar]
  • 63.Mørk T, Lähteenmäki L, Grunert KG. Determinants of intention to reduce salt intake and willingness to purchase salt-reduced food products: evidence from a web survey. Appetite. 2019 Aug 01;139:110–8. doi: 10.1016/j.appet.2019.04.018. https://linkinghub.elsevier.com/retrieve/pii/S0195-6663(18)31751-3 .S0195-6663(18)31751-3 [DOI] [PubMed] [Google Scholar]
  • 64.Conner M, Norman P. Predicting Health Behaviour. London: Open University Press; 2005. [Google Scholar]
  • 65.Willemsen MC, De Vries H, van Breukelen G, Oldenburg B. Determinants of intention to quit smoking among Dutch employees: the influence of the social environment. Prev Med. 1996;25(2):195–202. doi: 10.1006/pmed.1996.0046.S0091-7435(96)90046-8 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

CONSORT-eHEALTH checklist (V 1.6.1).

Multimedia Appendix 2

Report of both programs according to the Template for Intervention Description and Replication items.

Multimedia Appendix 3

Screenshots of the training content.

Multimedia Appendix 4

Data collection questionnaire after the training.


Articles from JMIR Nursing are provided here courtesy of JMIR Publications Inc.

RESOURCES