Abstract
Objective/design/setting
This study aims to develop preprocedural communication-specific framework that emphasises the use of audiovisual materials and compares its acceptability by trainees with a regular module.
Trainees
Between October 2018 and July 2021, 96 medical clerks were enrolled and randomly divided into regular and intervention groups. Another 48 trainees whose did not join the framework-based training but complete self-assessments were enrolled as the control group.
Interventions
In the intervention training module, the key steps of preprocedural communication-specific skills were structuralised into a framework using the acronym of OSCAR.
Primary and secondary outcome measures
This study compared the acceptability of trainees for two modules by measuring the degree of increase in the end-of-rotation and follow up (4 weeks later) competency from baseline by trainees’ self-assessments and physician assessments after serial trainings.
Results
In comparison with regular group trainees, greater degree of improvements (framework-1 statement: 111%±13% vs 27%±5%, p<0.001; framework-2 statement: 77%±9% vs 48%±2%, p<0.05; skill-1 statement: 105%±9% vs 48%±3%, p<0.001); skill-2 statement: 71%±11% vs 50%±9%, p<0.05) were noted in the framework-related and skill-related statement 1–2 (the familiarity and confidence to use the framework and skills) than those of intervention group. At the end-of-rotation stage, the trainees ability to use the ‘A-step: using audiovisual materials’ of the OSCAR was significantly improved (229%±13%, p<0.001), compared with other steps. In the intervention group, the degree of improvement of the end-of-rotation data of trainees’ self-assessment from baseline was significantly correlated with the degree of the improvement in physicians’ assessment data in the aspects of skills, framework and steps in framework (R=0.872, p<0.01; R=0.813, p<0.001; R=0.914, p<0.001).
Conclusions
The OSCAR framework-based intervention module is well accepted by medical clerks and motivates them to integrate the acquired skills in clinical practice, which leads to trainees’ primary care patients being satisfied with their preprocedural communication.
Keywords: information management, general medicine (see internal medicine), education & training (see medical education & training)
Strengths and limitations of this study.
Through serial baseline, end-of-rotation and follow-up assessments by trainees and physicians, this study evaluates the acceptability of an intervention module for training preprocedural communication skills of medical clerks during clinical rotation.
In addition to the regular and intervention groups trainees whose receive training for using a preprocedural communication framework and materials, control group whose did not join regular or intervention group were included for comparison.
This study was limited to a single site with relative sample size.
The competency of medical clerks’ skills in providing preprocedural communication was observed by physicians in class rather than in a clinical ward.
The study lacks an evaluation of the degree of transfer of acquired skills by medical clerks in practice via direct work-place assessments and patients’ satisfaction.
Introduction
Before medical procedures, anxious patients are not easy to satisfy with preprocedural communication if they lack specific audiovisual materials and frameworks.1 Effective reduction of preprocedural anxiety depends on doctors’ effective and accurate communication skills.2 When facing anxious patients, detailed communication can decrease their anxiety, improve periprocedural tolerability and increase satisfaction with the medical procedure and care.3–5
The Accreditation Council for Graduate Medical Education and the American Board of Medical Specialties have jointly identified communication skills as one of the six core competencies for physicians.6–8 Moreover, the Institute of Medicine also specifies communication skills as one of the six essential competencies for effective patient care. The Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) are formative assessments of the clinical competency of medical trainees.8 9 The importance of the teaching and assessment of communication skills has been reinforced by the fact that it has been integrated as an importance domain in the mini-CEX and DOPS.10
During the ward round, physicians sometimes lack sufficient time to provide detailed information about medical procedures to patients. Medical clerks, the most junior physicians, are thus the first-line healthcare personnel responsible for communicating with anxious patients about details of the preparation, periprocedural cooperation, postprocedural precaution, etc. The involvement of medical clerks in communication has been reported to enhance their competency and patients’ satisfaction. However, recent studies have reported that in complex clinical environments, without adequate framework, structural training and audiovisual materials, medical clerks and patients will fail to engage in effective preprocedural communication.11 12 Therefore, it is important to develop an easy-to-remember framework that integrates audiovisual materials for training and assessing the preprocedural communication skills of medical clerks.
For years in our institution, medical clerks were regularly trained and assessed with a regular framework for medical communication, which included the five steps that shown in table 1.13 The ACGME has included this regular framework in its toolbox of assessment methods for communication skills.14 However, the regular framework did not include essential elements of preprocedural communication, which are difficult to memorise and use in training and assessment of the process (or coherence) of medical communication in a complex clinical environment.15 Coherence is important in this context, as it refers to one’s understanding of the procedure.
Table 1.
The content of each step of regular and OSCAR framework for preprocedural communication skills and the trainings for regular, intervention and control group medical clerks in this study
| Details of each step in the regular framework | Step-1:Setting the stage | Details of each step in the OSCAR framework | O-step: Opening with what, when, why and how |
| Step 2: Eliciting information | S-step: explaining Subject to be communicated | ||
| Step-3: Providing information | C-step: Check for patients’ understanding of the subjects | ||
| Step-4: Understanding the patient’s perspective | A-step: Aid patient understanding with audiovisual material | ||
| Step-5: Ending the encounter | R-step: Recheck patient understanding | ||
| Details trainings and assessment among groups | Regular group | Intervention group | Control group |
| 2-hour introductory class | √ | ||
| Training for using of five steps regular framework | √ | ||
| Training for using of five steps OSCAR framework | √ | ||
| End-of-rotation class | √ | √ | |
| Complete baseline, end-of-rotation, follow-up self-assessments | √ | √ | √ |
| Receive baseline and end-of-rotation assessments from physicians | √ | √ |
Recent data derived from the use of the mini-CEX and DOPS showed that trainees’ competency of preprocedural communication skills was inferior to other domains.10 Meanwhile, trainees reported that they have difficulties in transferring the in-class acquired regular framework for preprocedure communication skills to real-world setting due to the complicated clinical environment and the anxiousness of patients.13 15 Thus, beginning in October 2018, for easy memorisation and application, the educational committee developed the OSCAR, which includes the 5 steps of Opening, clarifying the Subject to be discussed, Checking patients’ understanding of the subject, Aiding patient understanding with procedure-specific audiovisual (audiovisual) materials, and Rechecking the patients’ understanding of the subject based on the regular communication framework. The OSCAR framework that shown in table 1 emphasises audiovisual and acronym methods for training on preprocedural communication.13 15 16
It is important to build trainees’ ability to effectively communicate the procedure and risk of interventions to patients. In particular, involvement of medical clerks in communication can enhance their competency and patients′ satisfaction.17 It had been reported that anxious patients are prone to feeling dissatisfaction in regard to receive information simply through verbal communication.18 To enhance preprocedural satisfaction and maximise information gain, recent studies have suggested the use of audiovisual materials in) the ‘A step: Aid patient understanding’ step of the OSCAR communication framework.18–21
Taken together, this study aims to evaluate the acceptability of the implementation of the audiovisual materials-integrated preprocedural communication-specific OSCAR framework in teaching and assessing the preprocedural communication skills of medical clerks during clinical rotation. At the end-of-rotation and follow-up stages, the degree of improvement and retention effects were compared between groups. Finally, the correlation between the degree of improvement from baseline of the trainee self-assessments and physician assessments was evaluated.
Methods
Research design and training hypothesis
In 2016–2017, the annual clerkship surveys revealed that the regular framework-based communication training module did not give medical trainees confidence in providing preprocedural communication. Facing this challenge, the educational committee developed medical procedure-specific audiovisual materials and integrated them into a preprocedural communication-specific framework.
This was a prospective case-controlled study. The training hypotheses for the regular and intervention modules were the same, including experiential learning, structured skill-based learning and learner self-reflection fostering.22 23 In both the regular and intervention modules, didactic lecture and small-group role play plus discussion were included in the demonstration, discussion, reflection, practice and feedback phases for training with either the regular or OSCAR framework.11 16 22–24 We proposed that, in comparison with the regular framework, the OSCAR framework, which includes the detailed essential steps of preprocedural communication will enhance the acceptability of training. In particular, the use of audiovisual materials has been emphasised in the OSCAR framework. In this study, we hypothesised that use of the OSCAR framework would lead to better communication with patients than the regular approach, and better than communication seen in the control group.
Participants
Between August 2019 and July 2021, 48 medical clerks in each group (eight consecutive batches of six students) were enrolled and randomly divided into regular and intervention groups for training of preprocedural communication skills related to central venous catheterisation, bronchoscopy, thoracentesis, lumbar puncture and tracheostomy with either regular or intervention modules in their clinical rotation. In the intervention module, the OSCAR framework was designed for preprocedural communication in-class and in clinical practice. Before implementation in routine training, the OSCAR framework was piloted by testing it with voluntary medical clerks to ensure that the element of preprocedural communication had been integrated appropriately. Additionally, the third group of medical clerks (n=48) whose did not join either regular or intervention groups to receive additional training using a preprocedural communication framework and materials were served as the control group.
Procedure-content of regular five-step and OSCAR-based communication training modules
In both the regular and OSCAR framework-based modules for preprocedural communication, the same introductory class and end-of-rotation class were arranged and led by certified physicians (table 1). The 2-hour introductory classes began with introductory demonstrations using either the regular or OSCAR framework (30 min), and then featured, interactive discussion regarding using either framework to increase patients' understanding of the details of medical procedures (30 min), reflection on trainees’ real-world experience with procedural communication (15 min), dyad practising the regular or OSCAR framework with one standardised patient (SP) (30 min), ultimately concluding with a grouped feedback (15 min; figure 1). In contrast to the regular framework-based module, the intervention module emphasised the integration of procedure-specific audiovisual (two-dimensional, three-dimensional, virtual reality) (materials in) class and in clinical practice. Overall, both modules asked trainees to integrate acquired knowledge and skills in communicating with their patients between the introductory and end-of-rotation classes. On the end-of-rotation class, the physician discussed each trainee’s real-world experience with practice, provided feedback, demonstrated changeable behaviours through role playing, and ended with group reflection (table 1).22–24
Figure 1.
Schematic flow for additional training of the preprocedural communication skills of medical clerks for the regular framework-based regular module and OSCAR framework-based intervention module. The control group is the third group trainees whose did not belong to either the regular or intervention group.
Instrumentation for training and assessments
To increase the efficiency of clinical practice and in-class training, and to achieve a paperless approach, the detailed contents of the training, regular or OSCAR framework, audiovisual materials and assessment form were packaged in various QR codes. Users can access the information using various devices, such as smartphones, iPads and laptops. Medical clerks and physicians in the regular, intervention and control groups were asked to complete the baseline and end-of-rotation assessments in table 2. Additionally, 4 weeks after end-of-rotation, trainees were emailed for follow-up regarding their competency, whether they applied the learnt skills in clinical practice, and patient satisfaction in relation to their preprocedural communication skills.
Table 2.
Baseline, end-of-rotation and follow-up assessment form for medical clerks and physicians
| The first part is skills-related statements 1–3 | You are (trainee is) familiar with skills related to providing information (preparation, periprocedural cooperation and postprocedural precaution) regarding medical procedures to patients |
| You have (trainee has) confidence in providing information (preparation, periprocedural cooperation and postprocedural precaution) regarding medical procedures to patients | |
| You are (trainee is) not anxious about providing information (preparation, periprocedural cooperation and postprocedural precaution) regarding medical procedures to patients | |
| The second part is framework-related statements 1–3 | You are (trainee is) familiar with the regular or OSCAR framework, you have (trainee has) confidence in using the regular or OSCAR framework |
| You have (trainee has) confidence in using the regular or OSCAR framework | |
| You are (trainee is) not anxious about using the regular or OSCAR framework | |
| The third part is the competency to use steps in framework-related statements 1–5 (*‘regular’ and ‘control’ groups answer the statement 1–1, 2–1, 3–1, 4–1, 5–1 and the ‘intervention’ group answer the statement 1–2, 2–2, 3–2, 4–2, 5–2) |
Statement 1–1: you (trainee) can use the ‘step-1: setting the stage’ of the regular framework’ Statement 1–2: you (trainee) can use the ‘O-step: opening with what, when, why and how’ of the OSCAR framework |
|
Statement 2–1: you (trainee) can use the ‘step-2: eliciting information’ of the regular framework Statement 2–2: you (trainee) can use the ‘S-step: explaining Subject to be communicated’ of the OSCAR framework” | |
|
Statement 3–1: ‘you (trainee) can use the ‘step-3:giving information’ of the regular framework’ Statement 3–2: ‘you (trainee) can use the ‘C-step:Check patients understanding about the subjects’ | |
|
Statement 4–1: ‘you (trainee) can use the ‘step-4.understanding the patient’s perspective’ of the regular framework’ Statement 4–2: ‘you (trainee) can use the ‘A-step: Aid patient understanding with audiovisual materials’ | |
|
Statement 5–1: ‘you (trainee) can use the ‘step-5:ending the encounter’ of the regular framework’ Statement 5–2: ‘you (trainee) can use the ‘R-step:Recheck patient understanding’ of the OSCAR framework’ | |
| Responders answer each statement with 5-point Likert scale (5=strongly agree, 4=agree, 3=neutral, 2=did not agree, 1=strongly disagree) | |
Patient and public involvement
No patient involved
Statistical analysis
Data were expressed as mean±SD. A significance level of p=0.05 was chosen. The significance of difference of baseline and end-of-rotation data of individual groups were compared with paired students t test. Both for the trainees-self-assessment and physicians-assessment, the degree of improvement (per cent changes) of end-of-rotation data from baseline data of the step-1, step-2, step-3, step-4, step-5 in the regular framework of within the regular group were compared with one-way Analysis of Variance (ANOVA). Similarly, the degree of improvement (per cent changes) of end-of-rotation data from baseline data of the O-step, S-step, C-step, A-step and R-step in OSCAR framework within the intervention group were compared with one-way ANOVA with post hoc Tukey Test. The comparison of the degree of improvement of the skill-related or framework-related competency between regular and intervention group were analysed with Student’s t-test. Pearson correlation coefficient and p value was calculated to check the correlations between the degree of improvement in trainees’ self-assessment data from baseline and the degree of improvement in physicians’ assessment data from baseline among regular and intervention groups.
Results
Basic characteristics of medical clerks
There was no difference among the regular, intervention and control groups in regard to the mean age, distribution of gender, percentage of trainees receiving training in communication skills within 6 months before participating the study, percentage of trainees receiving training of preprocedural communication skills within 6 months before participating in the study, percentage of trainees with experience communicating with patients’ family regarding the details of medical procedures including central venous catheterisation, lumbar puncture, bronchoscopy, thoracentesis and tracheostomy (table 3).
Table 3.
Basal characteristics of three groups
| Regular group medical clerks (n=48) | Intervention group medical clerks (n=48) | Control group medical clerks (n=48) | |
| Age (years) | 21.5±1.2 | 22.8±0.9 | 21.9±1.4 |
| Gender (female/male) | 21/27 (44/56%) | 23/25 (48/52%) | 16/32 (33/67%) |
| % of trainees receiving training of communication skills within 6 months before participating the study | 46 (96%) | 47 (97%) | 44 (92%) |
| % of trainees receiving training of preprocedural communication skills within 6 months before participating the study | 4/48 (8%) | 5/48 (10%) | 3/48 (6%) |
| % of trainees who have experience communicating with patients about the details of any one of the medical procedures including either central venous catheterisation, lumbar puncture, bronchoscopy, thoracentesis or tracheostomy within 6 months before participating the study | 12/48 (25%) | 15/48 (31%) | 10/48 (20%) |
The OSCAR preprocedural communication framework-based intervention module was generally well accepted by trainees
There was no difference in the baseline degree of the medical clerks’ agreement with skills-related statements among the three groups (figure 2A). In comparison to the baseline stage, the degree of agreement of regular and intervention group′ trainees to the aforementioned skills-related statements significantly increased at end-of-rotation stage. The degree of improvement in trainees’ agreement with the aforementioned skills-related statements 1–2 was greater in the intervention group than that in the regular group (regular vs intervention group: skill-1 statement: 48%±3% vs 105±9%, p<0.001); skill-2 statement: 50%±9% vs 71±11%, p<0.05, figure 2A).
Figure 2.
Comparison of the baseline (introductory class) and end-of rotation (end-of rotation class) degree of medical clerks’ agreement with the competency-related statements. (A) Trainees’ agreement with the skills-related statements for preprocedural communication competency; (B) trainees’ agreement with the framework-related statements for preprocedural communication competency. *P<0.05 or **p<0.001 vs regular group; #p<0.05 vs baseline data; STAT, statement.
There were no differences among the three group in the degree of the medical clerks’ baseline agreement with the framework-related statements (figure 2B). In comparison with the baseline data, the degree of the regular and intervention group trainees’ end-of-rotation agreement with the aforementioned framework-related statements significantly increased. The degree of improvement in trainees’ agreement with the framework-related statement 1–2 was greater in the intervention group than that in the regular group ((regular vs intervention group: framework-1 statement: 27%±5% vs 111±13%, p<0.001); framework-2 statement: 48%±2% vs 77±9%, p<0.05, figure 2B). The trainees’ end-of-rotation agreement with the skills and framework-related statements 1 and 3 did not differ from the baseline in the control group.
Each step in the OSCAR framework is well accepted by the intervention group trainees
Figure 3A–B reveals that the baseline trainees’ agreement with the statements regarding their competency to use each step of either the regular or OSCAR framework did not differ among the three groups. Particularly, the intervention group’s baseline competency to use the “A-step” of the OSCAR framework is relatively lower but not reach the statistical significance than for other steps of the OSCAR framework (figure 3B). At the end-of-rotation stage, regular and intervention group trainees’ agreement with the statements that they could use each step of the regular or the OSCAR framework were increased. At the end-of-rotation stage, the ability of the intervention group to use the ‘A-step’ of the OSCAR framework was significantly improved (229%±13% improved from baseline, p<0.001 compared with the degree of improvement in other steps, figure 3B). The control group trainee’s agreement with the statement regarding their competency of using each step of the regular frameworks did not differ between the baseline and end-of-rotation stages.
Figure 3.
Comparison of the baseline and end-of rotation degree of medical clerks’ agreement with the self-assessed competency of using each step of the framework. (A) Regular and control group trainees’ agreement with the statements that they can use each step of the regular framework; (B) Intervention group trainees’ agreement with the statements that they can use each step of the OSCAR framework. #p<0.05 vs baseline data; STAT, statement.
Physicians reported that the acceptability of trainees to framework-based communication is higher in the intervention group than the regular group
Similar to the changing trends of the trainees’ competency by physician assessments were similar to the data of trainees’ self-assessment (figure 2A). The baseline trainees’ competency (familiarity, confidence, and anxiety) of giving preprocedural communication, using the regular or OSCAR framework, and using each step of the regular or OSCAR framework were similar between the regular and intervention groups (figures 4A–B and 5A). Significantly, the degree of improvement from baseline was greater in the intervention group than those in the regular group (regular vs intervention group: skill-1 statements: 21%±7% vs 100%±9%, p<0.001); framework-1 statements: 45%±3% vs 100%±11%, p<0.001, figure 4A–B). In the intervention group, the physicians-assessed end-of-rotation data revealed that the improvement was highest in the statement of ‘trainee can use the ‘A-step: Aid patient understanding with audiovisual materials’ compared with the other four ‘O-step, S-step, C-step, R-step’ statements (A-step: 170% vs O-step: 129%, S-step: 111%; C-step:91%; R-step: 100%).
Figure 4.
Comparison of the baseline and end-of rotation degree of physicians’ agreement with the trainees’ competency-related statements. (A) Physicians’ agreement with the trainees’ skills-related statements for preprocedural communication competency; (B) physicians’ agreement with the trainees’ framework-related statements for preprocedural communication competency. *P<0.05 or **p<0.001 vs regular group; #p<0.05 vs baseline data.
Figure 5.
Per cent change of end-of rotation data from baseline data for trainees’ self-assessed competency and corresponding physicians-assessed trainees’ competency. (A) Degree of physicians’ agreement to the statement regarding trainees’ competency to use each step of regular or OSCAR framework; (B) comparison of the percent changes of end-of-rotation data from baseline data for trainees’ self-assessed competency and corresponding physicians-assessed trainees’ competency. ∅∅: p<0.001 vs. other groups, #p<0.05 vs baseline data.
The trainees self-assessed degree of improvement from baseline at end-of-rotation stage in the intervention group was correlated with physician assessment
At the end-of-rotation stage, the degree of improvement in regular group trainees’ self-assessment data from baseline was higher than the degree of improvement in physicians’ assessment data from baseline (figure 5B). Notably, the degree of improvement in the self-assessment data of the intervention group trainees’ from baseline was similar to the degree of improvement in physicians’ assessment data from baseline. Further, correlation analysis revealed that, in the intervention group, the degree of improvement of the end-of-rotation data of trainees’ self-assessment from baseline was significantly correlated with the degree of the improvement in physicians’ assessment data in the aspects of skills, framework, and steps in framework (R=0.872, p<0.01; R=0.813, p<0.001; R=0.914, p<0.001, figure 6). Nonetheless, in the regular group, the degree of improvement of the end-of-rotation data from baseline of trainees’ self-assessment was not significantly correlated with the degree of the improvement in physicians’ assessment data in the aspects of skills, framework and steps in framework (figure 6).
Figure 6.
Correlation between the per cent change of different aspects of the end-of rotation data from baseline data of trainees’ self-assessed competency and corresponding physicians-assessed trainees’ competency. (A) The skills aspect in the regular group; (B) the framework aspect in the regular group; (C) the steps of framework aspect in the regular group; (D) the skills aspect in the intervention group; (E) the framework aspect in the intervention group; (F) the steps of framework aspect in the intervention group.
OSCAR framework is well accepted by trainees and motivates them to integrate the acquired preprocedural communication skills into primary care
Overall, the email response rate to the follow-up assessment 4 weeks after training class was 85%, 87% and 93% among the regular, control and intervention groups, respectively. The follow-up data revealed that a higher percentage (85%) of the intervention group trainees had applied the acquired skills in primary care than trainees in the regular (65%) and control (40%) group (table 4). Notably, in comparison to the data of the end-of-rotation stage, the intervention group’s agreement with the skill-related and framework-related statements did not decrease at the follow-up stage. Nonetheless, the regular group’ agreement to the above skill-related and framework-related statements were decreased at follow-up stage (figure 2A–B). These results indicated that the OSCAR framework-based intervention module had good retention training effects among the intervention group’ trainees. Moreover, the degree of intervention group’ agreement to the statement of ‘your patients are satisfied with your preprocedural communication skills’ is higher than that of regular and control groups (table 4).
Table 4.
Follow-Up (4 weeks after end-of-rotation class) competency of three groups
| Regular group medical clerks (n=48) | Intervention group medical clerks (n=48) | Control group medical clerks (n=48) | |
| % of trainees reported that they had applied the acquired skills in primary care | 31/48 (65%) | 41/48 (85%) | 19/48 (40%) |
| Average degree of trainees’ agreement with the statement ‘your patients are satisfied with your preprocedural communication skills’ | 2.9±0.6 | 4.4±0.5* | 2.3±0.4 |
5-point likert scale from 1 to 5 (□ very agree (5),□ agree (4),□ neutral (3),□ not agree (2),□ not very agree (1).
*P<0.05 vs regular group.
Discussion
In our study, both in the regular framework-based and OSCAR framework-based intervention modules, the teaching schedule included didactic approach and small group role-play plus discussion. The didactic approach has the advantages of (1) it efficiently presents core concepts for large numbers of learners; (2) it requires minimal time and faculty resources to deliver content to a wide range of learners and (3) it provides an opportunity for learners to efficiently use demonstrated skills. Small group role-play plus discussion, on the other hand, has the following advantages: (1) it presents multiple scenarios showing a range of approaches and patient responses; (2) trainees receive skills practice with feedback from faculty and peers and (3) it provides learners with the opportunity to discuss issues, skills and concerns.22–24
SPs, who are actors trained to reliably and reproducibly enact a patient scenario, allowing students to practice this challenging communication task without the concern of causing harm to an actual patient.24 SP simulations are effective in teaching and assessing communication skills.25 In both modules of this study, the SPs had been involved in the demonstration and role play on the introductory and end-of-rotation classes. Through role play with SPs, physicians can directly assess the improvement in trainees’ competency in preprocedural communication skills. In the control group, physicians assessed trainees’ baseline and end-of-rotation competency via observation in clinical wards.
In our study, both regular and OSCAR framework-based small-group training is well accepted by trainees and increased their confidence in providing preprocedural communication. Moreover, the regular and intervention group’ trainees reported that additional small-group training modules were useful in increasing their confidence in handling difficult communication. Most trainees desire more opportunities to role-play communication skills with SPs.
Self-assessment plays an important role in supporting the development of reflection and self-awareness skills.26 Therefore, researchers have suggested that the data from medical clerks’ self-assessment is a record of the process of self-reflection. For medial trainees, self-assessment is suggested as a way of identifying one’s strengths and weaknesses to guide goal setting and enhance self-efficacy.26 27 It is believed that students who maintain a more active role in the learning process are able to assess their own performance more objectively.28 So, in our study, both the regular and OSCAR framework-based modules increased medical clerks’ self-assessed competency for providing preprocedural communication after training.
It is indicated that the direct involvement of learners in assessing their work is highly effective in enhancing learning. Familiarity with an activity has been shown to positively affect trainees’ ability to self-assess of the performance of their task.29 Teachers’ evaluation brings more solid results.30 In our study, most of the medical clerks reported that they need to assess their readiness about audiovisual materials that incorporated in OSCAR framework before using it. Probably, this involvement increases their familiarities with skills, framework and steps in OSCAR communication framework. Notably, in intervention group, the degree of the end-of-rotation data of trainees self-assessed improvement from baseline was correlated with the degree of improvement the data of physicians’ assessment.
Studies show that patients often feel that they do not receive satisfactory information from their healthcare provider.31 Increasing patients’ families understanding of medical information through effective communication can enhance patient satisfaction and outcomes.31 32 In particular, audiovisual materials have been suggested to increase the effectiveness of preprocedural communication with patients with severe illness.33
In medical communication, specific information needs can vary individually among patients.32–35 Thus, it is important for healthcare providers to assess patients’ needs before providing medical information in patient-centred communication.34–36 Therefore, in our newly designed OSCAR framework, the process of communication is emphasised.
This prospective study was limited to a single site with relatively small sample size to generalise. Moreover, this study was limited by the lack of evaluation of the degree of the transfer of medical clerks’ acquired skill to clinical practice by direct work-place assessments of patient satisfaction. In order to avoid ‘self-fulfilling prophecy’ or bias caused, the effectiveness of the intervention should be addressed on patients’ level such as whether patients less anxious after the preprocedural information brought by the trainee. So, the methodological limitations of the study are that the competency of medical clerks’ skills in giving preprocedural communication was observed directly by physicians in class rather than in clinical ward. To monitor the transfer of medical students’ acquired skills to primary care, workplace assessments and surveys of patients’ satisfaction are necessary in the future. Alternatively, the effects on patient level can be evaluated by qualitative assessment by teachers whose are blinded for the intervention rather than students’ self-assessment in our study.
Conclusions
Overall, this study reported the acceptability of additional training of medical clerks for using a preprocedural communication framework and material in primary care. The OSCAR framework-based intervention module, which emphasises the use of audiovisual materials, is well accepted by medical clerks. The follow-up email was sent to medical students, and the intervention group’ medical clerks reported that they continuously applied the acquired preprocedural communication skills and framework in clinical practice. Overall, the trainees reported that their primary care patients were satisfied with their preprocedural communication skills.
Supplementary Material
Acknowledgments
The authors express their gratitude to all trainees and faculties for their input for this article.
Footnotes
Contributors: All authors actively participated in analysis of the research results. Y-YY, D-HC, C-TC and T-HL were responsible for study design. Y-YY, D-HC, T-YW, C-CH and T-HL participated in the design and data analysis of questionnaires. Y-YY, D-HC, C-TC, T-YW, T-HL, S-SH, S-YK, M-CH, WH-H participated in the creation and management of the database. Y-YY, S-YK, C-HC, M-CH and WH-H were responsible for the statistical analysis and writing of the manuscript. Y-YY and D-HC are guarantor of this article.
Funding: This work was supported by the Taipei Veteran General Hospital, Grant. 110EA-007, 111EA-009, V111C-018, by the Ministry of Education with grant No. PMN1100719, by the Ministry of Science and Technology with the grant No. MOST 109-2314-B-010-032-MY3 and grant No. MOST-110-2511-H-A49A-504 -MY3.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement
All data relevant to the study are included in the article or uploaded as online supplemental information.
Ethics statements
Patient consent for publication
Consent obtained directly from patient(s)
Ethics approval
Ethical approval (IRB No. 2018-07-030AC and 2019-12-007ACF) was granted by the ethics committee of the Taipei Veteran General Hospital. All participants were informed about the importance and advantage of this intervention for their competencies and informed consent was obtained from all participants and data were collected. The study complied with the Declaration of Helsinki.
References
- 1.Schöpf AC, Vach W, Jakob M, et al. Routine patient surveys: patients' preferences and information gained by healthcare providers. PLoS One 2019;14:e0220495. 10.1371/journal.pone.0220495 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lim L, Chow P, Wong C-Y, et al. Doctor-Patient communication, knowledge, and question prompt Lists in reducing preoperative anxiety: a randomized control study. Asian J Surg 2011;34:175–80. 10.1016/j.asjsur.2011.11.002 [DOI] [PubMed] [Google Scholar]
- 3.Goldberger JJ, Kruse J, Kadish AH, et al. Effect of informed consent format on patient anxiety, knowledge, and satisfaction. Am Heart J 2011;162:780–5. 10.1016/j.ahj.2011.07.006 [DOI] [PubMed] [Google Scholar]
- 4.Kim B-H, Kang H-Y, Choi E-Y. Effects of handholding and providing information on anxiety in patients undergoing percutaneous vertebroplasty. J Clin Nurs 2015;24:3459–68. 10.1111/jocn.12928 [DOI] [PubMed] [Google Scholar]
- 5.Mendoza BA, Fortier MA, Trinh LN, et al. Factors impacting parental and child satisfaction in the perioperative setting. Paediatr Anaesth 2021;31:932–43. 10.1111/pan.14236 [DOI] [PubMed] [Google Scholar]
- 6.Roter DL, Hall JA, Kern DE, et al. Improving physicians' interviewing skills and reducing patients' emotional distress. A randomized clinical trial. Arch Intern Med 1995;155:1877–84. [PubMed] [Google Scholar]
- 7.Swing SR. The ACGME outcome project: retrospective and prospective. Med Teach 2007;29:648–54. 10.1080/01421590701392903 [DOI] [PubMed] [Google Scholar]
- 8.Hawkins RE, Lipner RS, Ham HP, et al. American Board of medical specialties maintenance of certification: theory and evidence regarding the current framework. J Contin Educ Health Prof 2013;33 Suppl 1:S7–19. 10.1002/chp.21201 [DOI] [PubMed] [Google Scholar]
- 9.Seale J, Ragbourne SC, Purkiss Bejarano N, et al. Training final year medical students in telephone communication and prioritization skills: an evaluation in the simulated environment. Med Teach 2019;41:1023–8. 10.1080/0142159X.2019.1610559 [DOI] [PubMed] [Google Scholar]
- 10.Lörwald AC, Lahner F-M, Nouns ZM, et al. The educational impact of Mini-Clinical evaluation exercise (Mini-CEX) and direct observation of procedural skills (DOPS) and its association with implementation: a systematic review and meta-analysis. PLoS One 2018;13:e0198009. 10.1371/journal.pone.0198009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lörwald AC, Lahner F-M, Mooser B, et al. Influences on the implementation of Mini-CEX and DOPS for postgraduate medical trainees' learning: a grounded theory study. Med Teach 2019;41:448–56. 10.1080/0142159X.2018.1497784 [DOI] [PubMed] [Google Scholar]
- 12.Haidet P, Dains JE, Paterniti DA, et al. Medical student attitudes toward the doctor-patient relationship. Med Educ 2002;36:568–74. 10.1046/j.1365-2923.2002.01233.x [DOI] [PubMed] [Google Scholar]
- 13.Cinar O, Ak M, Sutcigil L, et al. Communication skills training for emergency medicine residents. Eur J Emerg Med 2012;19:9–13. 10.1097/MEJ.0b013e328346d56d [DOI] [PubMed] [Google Scholar]
- 14.Skillings JL, Porcerelli JH, Markova T. Contextualizing SEGUE: evaluating residents' communication skills within the framework of a structured medical interview. J Grad Med Educ 2010;2:102–7. 10.4300/JGME-D-09-00030.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Accreditation Council for Graduate Medical Education (ACGME) and American Board of Medical Specialties . Toolbox of assessment methods, version 1.1, 2000. Available: http://www.acgme.org/Outcome/assess/ToolTable.pdf [Accessed 08 Jul 2009].
- 16.Epp DA, Kubota T, Yoshida M, et al. Promoting patient care through communication training in a pre-clerkship pharmacy education course in Japan. Am J Pharm Educ 2019;83:6745. 10.5688/ajpe6745 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Vijn TW, Fluit CRMG, Kremer JAM, et al. Involving medical students in providing patient education for real patients: a scoping review. J Gen Intern Med 2017;32:1031–43. 10.1007/s11606-017-4065-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Wilson NA, Reich AJ, Graham J, et al. Patient perspectives on the need for implanted device information: implications for a post-procedural communication framework. Health Expect 2021;24:1391–402. 10.1111/hex.13273 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Herrera-Espiñeira C, Rodríguez del Aguila MdelM, Rodríguez del Castillo M, et al. Relationship between anxiety level of patients and their satisfaction with different aspects of healthcare. Health Policy 2009;89:37–45. 10.1016/j.healthpol.2008.04.012 [DOI] [PubMed] [Google Scholar]
- 20.Snyder-Ramos SA, Seintsch H, Böttiger BW, et al. Patient satisfaction and information gain after the preanesthetic visit: a comparison of face-to-face interview, brochure, and video. Anesth Analg 2005;100:1753–8. 10.1213/01.ANE.0000153010.49776.E5 [DOI] [PubMed] [Google Scholar]
- 21.Salzwedel C, Petersen C, Blanc I, et al. The effect of detailed, video-assisted anesthesia risk education on patient anxiety and the duration of the preanesthetic interview: a randomized controlled trial. Anesth Analg 2008;106:202–9. 10.1213/01.ane.0000287665.96156.72 [DOI] [PubMed] [Google Scholar]
- 22.Girvan C, Conneely C, Tangney B. Extending experiential learning in teacher professional development. Teach Teach Educ 2016;58:129–39. 10.1016/j.tate.2016.04.009 [DOI] [Google Scholar]
- 23.Villamizar AG, Mejía G. Fostering learner autonomy and critical reflection through digital video-journals in a university foreign language course. Reflective Practice 2019;20:187–200. 10.1080/14623943.2019.1575195 [DOI] [Google Scholar]
- 24.Geoffroy PA, Delyon J, Strullu M, et al. Standardized patients or conventional Lecture for teaching communication skills to undergraduate medical students: a randomized controlled study. Psychiatry Investig 2020;17:299–305. 10.30773/pi.2019.0258 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Kaufman DM, Laidlaw TA, Langille D, et al. Differences in medical students' attitudes and self-efficacy regarding patient-doctor communication. Acad Med 2001;76:188. 10.1097/00001888-200102000-00022 [DOI] [PubMed] [Google Scholar]
- 26.Papinczak T, Young L, Groves M, et al. An analysis of peer, self, and tutor assessment in problem-based learning tutorials. Med Teach 2007;29:e122–32. 10.1080/01421590701294323 [DOI] [PubMed] [Google Scholar]
- 27.Eva KW, Regehr G. Self-Assessment in the health professions: a reformulation and research agenda. Acad Med 2005;80:S46–54. 10.1097/00001888-200510001-00015 [DOI] [PubMed] [Google Scholar]
- 28.Milles LS, Hitzblech T, Drees S, et al. Student engagement in medical education: a mixed-method study on medical students as module co-directors in curriculum development. Med Teach 2019;41:1143–50. 10.1080/0142159X.2019.1623385 [DOI] [PubMed] [Google Scholar]
- 29.Mort JR, Hansen DJ. First-year Pharmacy Students’ Self-Assessment of Communication Skills and the Impact of Video Review. Am J Pharm Educ 2010;74:78. 10.5688/aj740578 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Papinczak T, Young L, Groves M, et al. An analysis of peer, self, and tutor assessment in problem-based learning tutorials. Med Teach 2007;29:e122–32. 10.1080/01421590701294323 [DOI] [PubMed] [Google Scholar]
- 31.Timmins F. Exploring the concept of 'information need'. Int J Nurs Pract 2006;12:375–81. 10.1111/j.1440-172X.2006.00597.x [DOI] [PubMed] [Google Scholar]
- 32.Behar-Horenstein LS, Guin P, Gamble K, et al. Improving patient care through patient-family education programs. Hosp Top 2005;83:21–7. 10.3200/HTPS.83.1.21-27 [DOI] [PubMed] [Google Scholar]
- 33.Carey M, Schofield P, Jefford M, et al. The development of audio-visual materials to prepare patients for medical procedures: an oncology application. Eur J Cancer Care 2007;16:417–23. 10.1111/j.1365-2354.2006.00772.x [DOI] [PubMed] [Google Scholar]
- 34.Johnson M, Tod AM, Brummell S, et al. Prognostic communication in cancer: a critical interpretive synthesis of the literature. Eur J Oncol Nurs 2015;19:554–67. 10.1016/j.ejon.2015.03.001 [DOI] [PubMed] [Google Scholar]
- 35.King A, Hoppe RB. "Best practice" for patient-centered communication: a narrative review. J Grad Med Educ 2013;5:385–93. 10.4300/JGME-D-13-00072.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Madula P, Kalembo FW, Yu H, et al. Healthcare provider-patient communication: a qualitative study of women's perceptions during childbirth. Reprod Health 2018;15:135. 10.1186/s12978-018-0580-x [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data relevant to the study are included in the article or uploaded as online supplemental information.






