Skip to main content
MedEdPublish logoLink to MedEdPublish
. 2025 May 21;13:310. Originally published 2023 Dec 29. [Version 2] doi: 10.12688/mep.19767.2

Using the Power of Narratives in E-Learning for COVID-19 Vaccine Hesitancy Conversations: A Mixed Methods Study in Medical Education

Aayushi Gupta 1,a, Anita Berlin 1, Graham Easton 1
PMCID: PMC12166355  PMID: 40519660

Version Changes

Revised. Amendments from Version 1

In Version 2 the abstract includes more detailed themes in results section, and the conclusion is more focused on online learning. The introduction now has a brief passage with a more critical review of narrative learning in healthcare education. The results section includes a reflection on the demographics and ethnicity of the participants and more detail about students' previous experience of Covid vaccine hesitancy conversations and administration of vaccines. The limitations section now includes more details about the small sample size and potential bias of the focus group facilitator and how we tried to mitigate this in the focus groups and subsequent analysis of data. The discussion now has a passage summarising how narratives have been used previously in healthcare education and relevant research findings, and touches on ideas for future studies - in particular higher level Kirkpatrick outcomes including patient perspectives and any lasting effects on students' communication skills. We have also suggested a new title to more accurately reflect the paper's message and scope: "Using the Power of Narratives in E-Learning for COVID-19 Vaccine Hesitancy Conversations: A Mixed Methods Study in Medical Education"

Abstract

Background

During the COVID-19 pandemic, we developed an e-learning resource to support medical students in having effective conversations with COVID vaccine hesitant patients (an urgent challenge). Development of information and communication skills elements was underpinned by narrative learning theory; learners interact with three fictional characters whose stories run through the resource in activities and role-plays. We co-developed the resource and characters with students, colleagues and local community.

Methods

We used a mixed methods approach to evaluate the resource, including a survey of pre- and post- module self-confidence scores, and by thematic analysis of a focus group with seven final year medical students to explore their perceptions of how the story elements influenced their learning.

Results

All students surveyed reported an improvement in their confidence in having effective conversations with vaccine-hesitant patients. The focus group analysis suggests that character-based narratives can promote learning online, particularly through engagement and accessibility, relatability of characters and their stories, improved memory, and emotional connection.

Conclusions

This study suggests that character-driven stories have potential value in online learning about vaccine hesitancy conversations. Further research is needed to establish the nature of their impact on different aspects of learning including the duration of effect on students' communication skills and any patient-related outcomes.

Keywords: narrative, e-learning, vaccine hesitancy, motivational interviewing, medical students

Introduction

Vaccine hesitancy is a well-established public health challenge ( MacDonald et al., 2015; World Health Organisation, 2019), defined by the World Health Organisation as a “delay in acceptance, or refusal, of safe vaccines despite availability of vaccine services” ( MacDonald et al., 2015). Attitudes to vaccination can be viewed as a continuum, from those who accept all vaccines to those who actively oppose all vaccines (see Figure 1).

Figure 1. Continuum demonstrating attitudes towards vaccination.

Figure 1.

The central portion represents those who are deemed vaccine hesitant. Adapted from ( Butler, 2017).

Causes of vaccine hesitancy are complex and context-specific, and it is thought to be influenced by issues such as perception of risk, low confidence in the vaccine, access barriers, inconvenience, and lack of endorsement from trusted providers and community leaders ( Scientific Advisory Group for Emergencies, 2021). COVID-19 vaccine hesitancy remains prevalent in our local East London community and is disproportionately high in ethnic minorities and religious groups living in East London ( UK Health Security Agency, 2022).

Development of an e-learning module

To address this problem, we designed an e-learning module to support healthcare professionals and medical students in having effective conversations about vaccine hesitancy – an urgent and ongoing challenge during the pandemic ( Razai et al., 2021b). Many of our medical students were having these conversations with patients on their clinical placements yet had had no specific training. We designed the module with three main principles in mind:

  • (1)

    Online delivery, allowing students to complete it asynchronously from anywhere in the world, in a self-directed fashion, providing flexibility, accessibility and comfort ( Mukhtar et al., 2020). With the shift to online teaching through the pandemic, it was particularly important for this to be an online resource.

  • (2)

    Motivational interviewing (MI) as the underlying counselling approach. MI is a recognized technique used in behavior change, and has a strong evidence base ( Gagneur, 2020; Lundahl et al., 2013; Rollnick et al., 2005; Rollnick et al., 2010). MI promotes a “guiding” approach in vaccine hesitancy consultations, which is likely to have more meaningful outcomes than a didactic, “telling” approach ( Easton, 2021; Lewandowsky et al., 2021; Razai et al., 2021a). In MI, the goal of the healthcare professional is not to persuade or coerce patients, but to ensure they have reliable, relevant information and to support them to make their own decision ( Lehner et al., 2021).

  • (3)

    Development of learning materials was underpinned by narrative learning theory: “Fostering learning through stories” ( Clark & Rossiter, 2008). Three characters’ stories would run through the resource in activities and role-plays. The literature suggests that narratives are a potentially powerful education tool that can be useful in promoting memory, engaging learners through emotions, and providing relevant context to learning ( Easton, 2016). Despite the theoretical promise, there is limited evidence for the benefits of narrative learning approaches on long-term learning outcomes, clinical behaviour or patient outcomes. For example, a systematic review of digital storytelling (which combines traditional storytelling with digital tools) showed minimal impact of patient stories alone on health professionals learning ( Moreau et al., 2018). Developing models for narrative medicine education and integrating and evaluating diverse storytelling formats, such as the digital storytelling approach we developed in this project, could further enhance student learning experiences

Previous work has explored reasons behind vaccine hesitancy and identified groups within society with higher rates ( Aw et al., 2021; Osama & Majeed, 2021; Robertson et al., 2021; Sallam, 2021; Troiano & Nardi, 2021). Health communication around vaccines is often more accessible if it is tailored to these different population groups ( British Islamic Medical Association, 2021). We wanted to reach groups within our community who have higher rates of vaccine hesitancy, including minoritised ethnic groups. We collated a range of resources for the e-learning module, as a collaboration with library information specialists, clinical academics, and the local community and council, in order to prepare current and future healthcare professionals to have productive conversations about vaccine hesitancy and explore common patient concerns.

To portray our characters in the e-learning module, we used a “thick narrative approach” (thorough case description and media-rich resources) that has been shown to increase teaching efficiency within online medical education ( Bizzocchi & Schell, 2009). Genuine stories tend to be more influential, so we wanted to provide this by giving each character an emotional dimension and a story ( Bowmaker, 2022). Narratives provide students with a holistic view of their patients, especially with the use of first person. It has also been shown that narratives can increase student enthusiasm and, in doing so, learning and engagement ( Lindgren & Mcdaniel, 2012).

Evaluation aims and research questions

For this evaluation, we were particularly interested in understanding more about the novel narrative elements of our e-learning module. Our aim was to find out how students experienced the narrative elements of the resource and how it influenced their learning and confidence in having vaccine hesitancy conversations with patients. Our research questions were:

  • To what extent and in what ways did the character-driven narratives influence learning of medical students who used the resource?

  • What effect, if any, did the resource have on medical students’ self-confidence rating in relation to having conversations with COVID-19 vaccine hesitant patients?

Methods

The e-learning module design

The e-learning module was designed to take 60–90 minutes to complete. The material was hosted on the university’s online virtual learning platform, allowing asynchronous completion of the module. For this study, our main learner group was medical students (although other health professionals and community workers later made use of the module). The resource was developed by GE and AG and received input from public health staff at one of our local borough councils, Tower Hamlets. The overview of the resource is outlined in Figure 2. Each section had learning objectives and ended with a summary. Interactive quizzes featured throughout the resource.

Figure 2. The seven sections of the online resource on vaccine hesitancy.

Figure 2.

We developed the module using several different types of media including Storyboard That, H5P, Microsoft PowerPoint (Version 16.46), and video. The module introduced users to the stories of three characters early on (see Figure 3). These characters were revisited throughout the materials allowing students to explore each character’s story arc via interactive storyboards and through roleplay. Characters were portrayed as cartoons to make the resource media-rich, aiming to increase engagement. Each character’s scenario was chosen to reflect the concerns and demographics of the local community. Alongside our own clinical experiences, the characters were co-developed with a local primary care doctor to make them as realistic as possible.

Figure 3. The three characters that students followed throughout this resource, with their introductory statements.

Figure 3.

Created with Storyboard That.

Additionally, one of three characters, Tanya, was portrayed by an actor in two video roleplays included within the resource. These portrayed an “effective” and “not-so-effective” patient consultation discussing vaccine hesitancy to demonstrate the impact of motivational interviewing. This video was interactive, pausing and asking students to answer questions on the roleplay as the consultation progressed. At the end of the video, the actor gave feedback on each consultation; what worked well and what the doctor could do to make the conversation more effective.

Evaluation methods

We chose a mixed qualitative and quantitative approach to answer the research questions as we wanted to explore: (a) student perceptions and engagement with the characters’ stories, and (b) the impact of the module on self-reported confidence in conversations with vaccine hesitant patients. The qualitative approach used focus group interviews. The guiding theory for our evaluation was the same as for the resource design – narrative learning theory. Narrative learning theory is an attempt to explain how narratives might promote learning. The central proposal for narrative learning theory rests on our strong impulse to make meaning from our experience by creating stories or narratives ( Hopkins, 1994). Learners connect new knowledge with lived experience and weave it into existing narratives of meaning ( Rossiter, 2002). Narrative learning theories therefore fall under the broader umbrella of constructivist learning theory, in which learning is seen as construction of meaning from experience ( Dewey, 1926).

We adopted three methods of evaluation, with the same group of seven students who had completed the pilot module:

  • (1)

    Focus group of seven students

  • (2)

    Pre- and post-module self-confidence scoring

  • (3)

    General feedback (optional) as part of the module

Sampling

Purposive sampling was used to recruit final year medical students before making the module available to all students. This cohort had completed their final examinations so had time for the study, and their involvement in the module would not give them any advantage over fellow students. They were also more likely to be in a position where they would be having vaccine hesitancy conversations. We aimed to recruit between seven and 10 students as recommended for an effective focus group discussion ( Kuper et al., 2008).

Recruitment

To recruit students, an email was sent to all MBBS final year students at Queen Mary University of London via the President of the Students’ Association. Students replied to express interest on a first come first served basis. Inclusion criteria were being a final year medical student; completion of the consent form; completion of the module; ability to attend the focus group. To incentivize participation, completion of the module, confidence assessment and focus group allowed students to apply for an award which formally recognizes student participation in co-development of educational resources. Seven final year students were recruited from the medical school.

Data collection

The data collection period was from 14/6/21 – 28/6/21.

Virtual focus group. We gathered data through a virtual focus group after the medical students had completed the online module independently. The focus group was held online via Microsoft Teams to maintain social distancing. AG facilitated the focus group. The group ran following standard focus group methodology ( Kuper et al., 2008), establishing an informal and conversational environment and encouraging participation from quieter members of the group. It was recorded and audio was later transcribed by AG. AG took notes during the discussions of recurring ideas and concepts. The focus group ran for one hour. AG asked open questions based on an interview topic guide ( Gupta et al., 2023e), derived from the theory underpinning the work, specifically regarding the use of stories and the impact of the characters. A transcript ( Gupta et al., 2023b) was created from this audio recording to be analyzed.

Confidence rating scores. Students were also asked to submit self-confidence scores (Likert scales out of 10) ( Gupta et al., 2023a; Gupta et al., 2023c; Gupta et al., 2023d), pre- and post-module completion via an electronic survey. Students were asked “How confident do you feel about having effective conversations with vaccine hesitant patients, on a scale of 0-10 where 0 is not at all confident, and 10 is totally confident?”.

Free-text feedback. Additionally, an optional free-text feedback form featured at the end of the module. This consisted of a single rating question using a Likert scale (“ Overall module rating, out of 10”) then two free-text questions: (1) “What did you really like about the module? Any specific sections or approaches?”, (2) “What could we do differently to make it better?”.

Analysis

The data analysis period was from 1/8/21 – 31/8/21.

Thematic analysis of the transcript was undertaken alongside review of the notes made during the focus group following steps outlined in previous work ( Braun & Clarke, 2012). AG read the data line-by-line to manually code topics throughout the text and identify patterns of meaning. AG and GE independently reviewed and reflected on all the initial codes and quotes to group these into emerging themes. After further discussion, merging and rearrangement AG and GE identified six coherent themes relating to the module’s accessibility, the use of characters/stories, and their pedagogic value that we describe in the results below. Both authors agreed on the final themes that emerged from analysis.

Ethics

Ethical approval was granted by Queen Mary Ethics of Research Committee (reference number QMERC20.400, approval date: 04.06.2021). Students were given a Participant Information Sheet beforehand and signed a written consent form if agreeable. Students were given the opportunity to re-review the details of the consent form and ask any outstanding questions prior to the focus group discussion starting. Ground rules were established: reassurance was given that AG played no direct role in student assessment; students were requested to keep the details of the focus group discussion confidential; cameras were encouraged to be turned on to facilitate more authentic discussions; any individual affected by triggering topics would be directed to student support services. Students were allocated a participant number beforehand, which AG and students used to refer to one another rather than student names. This enabled the audio to be recorded with consent and suitably pseudo-anonymized for storage, with a view to destroy data once this project is complete. To ensure participation in this study did not compete with students’ personal study time or scheduled teaching, the focus group did not run during formal teaching time and was only offered to those students who had completed examinations.

Results

Results were collected in the form of: (1) analysis of focus group transcript for key themes; (2) pre- and post-module self-confidence scores; (3) optional anonymized feedback from students. Of the final year students who received the study recruitment email, around 2% replied to express interest. All students were eligible and participated in the study. Of the seven students, two identified as male (29%) and five as female (71%). Whilst we did not formally collect demographic data on ethnicity, overall we felt the make-up of the focus group broadly reflected the diversity of the medical student body.

In the pre-course survey about students’ confidence and experience of having vaccine hesitancy conversations, three reported no experience at all, two reported very little experience, two reported some experience, and one reported quite a lot of experience. Some students in the focus group said they had vaccinated more than 100 patients. In terms of self-reported confidence having these conversations, on a scale of 0–10 where 0 is not at all confident, and 10 is totally confident, two students scored 2, three scored 3, one scored 4, one scored 5, one scored 6 and one scored 8.

Key themes from focus group analysis

Engagement and accessibility. The characters in the module engaged learners, made learning accessible as chunks of text felt less intimidating, and held students’ attention. Re-visiting the characters throughout the resource grounded the module. Students appreciated that the characters were a core stem that information kept referring to, with reports that learning is much easier with real patients to contextualize the information, which echoes the literature ( Perper, 2019). The stories gave context and invited the audience to engage and co-create through their imaginations.

  • Student 1: Learning is much easier with real patients to hang knowledge off... [rather than being told] people generally may not want the vaccine.

Relatability of characters and their stories helped learning. Evaluation shows students drew parallels between real-life conversations and the characters they met in this resource. Most junior doctors and medical students will be having these conversations and this resource and the characters’ stories helped to frame these conversations. In fact, some students in the focus group had vaccinated over 100 patients at the time therefore recognized the vaccine hesitancy concerns in this module. Others simply sympathized with the concerns because of conversations with family and friends. The characters were familiar, relatable, and authentic, particularly the hesitant healthcare worker.

  • Student 5: I liked having the characters. If you meet a patient with a condition, it really sticks in your head a lot more than just book learning about the condition. It kind of brings it to life.

  • Student 4: You can definitely draw parallels from people I have met in real life.

One student highlighted the value of the video consultation, where one of the cartoon characters was brought to life by a “real” actor:

  • Student 6: Cartoons didn’t really bother me until we got to the videos with the actor playing Tanya, I think that would be hard with cartoons alone. I don’t think the cartoons were a drawback, the videos and cartoons added to each other, but I related a lot more when I saw the interaction between real people play out.

Emotional connections. By understanding each character’s background, students were able to develop empathy for these characters and the challenges facing them. Interestingly, students reported Tanya generated the strongest emotional response, perhaps as she was portrayed “in real life conversation” by an actor in the video consultations. Students suggested that the video brought this character to life: hearing the emotions in her voice, and non-verbal factors such as her facial expressions, made Tanya more relatable than the characters purely portrayed via text and cartoons. Students did report that the cartoon depiction increased relatability versus having no visual representation. We discussed the possibility of using photographs of real people instead of cartoons; even if not all characters had a video, perhaps even a photograph may aid learning.

  • Student 3: I really liked the videos because when you hear Tanya speaking, you can hear all the emotion in her voice, and you can hear the concern. You can see her facial expressions. You can see there is a lot of worry and anxiety in what she is saying. It’s the sort of thing you can’t really get from reading text, because you’d read it in your own voice and in your own way, but when it’s happening like this then it’s more unique and distinct which helps you remember it a lot more.

  • Student 2: Seeing the non-verbal and observing the interaction between two individuals, and placing yourself in that position, is what makes the video so much more relatable. If you were to make a cartoon video, unless it was high quality, you wouldn’t get the emotion and non-verbal in the same way that you do when it’s an actual person who is an actress, and a really good actress at that.

Memory boost. Students felt stories helped them remember each character, activating memories of previous consultations and providing a framework to build knowledge on. The degree of this memorability was variable depending on the media used: videos seemed to be more effective than pictures, which were more memorable than no pictorial depiction. The power of the story arc also increased memory through enhanced engagement (see Figure 4) ( Perper, 2019). Characters featured throughout: in the introduction (where students rate each character on a vaccine hesitancy scale) and later in roleplays and the e-learning conclusion. Revisiting each story line in a temporally spaced manner allowed consolidation of learning. Finally, providing an outcome for each character was important because it gave closure to the students who had invested time and emotion into each narrative, allowing them to appreciate the outcome of an effective MI consultation.

Figure 4. A story arc can facilitate scientific flow, starting with information to pique and maintain interest, then a climax, followed by a satisfying ending.

Figure 4.

Adapted ( Perper, 2019).

  • Student 2: Definitely once I saw Tanya in the video, I remembered her case a lot more clearly and I felt like I could relate a lot more to what she was saying. and even now, thinking back to the other two cases, I can’t remember as much their reasons as I do Tanya’s.

More stories, more learning? Another consideration was the number of characters included within the resource. When designing the resource, we wanted to demonstrate the diversity within vaccine hesitant groups without producing too many characters, which risked overwhelming students who might lose any empathic connections. During the focus group, there was mixed feedback. Generally, students felt that for the length of the resource, there was an appropriate number of characters but perhaps there could be a few extra optional case studies after completion of the module.

  • Student 2: Obviously it’s a balance between a module that takes too long to complete where people start just clicking through because they’re frustrated that it’s taking so long but we probably could have benefitted from 1–2 more characters with the same level of detail and perhaps some additional optional characters at the end with a different view or perhaps a different outcome and how you could approach these.

  • Student 6: I thought 3 was a good number to avoid information overload but I like the suggestion of optional extra characters.

What if no story… Students reported that without the stories utilized in this resource, they would have struggled to maintain focus whilst completing the module. Moreover, an interest in the ending of each story motivated students to want to complete the resource, giving a sense of resolution. Finally, it would have been more difficult to recall learned information without the characters to contextualize the information.

  • Student 7: I was definitely invested in the stories, from the introduction all the way to the conclusion. It’s good to have an ending because it gave closure.”

  • Student 6: “I did find them [the characters] really helpful.

Pre- and post-module self-confidence scores

Students were asked “How confident do you feel about having effective conversations with vaccine hesitant patients? On a scale of 0–10 where 0 is not at all confident, and 10 is totally confident?” (see Figure 5). Student 5 did not submit a post-module score. Given that seven students participated, possibly a student accidentally submitted a pre-module score twice, most likely students 5 and 6 represent the same student.

Figure 5. Pre- and post-module self-confidence scores (out of 10).

Figure 5.

These scores were submitted online as part of the module.

These results demonstrate a mean improvement of +3 points on the scale. All students reported an improvement in their confidence, ranging from +1 point (n=1) to +5 (n=2). Table 1 demonstrates how previous experience in speaking to vaccine hesitant patients affects improvement in confidence. Students were asked “How much experience would you say you have in talking with vaccine hesitant patients?”. This table demonstrates there was greater self-perceived improvement in those with no or very little experience.

Table 1. Average change in confidence pre- and post-module, out of 10, stratified by self-reported experience in having conversations about vaccine hesitancy.

Experience Average improvement
in self-confidence
No experience at all +4
Very little experience +5
Some experience +3
Quite a lot of experience +1

Optional anonymized feedback

Of the seven students who finished the module, four of them (57%) completed the optional online feedback, comprising of three questions. Firstly, “How would you rate the module overall, out of 10 [where 10 is outstanding and 1 is very poor]?” (see Figure 6). Responses to questions two and three are tabulated below (see Table 2). These comments show that Tanya was particularly memorable, as she is the only named character in the feedback. Feedback on potential improvement in module interface and navigation was also collected, but further discussion is beyond the scope of this paper.

Figure 6. Student feedback on overall module rating (out of 10).

Figure 6.

These scores were submitted anonymously through an online survey.

Table 2. Student responses to optional questions, submitted anonymously online.

What did you really like about the module?
Any specific sections or approaches?
What could we do differently to make
it better?
Good variety of resources, helpful ways to address vaccination myths,
interesting to read about vaccine hesitancy in certain community
groups and why that might be.
The interface could be more user friendly, maybe more interactive
with quizzes etc
I liked that the module gives you very practical advice for
approaching these conversations and also highlights specific
knowledge that can be used in conversation with patients. The
opportunity for roleplay is very useful
Overall, I feel it was a great module. A huge variety of content. Very
engaging, lots of think about.
I liked the use of external articles and resources. I liked the examples
of good/bad techniques. I appreciate the option to complete a
number of sections and come back to the course.
Make sure the roleplay section can be utilized fully – I could not do it
as I had no one to practice with and thinking about responses is not
as helpful
Really comprehensive, really enjoyed the two videos with Tanya – the
first video is shockingly what I see on placement and can agree is not
a very effective method at all for discussing concerns with patients!
These videos were helpful for me.
I would always advocate for in person teaching over online. I realized
part way through that I was clicking through the tasks but missing a
lot of the written information available on the first page, so I had to
go back through

Limitations

There are some limitations of this study. Whilst qualitative studies do not necessarily need large sample sizes to allow collection of in-depth insights, perhaps having two focus groups would have demonstrated a broader range of views. As we used a convenience sample (the challenges of conducting the study in lockdown during the Covid pandemic and limited availability of medical students, meant we only used a single focus group), we cannot be sure how closely our focus group students represent the wider student population, and we should consider volunteer bias ( Heckman, 1990). Data shows volunteers in medical education tend to be higher achievers within their cohort, with women and ethnic minority groups being less likely to participate ( Callahan et al., 2007). This affects how translatable the results from this study might be to the entire student cohort. Low levels of interest in study participation are likely multi-factorial, including email and survey fatigue, and reluctance to engage once finals examinations were complete.

Focus groups have well established limitations, whether that is the dominating individual or the potential for conflict between group members ( Smithson, 2000). Participants may not feel free to express their views, depending on their personality type, and certain sensitive topics are automatically harder to discuss in a group setting, particularly virtually.

It could be argued that the facilitator for the focus group should have been an impartial individual, as students were aware that AG helped to develop the resource. Guidance recommends that the facilitator should maintain neutrality to avoid bias in participants responses ( ACET Inc, 2011). Although we took care to encourage negative feedback, and students did not seem hesitant to offer these, it is possible students did not contribute all their negative opinions so as not to offend AG. Similarly, there is a risk of moderator bias from accidental leading. However, in mitigation, AG was only minimally involved in developing the actual resource [GE oversaw most of this], we set clear ground rules about encouraging honesty, clarity that AG would not be involved in any of their formal course assessments, and we ensured another author [GE] also independently analysed the data.

Discussion

This work highlights the potential power of narratives in medical education, specifically when used in online asynchronous modules. The results suggest that narratives can promote learning online, particularly through improved memory, relatability, and emotional connection. Our themes echo existing literature on the use of narratives in medical education ( Charon, 2006; Greenhalgh, 2001; Hunter, 1993).

Stories are used in various ways in medical education; for example, during ward rounds and clinical case discussions to illustrate diagnostic reasoning and decision-making ( Hunter, 1991), or in narrative medicine courses and medical humanities programmes which often use patient stories to foster empathy and reflection ( Milota et al., 2019). Digital storytelling (which combines traditional storytelling with digital tools) is increasingly used to promote patient-centred care with patient narratives offering insights into lived experiences ( Moreau et al., 2018).

There is some limited evidence demonstrating the impact of narrative-based approaches on learning in health professions education . For example, narrative medicine, as explored in a systematic review, has shown positive changes in students’ attitudes, perceptions, attainment of new knowledge and skills, behaviour, and improved awareness of patients’ perspectives ( Milota et al., 2019). Storytelling has been shown to prepare students for uncertainty in clinical practice ( Papanagnou et al., 2021), and can be an effective way for students to learn about medical ethics ( Paton & Kotzee, 2021). In classroom lectures, narratives can provide context, engage learners, and aid memory retention by connecting new knowledge to lived experiences ( Easton, 2016). Digital storytelling has been shown to improve medical students’ critical thinking ( Zarei et al., 2021), although a systematic review of digital storytelling showed minimal impact of patient stories alone on health professionals learning ( Moreau et al., 2018).

The use of stories in this e-learning resource seemed to help medical students by achieving its aim to help frame vaccine hesitancy conversations through motivational interviewing. By creating relatable and recognizable characters, students appreciated following a story arc throughout with a sense of satisfaction that came from reaching a resolution for each character. It was important to us to assess the impact of applied narrative learning theory in e-learning, given the shift towards virtual learning in undergraduate medical education during the pandemic ( Gill et al., 2020). Previous work has established a role for narratives in in-person synchronous teaching, aiding medical students by providing context to learning, increasing engagement, and improving memory ( Easton, 2016). Stories can easily be shared in the form of case studies or shared experiences via patient or clinician narratives. This current work suggests that stories, in the form of character-based cartoons and videos, can also be effective tools to support online learning.

The students in our study felt that the characters’ stories made them easier to relate to and engage with. Narratives and story structure may help to engage learners by offering a connection with existing knowledge and experience, and by making the unfamiliar familiar. For example, Holt and others have shown that story structure can help learners call up existing banks of knowledge and can make new information seem relevant ( Holt, 1995; Pinker, 1995).

Students also highlighted that the stories were easier to remember, a key element of the learning process. Fernald’s study of undergraduates suggested that they found stories more memorable than formal book or lecture descriptions ( Fernald, 1987). Classical stories are defined by Haven as:

  • A detailed, character-based narration of a character’s struggles to overcome obstacles and reach an important goal - ( Haven, 2007)

These classical stories might be particularly memorable because they involve the listener in the actions and intentions of believable characters. Our study seems to support this idea with students all agreeing that the characters helped them to remember previous experiences, scaffolding learning and building new learning from those prior experiences, all key facets of constructivist learning ( Dewey, 1926).

Stories engage learners by involving them and encouraging an empathic response – the details of characters and their motivations draw us into a story and urge us to take the character’s perspective ( Rossiter, 2002). Students in this study felt that the characters’ stories allowed them to engage empathically, which in turn made the stories more relatable, engaging, and memorable. It would be interesting to explore whether this promoted any greater sense of empathy for patients the students subsequently spoke with. It also raises the question that if we want to use authentic and relatable stories which promote an emotional response in learners, could we not employ real people and patients instead of cartoons or actors? Would the emotional connection be even greater in that case?

Taking this resource forwards, to increase accessibility, non-students will be able to access the page with a password, allowing wider dissemination of the materials to healthcare professionals. Similarly, providing this resource in other languages would be the next consideration. There is also a lot of scope to further develop the resource itself e.g., addressing the technical issues highlighted by students. Perhaps, further empathy and memory could be promoted by adding voice recordings of the other two characters: Sydney and Sara, who do not presently have a “real-life” depiction by an actor. It would be interesting to assess whether giving these cartoons a voice would increase emotional connection. Evidence shows students appreciate information in audio form, but when delivered exclusively this way, it is associated with poorer exam performance ( Daniel & Woody, 2010; Furnham, 2001). A compromise would be to provide both audio and written information alongside the existing visual media. The longer-term implications of using videos as a resource must also be considered. To generate and maintain empathy and relatability, the characters and their stories must be believable ( Baron et al., 2019). This requires money to pay for the production costs, including actors. Without this, the believability may be challenged. The resource is interactive, but students are presently unable to alter the path their character takes. By considering branching storylines, students may take greater ownership over their decisions. This would have to be balanced against not overcomplicating the storylines to maintain accessibility ( Pulse Learning, 2015).

The evaluation of this resource primarily took place via subjective measurements, both qualitative (focus group interviews) and quantitative (surveys) ( Goldie, 2006). In the future, more objective styles could also be considered ( Morrison, 2003). However, to answer this research question, we believe that qualitative data was most valuable. We also think it would be important in future studies to include stronger outcome measures, particularly those relating to the patient perspective and the enduring effect on medical students’ communication skills or empathy, guided by outcome measures proposed by Kirkpatrick ( Kirkpatrick et al., 1967) and others. Another important measurement would be patient-reported outcome measures (PROMs): interviewing real-life vaccine hesitant patients who have had consultations ( Kirkpatrick et al., 1967). These could be split into two groups, with clinicians split between either having completed the vaccine hesitancy resource or not. Confounding factors would have to be accounted for such as clinician experience, specialty, demographic. This would allow for fair comparison.

When developing the resource, we were aware of the risk of stereotyping. We tried to mitigate this risk by gathering feedback from local community groups and students. The students felt the characters did not stereotype groups of patients and echoed authentic patterns in the local population. The first iteration of this module received input from the Public Health Program Manager of a local health authority in Tower Hamlets. The feedback advised adding more case studies, reconsidering the language used and potentially reordering content. To avoid the risk of inadvertent racial bias and profiling by students, adding more Caucasian characters could help. A suggestion was made to use “rumors” instead of “myths” as the latter implies a judgment or dismissal of concern. Often, concerns from vaccine hesitant groups are not unfounded, for example historical racism in medicine, unknown long-term side effects of vaccination. Similarly, the term “antivaxxer” should not be used for someone who is vaccine hesitant as they lie on different places along the vaccine hesitancy continuum and misrepresenting this is unlikely to be constructive. The feedback stated the concept of “resisting the righting reflex” was crucial. In fact, the feedback requested this concept be introduced earlier in the module. The community group feedback puts words into the mouths of the characters to help bring them to life.

In conclusion, this study suggests that character-driven stories have potential value in online learning about vaccine hesitancy conversations. Further research is needed to establish the nature of their impact on different aspects of learning including patient-related outcomes and the duration of any effect on students’ communication skills.

Acknowledgements

The authors would like to acknowledge the support of the following people:

Olumide Popoola - Education and Recognition Advisor in the Queen Mary Academy at Queen Mary University of London; for help with the design of the e-learning resource information

Paula Funnell - Faculty Liaison Librarian for Medicine & Dentistryat Queen Mary University of London; for help with the design of the e-learning resource information

Dr Meera Sood - Clinical Lecturer in Community-Based Medical Education at Queen Mary University of London; for help with the design of the e-learning resource characters

The Healthy Communities section of the Public Health Division at London Borough of Tower Hamlets; for feedback on the e-learning resource

Finally, the medical students who gave their time and efforts to make this research possible.

Funding Statement

The author(s) declared that no grants were involved in supporting this work.

[version 2; peer review: 2 approved]

Data availability

Underlying data

QMRO: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Self-Confidence scores. https://doi.org/10.17636/10190002 ( Gupta et al., 2023a).

The project contains the following underlying data:

  • -

    Self-confidence scores.docx

QMRO: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Transcript anonymous. https://doi.org/10.17636/10190001 ( Gupta et al., 2023b).

The project contains the following underlying data:

  • -

    VH transcript.docx

QMRO: Pre-course confidence and experience data. https://doi.org/10.17636/10191999 ( Gupta et al., 2023c).

The project contains the following underlying data:

  • -

    Easton Pre-course confidence and experience data 2023 Accepted.csv

QMRO: Post-course confidence survey. https://doi.org/10.17636/10192000 ( Gupta et al., 2023d)

The project contains the following underlying data:

  • -

    Easton Post-course confidence survey 2023 Accepted.csv

Extended data

QMRO: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Interview Guide. https://doi.org/10.17636/10190985 ( Gupta et al., 2023e).

This project contains the following extended data:

  • -

    Easton Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Interview Guide 2023 Accepted.docx

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

References

  1. ACET Inc: The art of facilitating focus groups.2011. Reference Source
  2. Aw J, Seng JJB, Seah SSY, et al. : COVID-19 vaccine hesitancy—a scoping review of literature in high-income countries. In: Vaccines (Basel). MDPI.2021;9(8): 900. 10.3390/vaccines9080900 [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Baron K, Rocha A, Anderson P: Ann's story: an authentic learning experience for online nursing students. Creat Nurs. 2019;25(2):144–147. 10.1891/1078-4535.25.2.144 [DOI] [PubMed] [Google Scholar]
  4. Bizzocchi J, Schell R: Rich-narrative case study for online PBL in medical education. Acad Med. 2009;84(10):1412–1418. 10.1097/ACM.0b013e3181b6ead0 [DOI] [PubMed] [Google Scholar]
  5. Bowmaker K: Storytelling and behaviour change. The Social Deck.2022. Reference Source
  6. Braun V, Clarke V: Thematic analysis. In: APA Handbook of Research Methods in Psychology, Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological. American Psychological Association,2012;2:57–71. 10.1037/13620-004 [DOI] [Google Scholar]
  7. British Islamic Medical Association: COVID-19 vaccine hub – myths.2021. Reference Source
  8. Butler R: Vaccine hesitancy, acceptance, and demand. In: T. Vesikari & P. van Damme (Eds.), Pediatric Vaccines and Vaccinations. Springer International Publishing,2017;27–35. 10.1007/978-3-319-59952-6_4 [DOI] [Google Scholar]
  9. Callahan CA, Hojat M, Gonnella JS: Volunteer bias in medical education research: an empirical study of over three decades of longitudinal data. Med Educ. 2007;41(8):746–753. 10.1111/j.1365-2923.2007.02803.x [DOI] [PubMed] [Google Scholar]
  10. Charon R: The self-telling body. Narrat Inq. 2006;16(1):191–200. 10.1075/ni.16.1.24cha [DOI] [Google Scholar]
  11. Clark MC, Rossiter M: Narrative learning in adulthood. New Directions for Adult and Continuing Education.2008;2008(119):61–70. 10.1002/ace.306 [DOI] [Google Scholar]
  12. Daniel DB, Woody WD: They hear, but do not listen: retention for podcasted material in a classroom context. Teach Psychol. 2010;37(3):199–203. 10.1080/00986283.2010.488542 [DOI] [Google Scholar]
  13. Dewey J: My Pedagogic Creed. J Educ. 1926;104(21):542. 10.1177/002205742610402107 [DOI] [Google Scholar]
  14. Easton GP: How medical teachers use narratives in lectures: a qualitative study. BMC Med Educ. 2016;16: 3. 10.1186/s12909-015-0498-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Easton GP: Resisting the “righting reflex” in conversations about COVID vaccine hesitancy. BMJ. 2021;373: n1566. 10.1136/bmj.n1566 [DOI] [PubMed] [Google Scholar]
  16. Fernald LD: Of windmills and rope dancing: the instructional value of narrative structures. Teach Psychol. 1987;14(4):214–216. 10.1207/s15328023top1404_5 [DOI] [Google Scholar]
  17. Furnham A: Remembering stories as a function of the medium of presentation. Psychol Rep. 2001;89(3):483–486. 10.2466/pr0.2001.89.3.483 [DOI] [PubMed] [Google Scholar]
  18. Gagneur A: Motivational interviewing: a powerful tool to address vaccine hesitancy. Can Commun Dis Rep. 2020;46(04):93–97. 10.14745/ccdr.v46i04a06 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Gill D, Whitehead C, Wondimagegn D: Challenges to medical education at a time of physical distancing. Lancet. 2020;396(10244):77–79. 10.1016/S0140-6736(20)31368-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Goldie J: AMEE Education Guide no. 29: evaluating educational programmes. Med Teach.2006;28(3):210–224. 10.1080/01421590500271282 [DOI] [PubMed] [Google Scholar]
  21. Greenhalgh T: Storytelling should be targeted where it is known to have greatest added value. Med Educ. 2001;35(9):818–9. 10.1046/j.1365-2923.2001.01027.x [DOI] [PubMed] [Google Scholar]
  22. Gupta A, Easton G, Berlin A: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Self-Confidence scores. QMRO.[Data].2023a. 10.17636/10190002 [DOI]
  23. Gupta A, Easton G, Berlin A: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Transcript anonymous. QMRO.[Data].2023b. 10.17636/10190001 [DOI]
  24. Gupta A, Easton G, Berlin A: Pre-course confidence and experience data. QMRO.[Data].2023c. 10.17636/10191999 [DOI]
  25. Gupta A, Easton G, Berlin A: Post-course confidence survey. QMRO.[Data].2023d. 10.17636/10192000 [DOI]
  26. Gupta A, Easton G, Berlin A: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Interview Guide. QMRO.[Data].2023e. 10.17636/10190985 [DOI]
  27. Haven K: Story proof: the science behind the startling power of story. Libraries Unlimited,2007. Reference Source [Google Scholar]
  28. Heckman JJ: Selection bias and self-selection. In: Econometrics. Palgrave Macmillan UK,1990;201–224. 10.1007/978-1-349-20570-7_29 [DOI] [Google Scholar]
  29. Holt JC: How children learn. Da Capo Lifelong Books,1995. [Google Scholar]
  30. Hopkins RL: Narrative schooling. New York: Teachers College Press, 1994.1994. Reference Source [Google Scholar]
  31. Hunter KM: Doctors’ stories: the narrative structure of medical knowledge. Princeton University Press,1991. Reference Source [Google Scholar]
  32. Hunter KM: Doctors’ stories: the narrative structure of medical knowledge. Princeton University Press,1993. 10.2307/j.ctv10vm1vd [DOI] [Google Scholar]
  33. Kirkpatrick DL, Craig RL, Bittel LR: Evaluation of training. In: Training and Development Handbook. McGraw Hill,1967;87–112. Reference Source [Google Scholar]
  34. Kuper A, Lingard L, Levinson W: Critically appraising qualitative research. BMJ. 2008;337: a1035. 10.1136/bmj.a1035 [DOI] [PubMed] [Google Scholar]
  35. Lehner L, Gribi J, Hoffmann K, et al. : Beyond the “information deficit model” - understanding vaccine-hesitant attitudes of midwives in Austria: a qualitative study. BMC Public Health. 2021;21(1): 1671. 10.1186/s12889-021-11710-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Lewandowsky S, Cook J, Schmid P, et al. : The COVID-19 vaccine communication handbook. A practical guide for improving vaccine communication and fighting misinformation.2021. Reference Source
  37. Lindgren R, McDaniel R: International forum of educational technology & society transforming online learning through narrative and student agency. J Educ Techno Soc. International Forum of Educational Technology & Society,2012;15(4):344–355. Reference Source [Google Scholar]
  38. Lundahl B, Moleni T, Burke BL, et al. : Motivational interviewing in medical care settings: a systematic review and meta-analysis of randomized controlled trials. Patient Educ Couns. 2013;93(2):157–168. 10.1016/j.pec.2013.07.012 [DOI] [PubMed] [Google Scholar]
  39. MacDonald NE, Liang X, Chaudhuri M, et al. : Vaccine hesitancy: definition, scope and determinants. Vaccine. 2015;33(34):4161–4. 10.1016/j.vaccine.2015.04.036 [DOI] [PubMed] [Google Scholar]
  40. Milota MM, van Thiel GJMW, van Delden JJM: Narrative medicine as a medical education tool: a systematic review. Med Teach. 2019;41(7):802–810. 10.1080/0142159X.2019.1584274 [DOI] [PubMed] [Google Scholar]
  41. Moreau KA, Eady K, Sikora L, et al. : Digital storytelling in health professions education: a systematic review. BMC Med Educ. 2018;18(1): 208. 10.1186/s12909-018-1320-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Morrison J: Evaluation. BMJ. 2003;326(7385):385. 10.1136/bmj.326.7385.385 [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Mukhtar K, Javed K, Arooj M, et al. : Advantages, limitations and recommendations for online learning during COVID-19 pandemic era. Pak J Med Sci. 2020;36(COVID19-S4):S27–S31. 10.12669/pjms.36.COVID19-S4.2785 [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Osama T, Majeed A: How can we address COVID-19 vaccine hesitancy and improve vaccine acceptance? Thebmjopinion. 2021. Reference Source [Google Scholar]
  45. Papanagnou D, Ankam N, Ebbott D, et al. : Towards a medical school curriculum for uncertainty in clinical practice. Med Educ Online. 2021;26(1): 1972762. 10.1080/10872981.2021.1972762 [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Paton A, Kotzee B: The fundamental role of storytelling and practical wisdom in facilitating the ethics education of junior doctors. Health (London). 2021;25(4):417–433. 10.1177/1363459319889102 [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Perper EJ: The power of a scientific story: why storytelling beats the dull lecture. Science Branding Communications. 2019. [Google Scholar]
  48. Pinker S: The language instinct: the new science of language and mind. Penguin Science. 1995. Reference Source [Google Scholar]
  49. Pulse Learning: The dos and don’ts of storytelling in eLearning. Pulse Learning Insights,2015. Reference Source
  50. Razai MS, Chaudhry UAR, Doerholt K, et al. : COVID-19 vaccination hesitancy. BMJ. BMJ Publishing Group,2021a;373: n1138. 10.1136/bmj.n1138 [DOI] [PubMed] [Google Scholar]
  51. Razai MS, Osama T, McKechnie DGJ, et al. : COVID-19 vaccine hesitancy among ethnic minority groups. BMJ. 2021b;372: n513. 10.1136/bmj.n513 [DOI] [PubMed] [Google Scholar]
  52. Robertson E, Reeve KS, Niedzwiedz CL, et al. : Predictors of COVID-19 vaccine hesitancy in the UK household longitudinal study. Brain Behav Immun. 2021;94:41–50. 10.1016/j.bbi.2021.03.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Rollnick S, Butler CC, Kinnersley P, et al. : Motivational interviewing. BMJ (Clinical Research Ed). 2010;340: c1900. 10.1136/bmj.c1900 [DOI] [PubMed] [Google Scholar]
  54. Rollnick S, Butler CC, McCambridge J, et al. : Consultations about changing behaviour. BMJ. 2005;331(7522):961–963. 10.1136/bmj.331.7522.961 [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Rossiter M: Narrative and stories in adult teaching and learning. ERIC Digest. 2002;241(2). Reference Source [Google Scholar]
  56. Sallam M: COVID-19 vaccine hesitancy worldwide: a concise systematic review of vaccine acceptance rates. Vaccines (Basel). MDPI AG,2021;9(2): 160. 10.3390/vaccines9020160 [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Scientific Advisory Group for Emergencies: Factors influencing COVID-19 vaccine uptake among minority ethnic groups.2021. Reference Source
  58. Smithson J: Using and analysing focus groups: limitations and possibilities. Int J Soc Res Method. 2000;3(2):103–119. 10.1080/136455700405172 [DOI] [Google Scholar]
  59. Troiano G, Nardi A: Vaccine hesitancy in the era of COVID-19. Public Health. Elsevier B.V.2021;194:245–251. 10.1016/j.puhe.2021.02.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. UK Health Security Agency: Vaccinations in Tower Hamlets.GOV.UK Coronavirus (COVID-19) in the UK.2022. Reference Source
  61. World Health Organisation: Ten threats to global health in 2019.2019. Reference Source
  62. Zarei A, Mojtahedzadeh R, Mohammadi A, et al. : Applying digital storytelling in the medical oncology curriculum: effects on students’ achievement and critical thinking. Ann Med Surg (Lond). 2021;70: 102528. 10.1016/j.amsu.2021.102528 [DOI] [PMC free article] [PubMed] [Google Scholar]
MedEdPublish (2016). 2025 Jun 13. doi: 10.21956/mep.22555.r41879

Reviewer response for version 2

Samar Aboulsoud 1

I think this version is better than the first one and can be approved.

Have any limitations of the research been acknowledged?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Partly

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

NA

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

MedEdPublish (2016). 2025 Jan 29. doi: 10.21956/mep.21181.r40976

Reviewer response for version 1

Samar Aboulsoud 1

“Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations”:

The title of the article is informative but could be improved to better reflect the main message and scope. Including the study design and a hint at the key findings would enhance clarity and attract a broader readership. For instance, explicitly mentioning the target audience or the specific contribution to health professions education (HPE) would help contextualize the work.

The abstract provides a comprehensive summary of the study, covering the background, methods, results, and conclusions. However, it could benefit from slightly more detail regarding the specific themes identified in the focus group analysis to give readers a clearer sense of the findings.

The introduction presents a compelling rationale for addressing vaccine hesitancy, especially in the context of the COVID-19 pandemic. The authors appropriately contextualize the need for such an e-learning resource and justify their use of narrative learning theory. However, the section could be strengthened with a more critical analysis of existing literature on narrative learning in healthcare education to firmly establish the knowledge gap this study addresses.

The methods section provides a solid overview of the resource's development and evaluation process. The integration of narrative learning theory into the design is well-explained, and the involvement of students and community members in co-developing the characters adds credibility and relevance. However, more detail on the survey instrument, particularly its design and validation, would enhance reproducibility. Additionally, a larger and more diverse sample for the focus group might improve the study's generalizability and strengthen the findings.

The results are clearly presented and indicate an improvement in students’ confidence in having conversations with vaccine-hesitant patients. The thematic analysis of the focus group is well-articulated, identifying key benefits such as memory retention, relatability, and emotional connection. However, the article could further elaborate on how these outcomes align with the theoretical underpinnings of narrative learning to enhance the interpretation of findings.

The discussion appropriately links the results to existing literature, particularly regarding the benefits of narrative-driven education in healthcare. The authors provide meaningful implications for practice, emphasizing the potential of e-learning to address urgent healthcare challenges. However, the discussion would benefit from a deeper exploration of the limitations, including the small sample size and the lack of patient-related outcome data. Suggestions for future research are mentioned but could be more specific, particularly regarding the kinds of outcomes or metrics that should be prioritized in subsequent studies.

Typos:

There is missing text in the character description in Figure 3 

Strengths:

  1. Timely and Relevant Topic: The focus on COVID-19 vaccine hesitancy addresses an urgent public health challenge.

  2. Innovative Pedagogical Approach: The use of narrative learning theory and character-driven storytelling is a novel method to enhance engagement and retention.

  3. Rigorous Evaluation: Combining pre/post confidence assessments and focus group feedback provides a robust mixed-methods evaluation.

  4. Practical Application: The resource has direct clinical relevance, preparing students for real-world conversations with patients.

Suggestions for Improvement

  1. Strengthen Literature Context: Provide a more robust review of narrative learning in healthcare education to enhance the introduction.

  2. Expand Methodological Details: Include greater detail on the survey design and focus group participant selection to improve transparency and reproducibility.

  3. Discuss Limitations More Fully: Acknowledge the small sample size and the absence of patient-centered outcomes in greater depth, with suggestions for addressing these in future work.

  4. Theoretical Integration: Explicitly link findings (e.g., improved memory, relatability) to narrative learning theory to provide a stronger theoretical foundation.

  5. Future Research: Offer specific recommendations for further study, such as exploring patient perspectives or evaluating the long-term retention of communication skills.

Overall, the article makes a valuable contribution to health professions education by demonstrating the potential of narrative-based e-learning to address vaccine hesitancy conversations. It effectively bridges theory and practice, offering insights that can inform future educational strategies in similar contexts. With refinements to methodological details and a deeper engagement with theoretical and practical implications, the study could have an even greater impact.

The references are largely relevant and timely, especially those directly addressing vaccine hesitancy and narrative learning. Some of the older sources, while foundational for narrative learning and focus groups, may require additional context to ensure their applicability to the specific challenges presented by COVID-19 vaccine hesitancy.

Have any limitations of the research been acknowledged?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Partly

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

CPD, Accreditation, Educational leadership, PGE

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

MedEdPublish (2016). 2025 Apr 28.
Graham Easton 1

Dear Reviewer, thank you for your comments and suggestions which we feel have improved the paper. Here are our responses below:

Re title change. Thank you.

This is a helpful suggestion. We are not sure if it is possible or advisable to change the title of the paper at this stage, given previous citations etc. If it is possible however, we suggest:  "Using the Power of Narratives in E-Learning for COVID-19 Vaccine Hesitancy Conversations: A Mixed Methods Study in Medical Education" 

Re results themes in abstract: Thank you, we agree.We have now provided the full list of themes identified in the focus group analysis:  "The focus group analysis suggests that character-based narratives can promote learning online, particularly through engagement and accessibility, relatability of characters and their stories, improved memory, and emotional connection. "

Re introduction. Thank you.  We have added the following text to the introduction, introducing a critical stance and suggesting knowledge gap this study addresses:  “Despite the theoretical promise, there is limited evidence for the benefits of narrative learning approaches on long-term learning outcomes, clinical behaviour or patient outcomes. For example, a systematic review of digital storytelling (which combines traditional storytelling with digital tools) showed minimal impact of patient stories alone on health professionals learning (Moreau, 2018). Developing  models for narrative medicine education and integrating and evaluating diverse storytelling formats, such as the digital storytelling approach we developed in this project, could further enhance student learning experiences”  Additional references needed for this section  Moreau, K.A., Eady, K., Sikora, L. et al. Digital storytelling in health professions education: a systematic review. BMC Med Educ 18, 208 (2018) 

Regarding the survey instrument. Thank you.

This was a simple survey instrument to assess self-confidence. We used accepted best practice in survey item-writing approaches, including use of Likert scales [Artino et al 2014]. However there was no validated survey instrument that we felt entirely appropriate for this specific study.  [ Artino, A. R., La Rochelle, J. S., Dezee, K. J., & Gehlbach, H. (2014). Developing questionnaires for educational research: AMEE Guide No. 87. Medical Teacher, 36(6), 463–474.] 

Regarding the diversity and small sample size, we have addressed this in response to Reviewer 1 and have added brief text to limitations section to address this.  Thank you. Regarding the query about the data reaching saturation and the small sample size: the novelty and challenges of conducting the study in lockdown during the Covid pandemic [and limited availability of medical students] meant a single focus group was conducted. Pressures on students was an important issue which affected recruitment/sampling – we could only use final year students who had finished their exams. We discuss this elsewhere in paper. Despite this acknowledged limitation, we feel the data was sufficiently rich to share, and that the need for saturation of data became meaningless with only one focus group.  

Ethnicity/gender - Thank you. We have added the following text near the start of the results section:   “Whilst we did not formally collect demographic data on ethnicity and gender, overall, we felt the make-up of the focus group broadly reflected the diversity of the medical student body   We have also provided a more robust review of narrative learning in healthcare in the introduction Re results section: Thank you. In response to reviewer 1, we have added a passage to the discussion section which more explicitly links findings to previous research in narrative learning in medical education. Here is the passage again for clarity:  “Stories are used in various ways in medical education; for example, during ward rounds and clinical case discussions to illustrate diagnostic reasoning and decision-making (Hunter, 1991), or in narrative medicine courses and medical humanities programmes which often use patient stories to foster empathy and reflection (Milota, 2019). Digital storytelling (which combines traditional storytelling with digital tools) is increasingly used to promote patient-centred care patient narratives offering insights into lived experiences (Moreau, 2018) .   There is some limited evidence demonstrating the impact of narrative-based approaches on learning in health professions education . For example, narrative medicine, as explored in a systematic review, has shown positive changes in students’ attitudes, perceptions, attainment of new knowledge and skills, behaviour, and improved awareness of patients’ perspectives (Milota, 2019). Storytelling has been shown to prepare students for uncertainty in clinical practice (Papnagnou, 2021), and can be an effective way for students to learn about medical ethics (Paton, 2021) . In classroom lectures, narratives can provide context, engage learners, and aid memory retention by connecting new knowledge to lived experiences (Easton, 2016).  Digital storytelling has been shown to improve medical students’ critical thinking (Zarei, 2021), although a systematic review of digital storytelling showed minimal impact of patient stories alone on health professionals learning (Moreau, 2018).”     Re limitations and discussion section: Thank you. We have now addressed the issue of small sample size in previous responses to Reviewer 1 in limitations section.  he novelty and challenges of conducting the study in lockdown during the Covid pandemic [and limited availability of medical students] meant a single focus group was conducted. Pressures on students was an important issue which affected recruitment/sampling – we could only use final year students who had finished their exams. We discuss this elsewhere in paper.  Despite this acknowledged limitation, we feel the data was sufficiently rich to share, and that the need for saturation of data became meaningless with only one focus group.     We have added some text so relavnt section of  limitations now reads:  “Whilst qualitative studies do not necessarily need large sample sizes to allow collection of in-depth insights, perhaps having two focus groups would have demonstrated a broader range of views. As we used a convenience sample (the challenges of conducting the study in lockdown during the Covid pandemic and limited availability of medical students, meant we only used a single focus group), we cannot be sure how closely our focus group students represent the wider student population, and we should consider volunteer bias ( Heckman, 1990).”  Thank you also for your suggestion about future studies. We have added the folllowing passage: “We also think it would be important in future studies to include stronger outcome measures, particularly those relating to the patient perspective and the enduring effect on medical students’ communication skills or empathy, guided outcome measures proposed by Kirkpatrick ( Kirkpatrick et al., 1967) and others”   Thank you again for your comments and suggestions which have been very helpful in developing this second version.

MedEdPublish (2016). 2025 Jan 28. doi: 10.21956/mep.21181.r40975

Reviewer response for version 1

Julie A Hunt 1

I am a MEP Advisory Board Member; this review represents my individual viewpoint. While I have performed mixed methods research, I am reviewing this research as a generalist in the topic of narrative learning theory and vaccine hesitancy, not as a specialist.

The title accurately represents the work.

The abstract may be improved by identifying the study as mixed methods and by modifying the abstract’s concluding statements to indicate that character-driven stories have potential value in online learning of vaccine hesitancy rather than in the overly broad “online learning environment”.

The introduction was robustly written.

The qualitative methods were stronger than the quantitative methods. The focus group and narrative learning theory were well chosen and well justified. Focus group questions should be provided to the reader as an appendix. The pre/post confidence measures are not strong outcome measures. The authors may consider collecting more substantive outcome measures in subsequent studies; they can be guided by stronger outcome measures proposed by Kirkpatrick’s hierarchy (1970), Miller’s pyramid (1990), and Moore et al’s framework (2009).

In the results section, it would have been helpful to have known the experience levels of the students in terms of COVID vaccines administered, hesitancy encountered, and experience having these conversations prior to the module. These could have been presented in the first paragraph of the results section rather than scattered later in the results section. Some statements could have used additional illustrative quotes.

In the discussion, the authors state that their themes echo existing literature on narratives in medical education, but they do not discuss where else in medical education these narratives have been used to teach students. Where have these been used, specifically, and what was the outcome? Whose work did the authors’ work build upon? What are the next steps for moving research forward in this line of inquiry?

In the limitations, the authors discuss qualitative sample size, but they do not state whether their data reached saturation in thematic analysis. This would help the reader to assess the adequacy of the sample size. They also mention the participation of minorities and women. While they reported a gender distribution, they did not report racial or ethnic makeup of their participants. Was this information collected? Could it be reported also?

Finally, the authors comment that the focus group should not have been facilitated by AG, as AG also created the resource being evaluated. This is a significant conflict of interest, particularly when combined with AG doing the primary qualitative analysis and therefore having the potential to sway the analysis as well. Were the focus group participants aware of this COI? A more thorough discussion of this COI should be added so that the reader can evaluate for themselves the potential for bias.

This mixed methods study is well grounded in narrative learning theory and evaluates an online, asynchronous learning module on vaccine hesitancy, an important issue for COVID and, increasingly, for other vaccines as well. The authors are commended for using e-learning, asynchronous delivery, motivational interviewing methods, and a thick narrative approach to addressing this important topic.

Have any limitations of the research been acknowledged?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Quantitative and mixed methods research in educational outcomes following online learning and simulation-based learning

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

MedEdPublish (2016). 2025 Apr 28.
Graham Easton 1

Dear Reviewer, thank you for your considered reviewed and your helpful suggestions. We have summaried our responses below: Re title change. Thank you. This is a helpful suggestion. We are not sure if it is possible or advisable to change the title of the paper at this stage, given previous citations etc. If it is possible however, we suggest:  "Using the Power of Narratives in E-Learning for COVID-19 Vaccine Hesitancy Conversations: A Mixed Methods Study in Medical Education"  Re results themes in abstract: Thank you, we agree. We have now provided the full list of themes identified in the focus group analysis:  "The focus group analysis suggests that character-based narratives can promote learning online, particularly through engagement and accessibility, relatability of characters and their stories, improved memory, and emotional connection." Re your suggestion to include link to questionnaire: Thank you. The focus group questions were provided as an appendix at end of paper, under extended data section:  QMRO: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Interview Guide. https://doi.org/10.17636/10190985 ( Gupta et al., 2023e).   Re introduction. Thank you.  We have added the following text to the introduction, introducing a critical stance and suggesting knowledge gap this study addresses:  “Despite the theoretical promise, there is limited evidence for the benefits of narrative learning approaches on long-term learning outcomes, clinical behaviour or patient outcomes. For example, a systematic review of digital storytelling (which combines traditional storytelling with digital tools) showed minimal impact of patient stories alone on health professionals learning (Moreau, 2018). Developing  models for narrative medicine education and integrating and evaluating diverse storytelling formats, such as the digital storytelling approach we developed in this project, could further enhance student learning experiences”  Additional references needed for this section  Moreau, K.A., Eady, K., Sikora, L. et al. Digital storytelling in health professions education: a systematic review. BMC Med Educ 18, 208 (2018)    Re: outcome measures. thank you for the suggestion. We agree that future work could consider additional outcome measures, and we have added this to the discussion section, linked to Reviewer 2 comments along similar lines. We have added the following text to version 2 in the discussion section;  “We also think it would be important in future studies to include stronger outcome measures, particularly those relating to the patient perspective and the enduring effect on medical students’ communication skills or empathy, guided outcome measures proposed by Kirkpatrick ( Kirkpatrick et al., 1967) and others”.  Re providing further detail about students' previous experience.Thank you. We did provide data on student experience and pre-course confidence as an appendix in data section:  QMRO: Pre-course confidence and experience data. https://doi.org/10.17636/10191999 ( Gupta et al., 2023c).  But agree, helpful to provide at start of results section, so we have added a sentence there, summarising what data we have, including the sentence later about some students vaccinated more than 100 patients. Added text:  “In the pre-course survey about students’ confidence and experience of having vaccine hesitancy conversations,  three reported no experience at all, two reported very little experience, two reported some experience, and one reported quite a lot of experience. Some students in the focus group said they had vaccinated more than 100 patients. In terms of self-reported confidence having these conversations, on a scale of 0–10 where 0 is not at all confident, and 10 is totally confident, two students scored 2, three scored 3, one scored 4, one scored 5, one scored 6 and one scored 8.”  Re more detailed review of other narrative uses and evaluations and how links to our study. Thank you. We have added the following passage to the discussion section:  “Stories are used in various ways in medical education; for example, during ward rounds and clinical case discussions to illustrate diagnostic reasoning and decision-making (Hunter, 1991), or in narrative medicine courses and medical humanities programmes which often use patient stories to foster empathy and reflection (Milota, 2019). Digital storytelling (which combines traditional storytelling with digital tools) is increasingly used to promote patient-centred care patient narratives offering insights into lived experiences (Moreau, 2018) .   There is some limited evidence demonstrating the impact of narrative-based approaches on learning in health professions education . For example, narrative medicine, as explored in a systematic review, has shown positive changes in students’ attitudes, perceptions, attainment of new knowledge and skills, behaviour, and improved awareness of patients’ perspectives (Milota, 2019). Storytelling has been shown to prepare students for uncertainty in clinical practice (Papnagnou, 2021), and can be an effective way for students to learn about medical ethics (Paton, 2021) . In classroom lectures, narratives can provide context, engage learners, and aid memory retention by connecting new knowledge to lived experiences (Easton, 2016).  Digital storytelling has been shown to improve medical students’ critical thinking (Zarei, 2021), although a systematic review of digital storytelling showed minimal impact of patient stories alone on health professionals learning (Moreau, 2018).”  Additional references needed for this section:   Hunter K. Doctors’ Stories - the Narrative Structure of Medical Knowledge. Princeton: Princeton University Press; 1991.  Moreau, K.A., Eady, K., Sikora, L. et al. Digital storytelling in health professions education: a systematic review. BMC Med Educ 18, 208 (2018)  M. M. Milota, G. J. M. W. van Thiel & J. J. M. van Delden (2019) Narrative medicine as a medical education tool: A systematic review, Medical Teacher, 41:7, 802-810  Papanagnou D, Ankam N, Ebbott D, Ziring D. Towards a medical school curriculum for uncertainty in clinical practice. Med Educ Online 2021;26:1972762  Paton A, Kotzee B. The fundamental role of storytelling and practical wisdom in facilitating the ethics education of junior doctors. Health (London) 2021;25:417‑33  Zarei A, Mojtahedzadeh R, Mohammadi A, Sandars J, Hossein Emami SA. Applying digital storytelling in the medical oncology curriculum: Effects on students’ achievement and critical thinking. Ann Med Surg (Lond) 2021;70:102528    Re your comments about small sample size and saturation of data.Thank you. Regarding the query about the data reaching saturation and the small sample size: the novelty and challenges of conducting the study in lockdown during the Covid pandemic [and limited availability of medical students] meant a single focus group was conducted. Pressures on students was an important issue which affected recruitment/sampling – we could only use final year students who had finished their exams. We discuss this elsewhere in paper. Despite this acknowledged limitation, we feel the data was sufficiently rich to share, and that the need for saturation of data became meaningless with only one focus group.   We have added some text so relavnt section of  limitations now reads:  “Whilst qualitative studies do not necessarily need large sample sizes to allow collection of in-depth insights, perhaps having two focus groups would have demonstrated a broader range of views. As we used a convenience sample (the challenges of conducting the study in lockdown during the Covid pandemic and limited availability of medical students, meant we only used a single focus group), we cannot be sure how closely our focus group students represent the wider student population, and we should consider volunteer bias ( Heckman, 1990).”  Ethnicity/gender - Thank you. We have added the following text near the start of the results section:   “Whilst we did not formally collect demographic data on ethnicity and gender, overall, we felt the make-up of the focus group broadly reflected the diversity of the medical student body “  Re your comments about potential bias of failitator of fous groups. Thank you. We acknowledge this limitation in Version 1. Students were aware that AG was involved in development of resource. We do agree that theoretically this can introduce bias of course; but recognise that being close to the teaching resource may also bring benefits, and that in our experience it is a common strategy for researchers who developed a teaching session or resource to also run their focus group evaluation.  However, in mitigation, AG was only  minimally involved in developing the actual resource [GE oversaw most of this], we set clear ground rules about encouraging honesty, clarity that AG would not be involved in any of their formal course assessments, and by another author [GE] also independently analysing the data.  We have added text to the limitations section so the relevant passage reads:  “It could be argued that the facilitator for the focus group should have been an impartial individual, as students were aware that AG helped to develop the resource. Guidance recommends that the facilitator should maintain neutrality to avoid bias in participants responses ( ACET Inc, 2011). Although we took care to encourage negative feedback, and students did not seem hesitant to offer these, it is possible students did not contribute all their negative opinions so as not to offend AG. Similarly, there is a risk of moderator bias from accidental leading. However, in mitigation, AG was only  minimally involved in developing the actual resource [GE oversaw most of this], we set clear ground rules about encouraging honesty, clarity that AG would not be involved in any of their formal course assessments, and we ensured another author [GE] also independently analysed the data” Many thanks again for your helpful suggestions and we hope we have addressed your concerns adequately.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Citations

    1. Gupta A, Easton G, Berlin A: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Self-Confidence scores. QMRO.[Data].2023a. 10.17636/10190002 [DOI]
    2. Gupta A, Easton G, Berlin A: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Transcript anonymous. QMRO.[Data].2023b. 10.17636/10190001 [DOI]
    3. Gupta A, Easton G, Berlin A: Pre-course confidence and experience data. QMRO.[Data].2023c. 10.17636/10191999 [DOI]
    4. Gupta A, Easton G, Berlin A: Post-course confidence survey. QMRO.[Data].2023d. 10.17636/10192000 [DOI]
    5. Gupta A, Easton G, Berlin A: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Interview Guide. QMRO.[Data].2023e. 10.17636/10190985 [DOI]

    Data Availability Statement

    Underlying data

    QMRO: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Self-Confidence scores. https://doi.org/10.17636/10190002 ( Gupta et al., 2023a).

    The project contains the following underlying data:

    • -

      Self-confidence scores.docx

    QMRO: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Transcript anonymous. https://doi.org/10.17636/10190001 ( Gupta et al., 2023b).

    The project contains the following underlying data:

    • -

      VH transcript.docx

    QMRO: Pre-course confidence and experience data. https://doi.org/10.17636/10191999 ( Gupta et al., 2023c).

    The project contains the following underlying data:

    • -

      Easton Pre-course confidence and experience data 2023 Accepted.csv

    QMRO: Post-course confidence survey. https://doi.org/10.17636/10192000 ( Gupta et al., 2023d)

    The project contains the following underlying data:

    • -

      Easton Post-course confidence survey 2023 Accepted.csv

    Extended data

    QMRO: Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Interview Guide. https://doi.org/10.17636/10190985 ( Gupta et al., 2023e).

    This project contains the following extended data:

    • -

      Easton Using the power of narratives in e-learning for COVID-19 vaccine hesitancy conversations. Focus Group Interview Guide 2023 Accepted.docx

    Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).


    Articles from MedEdPublish are provided here courtesy of Association for Medical Education in Europe

    RESOURCES