Skip to main content
PLOS One logoLink to PLOS One
. 2021 Sep 29;16(9):e0257880. doi: 10.1371/journal.pone.0257880

A scoping review of patient engagement activities during COVID-19: More consultation, less partnership

Lauren Cadel 1,2, Michelle Marcinow 1, Jane Sandercock 1, Penny Dowedoff 1, Sara J T Guilcher 2,3, Alies Maybee 4, Susan Law 1,3, Kerry Kuluski 1,3,*
Editor: Mariusz Duplaga5
PMCID: PMC8480845  PMID: 34587175

Abstract

Background

The COVID-19 pandemic has had a devastating impact on healthcare systems and care delivery, changing the context for patient and family engagement activities. Given the critical contribution of such activities in achieving health system quality goals, we undertook to address the question: What is known about work that has been done on patient engagement activities during the pandemic?

Objective

To examine peer-reviewed and grey literature to identify the range of patient engagement activities, broadly defined (inclusive of engagement to support clinical care to partnerships in decision-making), occurring within health systems internationally during the first six months of the COVID-19 pandemic, as well as key barriers and facilitators for sustaining patient engagement activities during the pandemic.

Methods

The following databases were searched: Medline, Embase and LitCOVID; a search for grey literature focused on the websites of professional organizations. Articles were required to be specific to COVID-19, describe patient engagement activities, involve a healthcare organization and be published from March 2020 to September 2020. Data were extracted and managed using Microsoft Excel. A content analysis of findings was conducted.

Results

Twenty-nine articles were included. Few examples of more genuine partnership with patients were identified (such as co-design and organizational level decision making); most activities related to clinical level interactions (e.g. virtual consultations, remote appointments, family visits using technology and community outreach). Technology was leveraged in almost all reported studies to interact or connect with patients and families. Five main descriptive categories were identified: (1) Engagement through Virtual Care; (2) Engagement through Other Technology; (3) Engagement for Service Improvements/ Recommendations; (4) Factors Impacting Patient Engagement; and (5) Lessons Learned though Patient Engagement.

Conclusions

Evidence of how healthcare systems and organizations stayed connected to patients and families during the pandemic was identified; the majority of activities involved direct care consultations via technology. Since this review was conducted over the first six months of the pandemic, more work is needed to unpack the spectrum of patient engagement activities, including how they may evolve over time and to explore the barriers and facilitators for sustaining activities during major disruptions like pandemics.

Introduction

The World Health Organization declared the COVID-19 outbreak, originating in Wuhan, China, as a pandemic on March 11, 2020 [1]. As of June 2021, over 174 million cases had been confirmed worldwide, with more than 3.6 million deaths [2]. Two hundred and nineteen countries/regions have been affected by this pandemic [2]. COVID-19 has not only affected healthcare systems, it has had a major impact on everyday life involving local and national economies [3], education systems [4], travel industries [5], immigration [6] and the environment [7]. In relation to healthcare systems, continuing to deliver high quality care amidst a pandemic has been challenging.

How healthcare systems interacted with patients and caregivers (forms of patient engagement) has changed over the course of the COVID-19 pandemic. The pandemic caused a major shift in health system activities with implications on how care was delivered and how patients and families were engaged as partners. For example, visitor restrictions were implemented in hospitals and long-term care facilities around the world [810], non-COVID-19 related research in some contexts was suspended [11] and many patient and family advisory committees, at least in the North American context, were put on hold [12]. An editorial by Richards and Scowcroft (2020) from the United Kingdom also described the abandonment of patient and public involvement in health system decisions and the omission of patient feedback on policies and guidelines [13].

Patient and family engagement in care and program planning is fundamental to person-centered care and quality of care [14, 15]. Over the past several decades, health systems have been working towards greater involvement of patients and families through engagement activities, such as the development of patient and caregiver advisory committees, consultations on guidelines or protocols, receiving feedback on experiences to promote change in care delivery and the healthcare system and working in partnership using co-design methods to design new programs and service delivery models [1619]. Through patient engagement, care can be transformed by individuals who are directly impacted by healthcare decisions [20]. While these examples refer to more ‘active’ forms of engagement, activities can be more broad in nature, ranging—from clinical consultations to partnership activities (advisory groups and participation in policy decision making) [21]. Engagement, in these various forms, is intended to optimize care to meet the health and social care needs of patients and caregivers [22, 23].

Patient engagement can be defined as the partnership between patients, families and health professionals across different levels of the healthcare system with the goal of improving health and healthcare [21]. Reflecting on the broad range of engagement activities, Carman and colleagues’ (2013) well cited, multidimensional framework for patient and family engagement outlines three core levels of engagement: 1) direct care, 2) organizational design and 3) governance and policy making. At each level, there is a continuum of engagement from consultation, to involvement, to partnership and shared leadership [21] reflecting both active and passive forms of engagement. Each stage of the continuum involves increased participation and collaboration from those being engaged, as they progress from information sharing to active partnership in the development and evaluation of healthcare programs and policies.

Patient engagement has been noted as an integral component of health care delivery, and is critical for obtaining feedback for improving processes, safety and experiences [24]. The pandemic halted many non-essential services; however, continuing to engage with patients and families during a pandemic is important to ensure quality of care is continually provided to those who are using and interacting with the healthcare system [14, 15]. With a rapidly changing environment as a result of COVID-19, understanding the initial impact of the pandemic on patient engagement activities requires our attention. The purpose of this scoping review was to examine peer reviewed and grey literature to identify the broad range of patient engagement activities that were happening within health systems during the first six months of the COVID-19 pandemic (March 2020 to September 2020), as well as key barriers and facilitators for patient engagement activities. We acknowledge that a scoping review is only one way to identify the type and extent of evidence available relating to patient engagement activities during the initial stages of COVID-19. Given that COVID-19 related papers were being published rapidly, our aim was to scope and synthesize the literature and to highlight knowledge gaps to help focus areas of improvement and future work [25].

Materials and methods

This scoping review followed the methodological framework for scoping reviews outlined by Levac and colleagues [26], as well as the PRISMA-ScR reporting guidelines by Tricco and colleagues (see S2 Table) [27]. A protocol was developed and registered on Open Science Framework (https://osf.io/khuap).

Identifying the research question

The following research question was formulated to guide this scoping review: What is known in the literature about work that has been done internationally within healthcare organizations on patient engagement during the first six months of the COVID-19 pandemic? Based on this question, the two main objectives were: (1) to identify strategies that have been implemented or sustained to engage with patients during the COVID-19 pandemic and (2) to identify the key barriers and facilitators to engaging with patients during the COVID-19 pandemic.

Identifying relevant studies

A search strategy was developed with guidance from the Medical Library Association’s resource on COVID-19 Literature Searches [28], as well as in consultation with a librarian at Trillium Health Partners (see S1 Table). The following are examples of terms searched using Boolean operators, truncations, wild cards and proximity operators: coronavirus, COVID-19, Sars-CoV-2, patient, family and caregiver engagement, participation, design and partner. Three databases were searched on May 25, 2020: Medline (Ovid Interface), Embase (Ovid Interface) and LitCOVID [29]. A search for relevant grey literature was conducted using Google (Advanced Google searches), and the websites of key health system and guidance producing organizations and associations (e.g. World Health Organization, United Kingdom National Health Service). Due to the high volume of publications related to COVID-19, grey literature was searched regularly throughout this study until September 1, 2020 (when analysis and manuscript writing began).

Study selection

For inclusion, articles were required to meet the following criteria: (1) specific to the context of COVID-19; (2) included a description of patient engagement activities; (3) involved a healthcare organization; and (4) published from March 11, 2020 to September 1, 2020. To be considered a patient engagement activity, we followed Carman’s framework, which includes engaging with patients, families, their representatives, and health professionals in direct care (e.g. participating in clinical consultations, participating in support groups), organizational design and governance (e.g. serving on advisory councils, assisting with hiring committees) and/or policy making (e.g. collaborating with policy-makers, setting priorities for healthcare resources) [21]. The patient engagement activity did not have to be specific to COVID-19, just occurring during the pandemic. Based on the rapidly changing environment, this review was bounded within the first six months after the pandemic was declared in order to gain an understanding of the initial impact of COVID-19 on patient engagement activities. Articles were excluded if they were: (1) conference abstracts and articles in which the full-text was not available or accessible; or (2) articles published prior to 2019. Articles were excluded if the full-text was not accessible because information would not be able to be extracted from it. Articles published prior to 2019 were excluded because they would not be related to the COVID-19 pandemic.

The database searches identified 762 articles and the grey literature searches identified 11 articles (reports, commentaries, etc.; see Fig 1). Following deduplication using EndNote X9 [30], 473 articles remained for screening. Covidence, a software platform for systematic and scoping reviews [31], was used to facilitate the screening processes. The research team (KK, LC, MM) independently screened the titles and abstracts of 20 articles to test their agreement; with an agreement of 90%, the remaining articles were divided amongst the three reviewers and double screened (two individuals screened each article for inclusion). All disagreements were discussed in virtual meetings until consensus among the team was achieved. Articles that were included were then reviewed at the full-text level. A subset of full-text articles (n = 10) were independently screened by the research team (KK, LC, MM) to test their agreement (90%). All full-text articles were double screened and disagreements were resolved through virtual meetings.

Fig 1. PRISMA flow diagram of included articles.

Fig 1

Charting the data

A data extraction form was developed in Microsoft Excel by the research team (KK, LC, MM). Data were extracted from the full-text articles by a single person (LC) to ensure consistency. A spot check of extracted data was performed (MM) for 10% of included articles to ensure the extracted data was complete and accurate. Extracted data contained the following information: study characteristics, population characteristics, patient engagement characteristics (description, target population, challenges, lessons learned, level of engagement [21]), intervention characteristics (if applicable), study outcomes and conclusions.

Collating, summarizing and reporting the results

The extracted data were analyzed using descriptive quantitative and qualitative approaches. Descriptive quantitative analyses included summarizing the number of articles based on the method of data collection, year of publication, country in which it was conducted and the type of patent engagement activity. Carman and colleagues’ framework was initially used to categorize each of the activities based on their level of engagement [21]; however, in doing so, it was identified that the majority of activities were categorized as direct care. A more in-depth analysis, guided by Hsieh and Shannon’s conventional approach to content analysis [32], was then conducted by two authors (KK, LC) to identify the nuances and details of each activity. Both authors read the extracted descriptions and purpose of the engagement activities, referring back to the full-text as needed, and applied a one or two word description to the activity. The authors then worked together (through virtual meetings and in-depth conversations) to review the simplified descriptions of the engagement activities and identified broader commonalities, which allowed for all articles to be classified into five categories (described in detail in the Results). This analysis provided a more nuanced set of categories within Carmen’s categories of engagement.

Results

Study characteristics

A total of 473 unique articles were screened at the title and abstract level and 83 were screened at the full-text level. Twenty-nine articles met the eligibility criteria and were included in this scoping review (see Fig 1). The majority of included articles were not original research articles (e.g. editorials, reviews, commentaries; n = 15). The most common study design of the empirical articles was quantitative (n = 12), with one mixed method study and one qualitative study. The work was carried out across 14 different countries, but the United States was the most common (n = 17). All of the included articles were published in 2020, with the majority published in May (n = 15). Table 1 outlines the characteristics of included articles.

Table 1. Characteristics of included articles (n = 29).

Author (Year) Country Objective Method Study Design Participants/ Target Population Sample Size
Meinert et al. (2020) [33] United Kingdom, France, and Sweden • To describe the design and implementation of a digital health solution for older adults (Activating Digital to Support Social Distancing COVID-19 Aware Family Engagement (ADAPT-CAFÉ)) Mixed Methods Case study and feasibility study Older adults, family members and peer groups 27,450 projected users
Sirotich et al. (2020) [34] United States • To describe the development of a survey through rapid engagement with patients, patient organizations and rheumatologists Quantitative Cross-sectional study Adults and parents of children with rheumatic diseases 9,541 survey responses
• To explore how COVID-19 is affecting the physical and mental health of people with rheumatic diseases
Overton et al. (2020) [35] United States • To describe how the patient experience team is supporting programs and patients during the pandemic Neither Summary/ review Patients and staff at MD Anderson N/A
Ekzayez et al. (2020) [36] Syria • NR Neither Review/ perspective paper NR N/A
Mgbako et al. (2020) [37] United States • To describe patient care at an HIV clinic during COVID-19 Neither Review/ notes from the field Adults with HIV 1
• To identify how telemedicine may affect patient-centred care
Wei et al. (2020) [38] China • To develop an internet-based intervention for COVID-19 patients experiencing psychological distress Quantitative Prospective, randomized, controlled, 2-week study Laboratory confirmed COVID-19 patients in the isolation ward 26
• To test the efficacy of the intervention on COVID-19 patients with depression and anxiety
Amir-Behghadami et al. (2020) [39] Iran • To describe the implementation of an electronic self-screening system for COVID-19 Neither Letter to the editor Iranian residents/ patients with COVID-19 N/A
Hart et al. (2020) [40] United States • To describe a framework for family-centred care in inpatient settings during COVID-19 Neither Review NR N/A
Tenforde et al. (2020) [41] United States • To present the process for the rapid adoption of telemedicine during COVID-19, as well as the results of a quality improvement initiative Quantitative Quality improvement initiative Outpatient sports & musculoskeletal medicine patients and physicians 132
Hu and Qiu (2020) [42] China • To outline measures to improve infection prevention through the implementation of risk communication and community engagement Neither Review/ perspective paper NR N/A
Medina et al. (2020) [43] United States • To describe the effectiveness of a home monitoring program during COVID-19 Quantitative Intervention study COVID-19 Patients 1,924
Griffin et al. (2020) [44] United States • To describe the rapid development and implementation of processes to prepare for the impact of COVID-19 Neither Review/ critical care perspective COVID-19 Patients N/A
Japan ECMOnet for COVID-19 (2020) [45] Japan • To describe a telephone consultation working group established for patients with severe respiratory failure caused by COVID-19 Neither Letter to the editor COVID-19 Patients 12
Murphy (2020) [46] United Kingdom • To review diabetes management in pregnant women before and during the lockdown caused by COVID-19 Neither Description/ review of processes Pregnant women with diabetes N/A
Yassa et al. (2020) [47] Turkey • To identify the attitudes, concerns and knowledge of COVID-19 among non-infected pregnant women Quantitative Cross-sectional survey research Healthy, pregnant women over 30th gestational week 172
• To develop targeted messages and counselling based on their attitudes, concerns and knowledge
Kreimer (2020) [48] United States • To describe the changes made to palliative care neurologists’ practice to address the fears and isolation of their patients and families Neither Article in brief Physicians, neurologists N/A
Mercadante et al. (2020) [49] Italy • To describe the use of WhatsApp to involve family members in clinical rounds and explore their perspectives Qualitative Descriptive Family members of palliative patients 16
Padala et al. (2020) [50] United States • To explore the perspectives of older patients and their caregivers regarding clinical research during COVID-19 Quantitative Cross-sectional study Older participants and caregivers enrolled in clinical studies 51
Peahl et al. (2020) [51] United States • To describe new guidelines and experiences transitioning to a new model for prenatal care Neither Description of guidelines Low risk pregnant women N/A
Fortune et al. (2020) [52] Canada, United States, Europe, Mexico and Australia • To describe the effects of a group videoconference-based intervention on anxiety, depression, stress, loneliness, boredom, physical activity, and frequency of social interactions Quantitative Partially nested randomised controlled trial At-risk scleroderma patients NR
Patel et al. (2020) [53] United States • To describe a pathway for increasing capacity for remote enrollment in telehealth Quantitative Report Pediatric patients Weekly enrollment:
0–12: 1582
13–17: 527
Annis et al. (2020) [54] United States • To describe experiences with a remote patient monitoring program Quantitative Case report COVID-19 Patients 1,496
• To investigate satisfaction and program acceptability among patients and staff
Edvardsson et al. (2020) [55] Australia • To describe the relational aspects of person-centred care in the context of research, practice and COVID-19 Neither Review/ contemporary issue Patients during COVID-19 N/A
Contreras et al. (2020) [56] United States • To describe the telemedicine environment, changes made because of COVID-19 and implications for the future Neither Review NR N/A
Brown et al. (2020) [57] United States • To examine the pain, anxiety, physical function and economic ability to have surgery among hip and knee arthroplasty patients whose surgery was delayed because of COVID-19 Quantitative Cross-sectional Survey/ questionnaire Electively scheduled hip and knee arthroplasty patients 360
Peters and Garg (2020) [58] United States • To describe the experiences of two patients who engaged in telehealth relating to diabetes care Quantitative Case study Adult patients with type 1 diabetes 2
Kullar et al. (2020) [59] United States • To review the use of Twitter for providing information about infectious diseases Neither Review NR N/A
Chen et al. (2020) [60] China • To explore how social media promoted citizen engagement during COVID-19 by the Chinese government Quantitative Pioneering study NR NR
Dokken and Ahmann (2020) [61] United States • To describe the development of, and the guidelines for, person and family-centred care during difficult times Neither Editorial Family members of hospitalized patients N/A

Abbreviations: NR = not reported; N/A = not applicable; HIV = human immunodeficiency virus.

During the analysis, five main descriptive categories were identified related to the literature on engagement: (1) Engagement through Virtual Care; (2) Engagement through Other Technology; (3) Engagement for Service Improvements/ Recommendations; (4) Factors Impacting Patient Engagement; and (5) Lessons Learned through Patient Engagement (see Fig 2). These categories are not mutually exclusive as some activities fell into more than one category. Across all categories, the majority of activities involved individual level patient engagement (i.e. information sharing and dissemination, feedback on attitudes and experiences), with limited activities empowering patients as leaders, integrating patient and caregiver partners as team members or co-designing interventions, programs or initiatives with patients and caregivers. Despite not limiting the topic of patient engagement activities to COVID-19, we identified that most of the articles included activities specific to the pandemic. Table 2 describes the patient engagement characteristics.

Fig 2. Methods used by health systems to stay connected with patients and families during the COVID-19 pandemic.

Fig 2

Table 2. Characteristics of patient engagement activities.

Author (Year) Engagement Activity Description of engagement activity Challenges with engagement Lessons learned from engagement Engagement Category or Sub-Category
Mgbako et al. (2020) [37] Virtual Visits/ Consultations • The use of telemedicine to connect with and check in on patients regarding their medication supply, food and housing situation and to help set-up technology
  • Technological issues–connectivity disruptions

  • Difficulties building provider-patient rapport via telemedicine

  • Building rapport is critical for recruiting and engaging with marginalized populations and persons from hard-to-reach communities

  • A team-based care model needs to be built into telemedicine

Virtual Care for Health and Social Services
Medina et al. (2020) [43] Home monitoring program • A program to provide information to patients on COVID-19, home isolation, social support, home safety and a care companion application (MyChart) NR • Integrating disciplines (psychiatry, behavioural health, social work, community partners) in the home monitoring program Virtual Care for Health and Social Services
Japan ECMOnet for COVID-19 (2020) [45] Telephone consultations • A 24 hour/day service providing telephone consultations for patients with severe respiratory failure NR NR Virtual Care for Health and Social Services
Murphy (2020) [46] Remote engagement/ services • The use of online resources (virtual training, email, telephone) to support pregnant women with type one diabetes with blood pressure and blood glucose monitoring NR NR Virtual Care for Health and Social Services
Peahl et al. (2020) [51] Virtual visits • The use of telephone or video technology as touchpoints between in-person visits for addressing questions and completing depression screens • Disadvantaged populations (patients living in rural areas, low socioeconomic status) NR Virtual Care for Health and Social Services
Fortune et al. (2020) [52] Scleroderma Patient-centered Intervention Network COVID-19 Home-isolation Activities Together Program
  • A video conference-based intervention targeting anxiety and mental health outcomes

  • The patient advisory team helped design the program and trial

NR NR Virtual Care for Health and Social Services
Patel et al. (2020) [53] Virtual enrolment in My Health at Vanderbilt and Telehealth Visits • The use of technology to enroll pediatric patients in telehealth visits • Teenagers who are unable to complete forms due to limited decision-making capacity or speech/ language barriers • Using successful strategies from the COVID-19 response in future situations/ disasters Virtual Care for Health and Social Services
Peters and Garg (2020) [58] Telehealth • Providing remote diabetes care using technology
  • Technological barriers (patients don’t have continuous glucose monitors, unsure how to find glucose levels with monitor, no availability of data)

  • Cost of devices for underserved patients

• Changes in service delivery can improve access and outcomes for patients with diabetes Virtual Care for Health and Social Services
Contreras et al. (2020) [56] Telemedicine • Providing care in real-time through technology supporting audio-visual interactions • Technological issues (bandwidth) and logistical difficulties (selecting a platform)
  • Educating all stakeholders involved on implementation and use

  • Distribution of tip sheets and instructional modules

  • Naming clinical champions during rollout periods

  • Considering comfort level and health literacy when using telehealth

Virtual Care for Health and Social Services
Overton et al. (2020) [35] Virtual Care
  • Use of MyChart (combination of Epic and Zoom) for video visits with patients

  • Virtual care conferences (video or telephone) with caregivers and family members

NR NR Virtual Care for Health and Social Services
Virtual Care for Connecting with Families and Caregivers
Kreimer (2020) [48] Telehealth
  • The use of telephone and video appointments for advance care planning and palliative patients

  • Assisting patients with setting up Zoom and FaceTime to talk with family/friends

  • Inability to see body language or read nonverbal cues

  • Delivering bad news via technology

NR Virtual Care for Health and Social Services
Virtual Care for Connecting with Families and Caregivers
Tenforde et al. (2020) [41] Telemedicine and follow-up survey
  • The use of telemedicine (InTouch, Zoom) to facilitate communication between physicians and patients

  • Completion of an online quality improvement survey following the visit

  • Patients with cognitive issues, who are deaf, blind or hard of hearing, with limited technology literacy, do not have the required technology

  • Patients who require an interpreter

  • Logistic support for the physiatrist prior to telemedicine visits

  • Education and training for physiatrists so they are comfortable with telemedicine

  • Information provided to patients to complete the visit in a private location

Virtual Care for Health and Social Services
Technology for Gathering Information
Annis et al. (2020) [54] Remote Patient Monitoring and Patient Satisfaction
  • A monitoring program specific to COVID-19 that provided patients with information about COVID-19, symptom assessments and reminders about hygiene and social distancing

  • A survey on patient satisfaction with the program was administered following the completion of treatment

• Having enough staff to match to newly enrolled patients and respond to messages
  • Improving the system to allow for mass messaging to patients and tools to measure patients coming into and out of the program

  • Improving the process of enrolling patients

Virtual Care for Health and Social Services
Technology for Gathering Information
Mercadante et al. (2020) [49] WhatsApp for clinical rounds • The use of WhatsApp (mobile messaging app) to involve family members in clinical rounds during visitor restrictions • No access to a smartphone • Ensuring the availability of/ access to technology Virtual Care for Connecting with Families and Caregivers
Ekzayez et al. (2020) [36] Communication and information dissemination
  • A volunteer campaign aiming to raise awareness, share information, identify high-risk individuals and connect community members to campaign resources

  • Social media (WhatsApp and Facebook) was used to stay connected and share information

NR NR Technology for Sharing Information
Hu and Qiu (2020) [42] Information sharing • The use of online-based channels to share information about the pandemic and to respond to the publics’ concerns NR
  • Sharing timely and accessible information through trusted sources

  • Combatting rumors and misinformation with transparent information

  • Sharing information internationally

Technology for Sharing Information
Chen et al. (2020) [60] Sina Weibo account ‘Healthy China’ • The use of Sina Weibo (social media platform) for communicating information and engaging with its followers NR NR Technology for Sharing Information
Kullar et al. (2020) [59] Twitter • The use of Twitter (social media platform) as a tool for communicating with providers and the public to share information about infectious diseases NR NR Technology for Sharing Information
Technology for Creating Connections
Meinert et al. (2020) [33] 1. Digital Health Solution
  1. An app for older adults to maintain social interactions during physical distancing

  2. Qualitative and quantitative feedback on user experience through in-app surveys, interviews and virtual focus groups

  3. Virtual interviews with participants to receive feedback on the app to integrate into future iterations

NR
  • Learning how to make the best use of resources, people and ideas

  • Identifying what has worked for service delivery and embedding them in future care

Technology for Creating Connections
2. User experience (qualitative and quantitative)
3. User feedback and integration
Edvardsson et al. (2020) [55] Letters and technology for socialization
  • Receiving letters from children to remain engaged with the community

  • Using technology (email, social media, etc.) to maintain social relationships

NR
  • Differentiate positive and negative outcomes and experiences

  • Instrumentation should be sensitive to the life-stage of the targeted individual

Technology for Creating Connections
Griffin et al. (2020) [44] Communicating with families • The use of video conferencing to connect the care team or patients with family members • Fragmented communication with families NR Technology for Creating Connections
Sirotich et al. (2020) [34] Survey development and dissemination • Development and distribution of a COVID-19 Patient Experience survey in consultation with a steering committee, patient partners and patient organization representatives NR NR Technology for Gathering Information
Wei et al. (2020) [38] Self-help Intervention
  • An internet-based, self-help intervention that integrates training on breath relaxation, mindfulness, refuge skills and the butterfly hug method

  • The impact on depression and anxiety was measured

NR NR Technology for Gathering Information
Brown et al. (2020) [57] Survey • An electronic or telephone questionnaire about anxiety around COVID-19 and canceled operations, the patients’ disease state and socioeconomic concerns • Limited number of patient responses NR Technology for Gathering Information
Amir-Behghadami et al. (2020) [39] Self-screening Tool • A national, electronic, self-screening tool for Iranian residents to log information and complete questions about COVID-19 symptoms and other chronic diseases NR • Public education about the consequences of COVID-19 can contribute to the involvement in self-screening Technology for Gathering Information
Hart et al. (2020) [40] Framework for supporting family-centred care • A framework of strategies for maintaining family-centred care when physical distancing measures are in place • Family unavailable during daytime hours, no access to internet or devices with videoconferencing capability, lack of technology literacy, inability to speak the same language as the clinical team, lack of communication aids (glasses, hearing aids) NR Engagement for Service Improvements / Recommendations
Yassa et al. (2020) [47] Survey • A survey to understand pregnant women’s knowledge, attitudes and concerns towards COVID-19, with the goal of developing targeted messages • Illiteracy, challenges with translation NR Engagement for Service Improvements / Recommendations
Padala et al. (2020) [50] Survey • A survey to identify participant perspectives on safety, panic among the public and how the medical centre is handing the pandemic NR NR Engagement for Service Improvements / Recommendations
Dokken and Ahmann (2020) [61] Person-Centered Guidelines for Preserving Family Presence in Challenging Times • The virtual development of guidelines for maintaining person and family centred care during difficult times (i.e. a pandemic) NR NR Engagement for Service Improvements / Recommendations

Abbreviations: NR = not reported; HIV = human immunodeficiency virus

Engagement through virtual care

The primary type of patient engagement was through virtual care, with two sub-categories of engagement activities: (a) virtual care for health and/or social services (n = 13) [35, 37, 41, 43, 45, 46, 48, 5154, 56, 58] and (b) virtual care for connecting with families and caregivers, including their involvement in care team discussions (n = 3) [35, 48, 49].

Virtual care for health and social services

Virtual care was primarily used for clinical services, inclusive of both health and social care (e.g. consultations, care conferences, home monitoring, remote appointments/check-ups) [35, 37, 41, 43, 45, 46, 48, 5154, 56, 58]. Virtual visits and consultations extended beyond medical care to include social services [35, 37, 43, 48]. For example, healthcare providers and care coordinators at a HIV clinic in the United States used telemedicine to consult with patients, check on their medication supply, help set up technology (answer questions) and ensure food and housing security during COVID-19 [37].

In light of the COVID-19 pandemic, many healthcare organizations and institutions transitioned from in-person appointments to online platforms (i.e. telemedicine/ telehealth). This transition and increased use of telemedicine to encourage virtual interactions between healthcare providers and patients was described in several included articles [41, 46, 56, 58]. For example, from March 2020 to April 2020, telemedicine visits (telephone and video) at one institution increased from fewer than 100 visits per day to greater than 2,200 visits per day [56]. A number of platforms were used for providing virtual clinical services, with one article describing appropriate platforms on which to engage with patients (e.g. Skype for Business/ Microsoft Teams, Updox, Zoom for Healthcare, Doxy.me, Google G Suite Hangouts Meet, Cisco Webex Meetings/Webex Teams, Amazon Chime, GoToMeeting, Spruce Health Care Messenger) [56]. Further, authors reflected on the potential benefits of telemedicine for patients, including: the ability to reach more patients (i.e. rural, international, low-socioeconomic status) and improved access (eliminating parking, public transit, etc.) [37, 51, 56, 58].

Feedback on virtual care services was also obtained from patients and healthcare providers (examples combining virtual care for clinical services and technology for gathering information [41, 54]. For example, a quality improvement initiative received feedback from patients (n = 119) and physicians (n = 14) on the rapid implementation of telemedicine (via InTouch or Zoom) on a physical medicine and rehabilitation department in the United States [41]. Patients were engaged through telemedicine and follow-up surveys to identify their demographic characteristics (age, gender, insurance status, travel time saved), telemedicine details and characteristics (accompanied by family/friend, type, reason and time of visit) overall experiences (developing a treatment plan, communication, convenience, discussing concerns/questions, satisfaction) and future value. The majority of patients (>90%) rated their telemedicine experience as good or very good across the experience measures and most believed it would be valuable to complete a future telemedicine visit.

Virtual care for connecting with families and caregivers

Virtual care was also used to connect healthcare providers or patients with family members and caregivers during healthcare interactions [35, 48, 49]. WhatsApp, Zoom, FaceTime and MyChart (online tool combining Epic and Zoom) were the main platforms for connecting. Despite visitor restrictions, these platforms gave family members the opportunity to be involved in clinical rounds [35, 49] and remain socially connected with patients while they were in hospital [48]. One study explored family members’ of palliative patients (n = 16) thoughts and experiences with the use of WhatsApp for sharing information on the patients’ progress [49]. Overall, family members were happy to virtually attend clinical rounds, receive and exchange information during the call and see their loved one. However, participants also noted that the virtual connection did not replace their physical presence. Technology-based solutions allowed for improved communication and connection between healthcare providers and patients or family members, but the importance of providing clear communication about COVID-19 and self-isolation, addressing patients concerns’ and demonstrating compassion throughout the pandemic were also highlighted [35].

Engagement through other technology

Patient engagement activities through the use of other technology (e.g. social media, online-based interventions) were identified as a way of sharing information (n = 4) [36, 42, 59, 60], creating connections (n = 4) [33, 44, 55, 59] and gathering information (n = 6) [34, 38, 39, 41, 54, 57].

Technology for sharing information

The use of technology for engaging patients and the community through information sharing was identified in four articles [36, 42, 59, 60]. Information was shared through online platforms, including social media (e.g. Twitter, Sina Weibo). Online-based channels were used in China to share information about the pandemic, improve risk communication and community engagement practices, and respond to the publics’ concerns [42]. The importance of sharing information through the communities’ trusted sources, combatting rumors early by disclosing up-to-date information and ensuring information was accessible and comprehensible to the public was noted by the authors. Twitter was also used as a communication tool for healthcare providers and the general public to share information about infectious diseases [59]. Twitter chats and hashtags were discussed as valuable tools for both engaging with, and disseminating information to, other professionals and the public. During COVID-19, the authors explained the importance of Twitter for remaining up-to-date on the state of the pandemic and relevant literature being published, while ensuring credible resources were followed (@WHO, @CDCgov, @IDSAInfo). A combination of social media platforms (e.g. Facebook, WhatsApp) was also used by a volunteer campaign in Syria, Volunteers Against Corona, to effectively communicate, stay connected and share information about COVID-19 [36].

Technology for creating connections

Patient engagement activities using technology (digital health solutions, email, teleconferencing) for creating or maintaining social connections were identified in four articles [33, 44, 55, 59]. The importance of maintaining person-centred care, which included promoting communication between patients, families and healthcare providers and limiting relationship and social restrictions during the pandemic was discussed in two articles [44, 55]. Residents at a rural healthcare facility in Australia remained socially engaged with their family and friends through the use of email and social media [55].

Another paper described a future mixed methods case study which aims to develop an app for older adults, their families and peers to enhance their overall health and well-being during social distancing measures due to COVID-19 [33]. This digital health solution, Activating Digital to Support Social Distancing COVID-19 Aware Family Engagement (ADAPT-CAFÉ), will allow families and peers to remain in contact with older adults (in the community or in hospital) through virtual interactions. The app will also integrate goal setting, promote good nutrition and physical activity and track symptoms. During beta phase testing of the app, qualitative interviews will be conducted with participants and their feedback will be integrated in future iterations of the app, reflecting an example of co-design.

Technology for gathering information

Patient engagement activities using technology for gathering information (experiences, satisfaction, knowledge, attitudes, concerns, health outcomes) were identified in six articles [34, 38, 39, 41, 54, 57]. These activities included survey development and/or completion, self-screening and a self-help intervention.

The use of surveys to gain information and insights about participants’ knowledge, attitudes, concerns, health outcomes and overall experiences (with their condition, care or engagement in activities) was identified in a number of articles [34, 38, 41, 54, 57]. These articles involved patients as partners in research activities (responding to surveys and participating in randomized controlled trials). There were few examples of activities that involved patients in multiple aspects of a research project; however an example of greater involvement was a global patient experience survey for individuals with rheumatic disease that was launched to identify patients’ concerns with the disease and treatment and the impact of COVID-19 on their physical and mental health [34]. This survey was developed through rapid engagement of patients with rheumatic disease, patient organizations and rheumatologists. Patients were involved in all stages of the research, from study design to dissemination of the survey (i.e. development of research questions, study design, measuring instruments; participating in recruitment and the steering committee; and writing of the manuscript). Their main responsibilities included providing input on the content of the survey questions, reviewing the survey questions for culturally appropriate language and translating the survey into different languages. Involvement was facilitated through the use of an online messaging and collaboration tool. Sirotich and colleagues described a process for, and the benefits of, the rapid engagement of multiple stakeholders in order to address a complex problem.

Engagement for service improvements/recommendations

Few articles (n = 4) involved patients as partners as part of the development of guidelines or service improvements [40, 47, 50, 61]. Two of the included articles conducted surveys to inform the design of services [47, 50]. A cross-sectional study was conducted by Yassa and colleagues (2020) in Turkey to understand pregnant women’s knowledge, attitudes and concerns towards COVID-19, with the goal of developing targeted counselling and messages during the pandemic [47]. Based on the findings from the survey, the authors noted the importance of providing education, mental health support and counseling to pregnant women during the COVID-19 pandemic; however, no specific programs or services had been designed at the time of our scoping review.

Additionally, two articles developed frameworks to ensure family support/ family-centred care during the pandemic [40, 61]. The “Person-Centred Guidelines for Preserving Family Presence in Challenging Times” (pg 1) [61] was created in virtual consultation with over 60 organizations, inclusive of patients, caregivers, advocates, clinicians and policy-makers. The guidelines were developed for healthcare leaders and health authorities and are intended to be applied across different contexts, including resource-challenged settings and among vulnerable populations. The goal of the guidelines is to balance individual needs with safety and community needs, support the principles of person-centred care across the continuum, keep patients and families connected through continual assessments, minimize risks and isolation, communicate expectations and policies clearly, support social connections, educate patients and families on discharge processes and partner with families. Some specific examples include keeping a digital diary of the patients’ ICU experience (to help fill in the gaps for patients and families about what happened during hospital stay and to minimize stress when discharged home) and redeploying staff, volunteers or medical students to act as “connectors” between patients and families, who might be separated (due to hospital stay), particularly if there is no technology available.

Factors impacting patient engagement

Just under half of the included articles (n = 13) described technological barriers or individual patient characteristics that impacted organizations’ ability to engage with patients and families [37, 40, 41, 44, 4749, 51, 53, 54, 5658]. The most common technological barriers to engaging with patients were: technology that did not support video conferencing, limited technology literacy among those engaging with it (usually patients and families), lack of comfort using technology for medical visits and slow or poor internet connection [37, 40, 41, 49, 51, 56, 58]. Individuals with cognitive, vision or hearing impairments, limited decision-making capacity or who required an interpreter to speak with their care provider created challenges for virtual engagement [40, 41, 47, 53]. The lack of patient access to a smart phone or internet, as well as the providers’ inability to read nonverbal cues and body language represented additional barriers to virtual care [40, 41, 48, 49, 51].

Lessons learned through patient engagement

Despite many challenges to engaging with patients and families during COVID-19, several articles also reflected on lessons learned [33, 37, 39, 4143, 49, 5356, 58]. There was an identified need for more team-based models and approaches to virtual care and telehealth [37, 41, 43]. Authors explained that virtual care should reflect the care an individual would receive in person, so if a patient would be supported by a multidisciplinary team at an in-person clinic, they should receive the same level of support virtually [37]. The need for training prior to engaging in virtual care and telehealth was identified to ensure providers, patients and families were comfortable using the platform before participating in live sessions [41, 56]. Lastly, the responses to providing care differently (i.e. virtually) during COVID-19 should be used as an example for future disasters, that limit in-person care contact [53, 58]. Successful response strategies to maintain patient engagement during COVID-19 should be referred to and used as guidance if future disruptions were to occur [53].

Discussion

To our knowledge, this scoping review was the first to examine what is known in the literature about patient engagement activities during the COVID-19 pandemic. Our findings showed a delineation between tools to support patients and caregivers in receipt of care interactions (most articles) and partnership activities in the design of care (few articles). Partnership activities like co-designing a new care delivery pathway or participating in decision making tables is how engagement is more traditionally defined. However, we took at broad view on engagement, in line with Carman’s framework, to include direct care consultations, allowing us to capture the various ways in which health systems stayed connected to patients and families during the pandemic.

Based on Carman’s continuum, the majority of published literature at the time of our scoping review was centered on activities at the level of direct care (e.g. consultations, care conferences, home monitoring, remote appointments/check-ups) [21]. In some cases, the focus of these consultations was not just on medical care needs, but on social determinants of health and ability to self-manage (perhaps due to heightened acknowledgement of social needs amidst the pandemic). Many organizations were incorporating virtual visits into their practice prior to the pandemic. Virtual care and telehealth were emerging in certain fields to target specific population groups, but these technologies were often resisted by organizations because of worries around privacy and security [62], with concerns about ownership of data, authorization of unspecified use and data security noted as reasons for the lack of large-scale uptake [63]. In spite of these concerns, it is possible that COVID-19 presented a window of opportunity for this work to be pushed forward and adopted at a rapid pace, as many Health Insurance Portability and Accountability Act (HIPAA) private health information confidentiality violations were waived during the pandemic to allow for the use of non-encrypted technologies for virtual care [64].

We also saw some examples of broader community engagement, also through use of technology, to not only share information, but to create a space for the community to connect, ask questions or share concerns [42, 55, 59]. Given the short time window of our scoping review, it is not surprising that individual engagement such as virtual consultations and home monitoring were implemented and published more quickly compared to other levels of engagement along Carman’s continuum (e.g. partners in organizational governance and policy change) [21]. Changes to organization governance and policies often require more time, effort and resources. Overall, it is possible that the pandemic created the space, context and opportunity to quickly push forward and transition to a more virtual environment, which is reflected in the literature. A virtual environment is important for facilitating both individual interactions and patient partnership.

While it may seem that virtual care and the use of technology for providing health and social services do not reflect active patient engagement, such activities allow for capacity building and can incorporate models of shared decision-making, goal setting and patient autonomy in directing their own care. As such, these activities demonstrate a more active form of engagement and highlight how partnership may occur during virtual and direct care activities. However, it was not always clear in the included articles if these more active forms of direct care engagement were used.

Some initiatives did signify a deeper form of engagement by way of bi-directional information sharing (providing feedback to improve services and programs), as well as virtually connecting families to be part of clinical consultations due to visitor restrictions, similar to what we would see in activities such as bedside rounding [65]. Furthermore, and perhaps most promising, was the involvement of multiple stakeholders (patients, clients and patient organizations) in a virtual environment in the design of a global patient experience survey for individuals with rheumatic disease, showing the potential of engagement during a crisis across all stages of the research cycle [34].

This scoping review highlighted the rapid transition to a virtual environment, through the use of online platforms, social media and telehealth. Almost all of the included articles used technology, in one form or another, to engage with patients and families during COVID-19, with virtual care being the most common (n = 13). Virtual care and the use of technology for patient engagement activities can open doors and increase opportunities for involvement [66, 67]. For example, accessibility, continuity of care, cost effectiveness, health outcomes, satisfaction and attention to equity (in terms of access and patients’ social, cultural and health needs being addressed) were highlighted as potential benefits of virtual care in a rapid review conducted by Li and colleagues (2020) [66]. Similarly, a literature review of telehealth in rural Australia identified several benefits, including: lower costs, improved convenience accessing services and specialists and improved quality of services [67].

On the other hand, virtual care and technology use may also close doors and limit involvement from certain individuals and population groups in both clinical care interactions and, by extension, from patients and families involved in partnership activities (e.g., decision making tables, co-design activities). As identified in this review, engagement was impacted by poor internet connection, lack of technology or technology that did not support video conferencing and an individual’s lack of knowledge or comfort using technology [37, 40, 41, 49, 51, 56, 58]. Many of these challenges with telehealth and virtual care have been echoed in the literature [66, 6870]. Bandwidth issues and access to devices have been noted to negatively impact the ability to engage virtually, as well as an individual’s overall experience [70, 71]. In addition to technology-related barriers to engagement, this review highlighted that individual level factors (i.e. health literacy, socioeconomic status) can also negatively impact virtual interactions, and as such, an individual’s opportunity to engage in activities when they are technology-based [40, 41, 47, 53]. Social and economic factors have been noted to create challenges for virtual visits, as mental health issues and low levels of health literacy can impede conversations between healthcare professionals and patients [68]. Persons who are older, non-English speaking, unemployed, low income, live in rural areas or are a racial/ethnic minority (African American, Latino, Japanese, Chinese, Filipino, South Asian) can also experience a divide from virtual care [69]. Furthermore, the use of virtual care and technology has the potential to increase opportunities for involvement (for patients both in clinical care interactions and partnership activities), but it may also hinder them. It is critical to better understand how to ensure involvement is not limited or restricted when transitioning to online platforms. The “Person-Centred Guidelines for Preserving Family Presence in Challenging Times” report recognized that technology is not always an option for people and included examples of non-technology based ways to connect (through volunteers, medical students, etc.) who act as connectors between patients and families. This connector role could also serve as the interface between patients, caregivers and other stakeholders.

The challenges related to virtual care engagement (language, health literacy, socio-economic status) parallel the kinds of barriers noted in patient engagement activities generally [72, 73]. For example, Chegini and colleagues conducted a qualitative study in which low levels of health literacy, cultural barriers, ineffective patient education and patient unwillingness were identified as patient-related barriers impacting engagement in the safe delivery of care in hospital [72]. Since this scoping review pointed to equity challenges in engaging in virtual care it will be important to place emphasis on addressing these barriers as we move into the COVID-19 recovery period. Further, equity challenges in participating in patient engagement activities extend beyond virtual care and can occur along the continuum of engagement; thus highlighting the importance of applying a health equity lens to engagement, which is reflexive, intersectional and trauma-informed [74].

In using Carman’s framework as a guide, we identified several limitations that could be addressed in future work. Despite having three levels of engagement across a continuum of three categories, we identified challenges categorizing direct care level engagement activities. This was based on a limited ability to highlight differences in these activities. For example, the majority of patient engagement activities were categorized at the direct care level, as consultation or involvement. However, we identified a number of differences in these engagement activities that were lost with this categorization and we were able to create a more nuanced set of categories, many of which fit under the umbrella of direct are activities. Based on the purposes of this review, it was important to highlight these nuances and differences in the engagement activities, which is why we conducted a more in-depth analysis following the categorization according to the framework. Additionally, Carman et al.’s definition of patient engagement involves an active partnership between patients, families, representatives and health professionals; however, the levels of engagement along the framework continuum do not all include active partnership [21]. It is important for the definition and framework to present consistent information to eliminate confusion around the classification of activities as patient engagement. Overall, this framework served as a fundamental starting point from which we adapted to better reflect the nuances discovered in our scoping review.

Future work

Based on the findings from this scoping review, several areas of future work have been identified. There is a need for more original research on all patient engagement activities (clinical care interactions and partnership activities) occurring during the pandemic to better describe engagement work from different perspectives, as well as exposure factors related to success. For example, research evaluating the use of technology for other types of patient engagement (i.e., advisory committees, planning and decision-making activities), exploring the perspectives of patients, families, providers and researchers regarding engagement activities during COVID-19 and gaining a better understanding of how organizations transitioned to maintain patient engagement. It is critical to understand strategies that have worked, or not worked, to allow organizations to continue patient engagement activities. The findings of this scoping review may imply that other types of engagement activities (e.g., partnering in organizational design and governance, policy decisions) were not occurring as much as individual level engagement, but it is highly likely that our results were more a reflection that this work, and the learning that can be gained from it, may not yet be published. However, it is important to explore this area further to identify if (and why) partnership activities at the organizational level came to a halt during the initial stages of the pandemic and beyond. Understanding the structures and processes that allow for engagement activities to continue during times of major disruption is critical for improving patient engagement activities and overall experiences. Environmental scans, original qualitative research and case studies, for example, are recommended methods for capturing these other, organizational level forms of engagement and is the next phase of work being conducted by our team. Additionally, as the focus of this scoping review was on patient engagement activities occurring during the first six months of the pandemic, it is important to explore if, and how, engagement approaches have evolved over the course of the pandemic. Lastly, there is a need to explore if, and how, patients, caregivers and families can remain involved in engagement activities without relying solely on technology.

Limitations

There are a few limitations to be noted. First, based on the rapid publication of COVID-related research and topics, it is possible that relevant articles were missed because of the state of indexing. Second, our search was conducted in English, so it is possible that articles published in other languages were missed. Third, based on the current state of the literature, with many of the included articles being editorials and commentaries that lacked contextual information, we did not conduct a critical appraisal of the quality of the articles. However, this is not a requirement for scoping reviews [27]. Lastly, we acknowledge that this review is not reflective of all the patient engagement work that is being done during COVID-19, as there is the potential that engagement is occurring on different platforms or other levels of engagement that take longer to implement have not yet been written about or published. For example, while we included articles that used social media for engagement, we did not specifically search social media (Twitter, Facebook, Sina Weibo, etc.) for posts related to engagement. Despite these limitations, this review presents a summary of the work that was implemented and published during the first six months of the pandemic.

Conclusions

This scoping review identified a number of examples of how healthcare systems stayed connected to patients and families during the pandemic. Though we had exclusively looked for examples of patient engagement activities, we found few examples of patient partnership and more examples of direct care consultations via technology as well as broader community engagement for purposes of sharing and receiving information related to the pandemic. Other research methods to explore specific contexts and initiatives (e.g., qualitative investigations or case studies) may better unpack the full spectrum of patient engagement activities that occurred during the pandemic and give greater insight into the barriers and facilitators of sustaining these activities.

Supporting information

S1 Table. MEDLINE search strategy.

(DOCX)

S2 Table. Preferred reporting items for systematic reviews and meta-analyses extension for scoping reviews (PRISMA-ScR) checklist.

(DOCX)

Acknowledgments

The authors would like to thank the librarian at Trillium Health Partners (Antonia Giannarakos) for her guidance on the search strategy. We would also like to thank Dr. Alison Freeland, Sandy Dayes, Shiza Sheikh and Aditi Desai from Trillium Health Partners and Dr. Carol Fancott, Julie Drury and Jessie Checkley from Healthcare Excellence Canada for their ongoing support throughout the project. The findings and reflections in this paper do not necessarily reflect the views of our Collaborators and Funders.

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

This paper was funded by the Canadian Foundation for Health Care Improvement. Dr. Kerry Kuluski holds the Dr. Mathias Gysler Research Chair in Patient and Family Centred Care at the Institute for Better Health, Trillium Health Partners. The funding for this Chair, supported by the Trillium Health Partners Foundation, was used to support Dr. Kuluski’s time in leading the study reported in this paper.

References

  • 1.World Health Organization. Rolling updates on coronavirus disease (COVID-19): World Health Organization; 2020. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/events-as-they-happen.
  • 2.World Health Organization. Coronavirus disease (COVID-19) pandemic: World Health Organization; 2020. https://www.who.int/emergencies/diseases/novel-coronavirus-2019.
  • 3.Jones L, Palumbo D, Brown D. Coronavirus: A visual guide to the economic impact United Kingdom: BBC News; 2020. https://www.bbc.com/news/business-51706225.
  • 4.Azevedo JoP, Hasan A, Goldemberg D, Iqbal SA, Geven K. Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates: The World Bank; 2020. 61 p.
  • 5.Becker E. How hard will the coronavirus hit the travel industry? United States: National Geographic; 2020. https://www.nationalgeographic.com/travel/2020/04/how-coronavirus-is-impacting-the-travel-industry/.
  • 6.Government of Canada. How the coronavirus disease (COVID-19) is affecting immigration, refugees, citizenship and passport services Canada: Government of Canada; 2020. https://www.canada.ca/en/immigration-refugees-citizenship/services/coronavirus-covid19.html.
  • 7.Zambrano-Monserrate MA, Ruano MA, Sanchez-Alcalde L. Indirect effects of COVID-19 on the environment. Science of The Total Environment. 2020;728:138813. doi: 10.1016/j.scitotenv.2020.138813 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Rocca R. Coronavirus: Toronto-area hospitals implement no visitor policies Toronto, Canada: Global News; 2020. https://globalnews.ca/news/6712594/coronavirus-toronto-hospitals-no-visitors/.
  • 9.Coronavirus: Hospitals across southern England impose visitor restrictions England: BBC News; 2020. https://www.bbc.com/news/uk-england-51962793.
  • 10.Hafner K. ‘A Heart-Wrenching Thing’: Hospital Bans on Visits Devastate Families United States: The New York Times; 2020. https://www.nytimes.com/2020/03/29/health/coronavirus-hospital-visit-ban.html.
  • 11.MacCharles T. All non-COVID19 research and clinical trials at hospitals suspended or cancelled due to funding crunch Ontario, Canada: The Star; 2020. https://www.thestar.com/news/canada/2020/04/10/all-non-covid19-research-and-clinical-trials-at-hospitals-suspended-or-cancelled-due-to-funding-crunch.html.
  • 12.Institute for Patient-and-Family-Centered Care. PFCC and COVID-19 Virginia, USA: Institute for Patient- and Family-Centered Care; 2020 [May 18, 2021]. https://www.ipfcc.org/bestpractices/covid-19/index.html.
  • 13.Richards T, Scowcroft H. Patient and public involvement in COVID-19 policy making. BMJ. 2020;370:m2575. doi: 10.1136/bmj.m2575 [DOI] [PubMed] [Google Scholar]
  • 14.Berwick DM, Feeley D, Loehrer S. Change from the inside out: health care leaders taking the helm. JAMA. 2015;313(17):1707–8. Epub 2015/03/27. doi: 10.1001/jama.2015.2830 [DOI] [PubMed] [Google Scholar]
  • 15.Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff (Millwood). 2008;27(3):759–69. Epub 2008/05/14. [DOI] [PubMed] [Google Scholar]
  • 16.Baker GR, Judd M, Fancott C. Creating ‘Engagement-Capable Environments’ in Healthcare. In: Baker MJaCM G.R., editor. Patient Engagement: Catalyzing Improvement and Innovation in Healthcare Toronto, Ontario: Longwoods Publishing Company; 2016. p. 11–34. [Google Scholar]
  • 17.Estabrooks CA. Engagement-Capable Environments—No Less Challenging than other Large System Changes. Healthc Pap. 2017;17(2):40–5. Epub 2018/03/30. doi: 10.12927/hcpap.2017.25411 . [DOI] [PubMed] [Google Scholar]
  • 18.Fancott C, Baker GR, Judd M, Humphrey A, Morin A. Supporting Patient and Family Engagement for Healthcare Improvement: Reflections on "Engagement-Capable Environments" in Pan-Canadian Learning Collaboratives. Healthcare quarterly (Toronto, Ont). 2018;21(SP):12–30. Epub 2018/12/20. doi: 10.12927/hcq.2018.25642 . [DOI] [PubMed] [Google Scholar]
  • 19.Rowland P, Brosseau M, Houle C. Patient Roles in Engagement-Capable Environments: Multiple Perspectives. Healthcare quarterly (Toronto, Ont). 2018;21(SP):45–9. Epub 2018/12/20. doi: 10.12927/hcq.2018.25639 . [DOI] [PubMed] [Google Scholar]
  • 20.Health Quality Ontario. Ontario’s Patient Engagement Framework: Creating a strong culture of patient engagement to support high quality health care. Toronto, Canada: Health Quality Ontario, 2017. [Google Scholar]
  • 21.Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient And Family Engagement: A Framework For Understanding The Elements And Developing Interventions And Policies. Health Affairs. 2013;32(2):223–31. doi: 10.1377/hlthaff.2012.1133 [DOI] [PubMed] [Google Scholar]
  • 22.World Health Organization. What are integrated people-centred health services? Geneva, Switzerland: World Health Organization; nd [cited 2020 April 13]. https://www.who.int/servicedeliverysafety/areas/people-centred-care/ipchs-what/en/. [Google Scholar]
  • 23.Kuluski K, Nelson MLA, Tracy CS, Alloway CA, Shorrock C, Shearkhani S, et al. Experience of Care as a Critical Component of Health System Performance Measurement: Recommendations for Moving Forward. Healthc Pap. 2017;17(2):8–20. doi: 10.12927/hcpap.2017.25415 . [DOI] [PubMed] [Google Scholar]
  • 24.World Health Organization. Patient Engagement: Technical Series on Safer Primary Care. Geneva: Department of Service Delivery and Safety, World Health Organization, 2016. [Google Scholar]
  • 25.Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(1):143. doi: 10.1186/s12874-018-0611-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implementation science: IS. 2010;5:69. doi: 10.1186/1748-5908-5-69. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and ExplanationThe PRISMA-ScR Statement. Ann Intern Med. 2018;169(7):467–73. doi: 10.7326/M18-0850 [DOI] [PubMed] [Google Scholar]
  • 28.Medical Library Association. COVID-19 Literature Searches: Medical Library Association; 2020. https://www.mlanet.org/p/cm/ld/fid=1713.
  • 29.Chen Q, Allot A, Lu Z. Keep up with the latest coronavirus research. Nature. 2020;579(7798):193. Epub 2020/03/12. doi: 10.1038/d41586-020-00694-1. [DOI] [PubMed] [Google Scholar]
  • 30.Bramer WM, Giustini D, de Jonge GB, Holland L, Bekhuis T. De-duplication of database search results for systematic reviews in EndNote. J Med Libr Assoc. 2016;104(3):240–3. doi: 10.3163/1536-5050.104.3.014 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Babineau J. Product review: Covidence (systematic review software). JCHLA / JABSC. 2014;35(2):68–71. doi: 10.5596/c14-016 [DOI] [Google Scholar]
  • 32.Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qualitative health research. 2005;15(9):1277–88. Epub 2005/10/06. doi: 10.1177/1049732305276687 . [DOI] [PubMed] [Google Scholar]
  • 33.Meinert E, Milne-Ives M, Surodina S, Lam C. Agile Requirements Engineering and Software Planning for a Digital Health Platform to Engage the Effects of Isolation Caused by Social Distancing: Case Study. JMIR Public Health Surveill. 2020. doi: 10.2196/19297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Sirotich E, Dillingham S, Grainger R, Hausmann JS. Capturing patient-reported outcomes during the COVID-19 pandemic: Development of the COVID-19 Global Rheumatology Alliance Patient Experience Survey. Arthritis care & research. 2020. 10.1002/acr.24257. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Overton J, Denton K, Frumovitz M, Lewis C, Christensen S, Bezerra J, et al. Coronavirus (COVID-19): Patient experience-Administrative services on the frontline during crisis. Head & neck. 2020. 10.1002/hed.26259. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Ekzayez A, Al-Khalil M, Jasiem M, Al Saleh R, Alzoubi Z, Meagher K, et al. COVID-19 response in northwest Syria: innovation and community engagement in a complex conflict. J Public Health (Oxf). 2020. doi: 10.1093/pubmed/fdaa068. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Mgbako O, Miller EH, Santoro AF, Remien RH, Shalev N, Olender S, et al. COVID-19, Telemedicine, and Patient Empowerment in HIV Care and Research. AIDS and behavior. 2020. 10.1007/s10461-020-02926-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Wei N, Huang BC, Lu SJ, Hu JB, Zhou XY, Hu CC, et al. Efficacy of internet-based integrated intervention on depression and anxiety symptoms in patients with COVID-19. Journal of Zhejiang University Science B. 2020;21(5):400–4. 10.1631/jzus.B2010013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Amir-Behghadami M, Gholizadeh M. Electronic Screening System through Community Engagement: A National Strategic Plan to Find COVID-19 Patients and Reduce Clinical Intervention Delays. Infect Control Hosp Epidemiol. 2020. doi: 10.1017/ice.2020.188. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Hart JL, Turnbull AE, Oppenheim IM, Courtright KR. Family-Centered Care During the COVID-19 Era. Journal of pain and symptom management. 2020. 10.1016/j.jpainsymman.2020.04.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Tenforde AS, Iaccarino MA, Borgstrom H, Hefner JE, Silver J, Ahmed M, et al. Feasibility and High Quality Measured in the Rapid Expansion of Telemedicine During COVID-19 for Sports and Musculoskeletal Medicine Practice. PM & R: the journal of injury, function, and rehabilitation. 2020. 10.1002/pmrj.12422. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Hu G, Qiu W. From guidance to practice: Promoting risk communication and community engagement for prevention and control of coronavirus disease (COVID-19) outbreak in China. J Evid Based Med. 2020. doi: 10.1111/jebm.12387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Medina M, Babiuch C, Card M, Gavrilescu R, Zafirau W, Boose E, et al. Home monitoring for COVID-19. Cleveland Clinic journal of medicine. 2020. 10.3949/ccjm.87a.ccc028. [DOI] [PubMed] [Google Scholar]
  • 44.Griffin KM, Karas MG, Ivascu NS, Lief L. Hospital Preparedness for COVID-19: A Practical Guide from a Critical Care Perspective. American journal of respiratory and critical care medicine. 2020. 10.1164/rccm.202004-1037CP. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Japan ECMOnet for COVID-19. Japan ECMOnet for COVID-19: Telephone consultations for cases with severe respiratory failure caused by COVID-19. Journal of intensive care. 2020;8(1):24. 10.1186/s40560-020-00440-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Murphy H. Managing Diabetes in Pregnancy before, during and after COVID-19. Diabetes Technology & Therapeutics. 2020. 10.1089/dia.2020.0223. [DOI] [PubMed] [Google Scholar]
  • 47.Yassa M, Birol P, Yirmibes C, Usta C, Haydar A, Yassa A, et al. Near-term pregnant women’s attitude toward, concern about and knowledge of the COVID-19 pandemic. The Journal of Maternal-Fetal & Neonatal Medicine. 2020:1–8. 10.1080/14767058.2020.1763947. [DOI] [PubMed] [Google Scholar]
  • 48.Kreimer S. Neuropalliative Care During COVID-19—Addressing Isolation, Fear, and Terminal Illness. Neurology Today. 2020;20(11):1–22. doi: 10.1097/01.NT.0000672408.48923.f9 [DOI] [Google Scholar]
  • 49.Mercadante S, Adile C, Ferrera P, Giuliana F, Terruso L, Piccione T. Palliative Care in the Time of COVID-19. Journal of pain and symptom management. 2020. 10.1016/j.jpainsymman.2020.04.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Padala PR, Jendro AM, Gauss CH, Orr LC, Dean KT, Wilson KB, et al. Participant and Caregiver Perspectives on Clinical Research During Covid-19 Pandemic. Journal of the American Geriatrics Society. 2020. 10.1111/jgs.16500. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Peahl AF, Smith RD, Moniz MH. Prenatal Care Redesign: Creating Flexible Maternity Care Models Through Virtual Care. American journal of obstetrics and gynecology. 2020. 10.1016/j.ajog.2020.05.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Fortune C, Gietzen A, Guillot G, Lewis N, Nielsen K, Richard M, et al. Protocol for a partially nested randomised controlled trial to evaluate the effectiveness of the scleroderma patient-centered intervention network COVID-19 home-isolation activities together (SPIN-CHAT) program to reduce anxiety among at-risk scleroderma patients. J Psychosom Res. 2020. doi: 10.1016/j.jpsychores.2020.110132. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Patel PD, Cobb J, Wright D, Turer R, Jordan T, Humphrey A, et al. Rapid Development of Telehealth Capabilities within Pediatric Patient Portal Infrastructure for COVID-19 Care: Barriers, Solutions, Results. Journal of the American Medical Informatics Association: JAMIA. 2020. 10.1093/jamia/ocaa065. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Annis T, Pleasants S, Hultman G, Lindemann E, Thompson JA, Billecke S, et al. Rapid Implementation of a COVID-19 Remote Patient Monitoring Program. Journal of the American Medical Informatics Association: JAMIA. 2020. 10.1093/jamia/ocaa097. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Edvardsson D, Baxter R, Birkett P, Dunlop A. Supporting lives lived whilst protecting lives saved during COVID-19. Nordic Journal of Nursing Research. 2020;40(2):61–3. [Google Scholar]
  • 56.Contreras CM, Metzger GA, Beane JD, Dedhia PH, Ejaz A, Pawlik TM. Telemedicine: Patient-Provider Clinical Engagement During the COVID-19 Pandemic and Beyond. Journal of gastrointestinal surgery: official journal of the Society for Surgery of the Alimentary Tract. 2020. 10.1007/s11605-020-04623-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Brown TS, Bedard NA, Rojas EO, Anthony CA, Schwarzkopf R, Barnes CL, et al. The Effect of the COVID-19 Pandemic on Electively Scheduled Hip and Knee Arthroplasty Patients in the United States. Journal of Arthroplasty. 2020. 10.1016/j.arth.2020.04.052. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Peters AL, Garg S. The Silver Lining to COVID-19: Avoiding Diabetic Ketoacidosis Admissions with Telehealth. Diabetes Technology & Therapeutics. 2020. 10.1089/dia.2020.0187. [DOI] [PubMed] [Google Scholar]
  • 59.Kullar R, Goff DA, Gauthier TP, Smith TC. To Tweet or Not to Tweet-a Review of the Viral Power of Twitter for Infectious Diseases. Current Infectious Disease Reports. 2020;22(6):14. 10.1007/s11908-020-00723-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Chen Q, Min C, Zhang W, Wang G, Ma X, Evans R. Unpacking the black box: How to promote citizen engagement through government social media during the COVID-19 crisis. Comput Human Behav. 2020. doi: 10.1016/j.chb.2020.106380. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Dokken DAE. Family Presence During Challenging Times. Pediatric nursing. 2020;46(4):161–2. [Google Scholar]
  • 62.Hall JL, McGraw D. For Telehealth To Succeed, Privacy And Security Risks Must Be Identified And Addressed. Health Affairs. 2014;33(2):216–21. doi: 10.1377/hlthaff.2013.0997 [DOI] [PubMed] [Google Scholar]
  • 63.Hardcastle L, Ogbogu U. Virtual care: Enhancing access or harming care? Healthcare Management Forum. 2020;33(6):288–92. doi: 10.1177/0840470420938818 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Centers for Medicare and Medicaid Services. Medicare telemedicine healthcare provider fact sheet: Medicare coverage and payment of virtual services Maryland, United States: US Centers for Medicare & Medicaid Services; 2020. https://www.cms.gov/newsroom/fact-sheets/medicare-telemedicine-health-care-provider-fact-sheet.
  • 65.Fowler B, Johns J, Tanniru M, Ballijepally V, Roumani Y, Bobryk D, et al. Engaging patients through Multi-Disciplinary Rounding–The case study at a Michigan hospital. Journal of Hospital Administration. 2018;7:17. doi: 10.5430/jha.v7n5p17 [DOI] [Google Scholar]
  • 66.Li J, Roerig M, Saragosa M, Carbone S, Abdelhalim R, Jamieson M, et al. Virtual Primary Care in Northern, Rural and Remote Canada. Toronto, Canada: North American Observatory on Health Systems and Policies, 202026. [Google Scholar]
  • 67.Moffatt JJ, Eley DS. The reported benefits of telehealth for rural Australians %J Australian Health Review. 2010;34(3):276–81. [DOI] [PubMed] [Google Scholar]
  • 68.Glauser W. Virtual care is here to stay, but major challenges remain. Canadian Medical Association Journal. 2020;192(30):E868. doi: 10.1503/cmaj.1095884 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Nguyen A, Mosadeghi S, Almario CV. Persistent digital divide in access to and use of the Internet as a resource for health information: Results from a California population-based study. International Journal of Medical Informatics. 2017;103:49–54. doi: 10.1016/j.ijmedinf.2017.04.008 [DOI] [PubMed] [Google Scholar]
  • 70.Horner L. The Challenges and Benefits of Implementing Virtual Care New Jersey, United States: Inside Digital Health; 2018. https://www.idigitalhealth.com/news/the-challenges-and-benefits-of-implementing-virtual-care.
  • 71.Ipsos MORI, York Health Economics Consortium, Salisbury C. Evaluation of Babylon GP at hand: Final evaluation report. London, United Kingdom: Ipsos MORI Social Research Institute, 2019.
  • 72.Chegini Z, Janati A, Babaie J, Pouraghaei M. Exploring the barriers to patient engagement in the delivery of safe care in Iranian hospitals: A qualitative study. Nurs Open. 2019;7(1):457–65. doi: 10.1002/nop2.411 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, et al. Patient engagement in research: a systematic review. BMC Health Services Research. 2014;14(1):89. doi: 10.1186/1472-6963-14-89 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Roche P, Shimmin C, Hickes S, Khan M, Sherzoi O, Wicklund E, et al. Valuing All Voices: refining a trauma-informed, intersectional and critical reflexive framework for patient engagement in health research using a qualitative descriptive approach. Research involvement and engagement. 2020;6:42. Epub 2020/07/24. doi: 10.1186/s40900-020-00217-2. [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Mariusz Duplaga

6 May 2021

PONE-D-20-38436

A scoping review of patient engagement activities during COVID-19: More consultation than partnership

PLOS ONE

Dear Dr. Kuluski,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please ensure that you efficiently respond to the reservations raised by the reviewers, especially the reviewer No 2. The issues raised are well defined and rather serious; without providing relevant amendments and extensions, I do not think you paper can be proceeded further.

Please submit your revised manuscript by Jun 20 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Mariusz Duplaga, Ph.D., M.D., Ass. Prof.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

3. In the manuscript title page, it is not clear with which organisation 'Patient Partner, Canada' is affiliated.

Please amend your list of authors in the manuscript to ensure that each author is linked to an affiliation. Authors’ affiliations should reflect the institution where the work was done (if authors moved subsequently, you can also list the new affiliation stating “current affiliation:….” as necessary).

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This study aimed to determine what has been done in terms of patient engagement activities during the COVID-19 pandemic. The authors collected over 700 articles, performed screening, and selected 29 suitable articles for content analysis. The study identified 4 major topics related to patient engagement, and found that the majority of patient engagement activities were direct care consultation rather than patient partnership.

Patient engagement is a promising area in the field of health care education. Having patients articulate their experiences and viewpoints helps those taking part in training to appreciate the patient perspective and the importance of preserving trust between clinicians and patients. Thus, studying patient engagement activities during this COVID-19 pandemic may provide valuable insights to medical practitioners, patients and even the government to better prepare for future crises.

The analyses were carefully performed and the manuscript was well-written. Only some minor issues to be addressed:

On page 13, line 185, "Four main categories were identified: (1) Engagement through Virtual Care; (2) Engagement through Other Technology; (3) Engagement for Service Improvements/Recommendations; and (4) Factors Impacting Patient Engagement." How were the four categories derived? Were there more than 4 categories that were considered before the "4 main" were selected? Some better explanations could have given to how these four were identified.

I understand each of the n represents an article, but for some of the n's, it was unclear whether they overlapped.

For example, on page 23, line 282-284, "Patient engagement activities through the use of other technology (e.g. social media, online-based interventions) were identified as a way of sharing information (n=4), creating connections (n=4) and gathering information (n=6)."

Did the n's came from different articles or the same articles? Since these subcategories are not mutually exclusive, does that mean the apparent 15 (4+4+6) articles of "Engagement through Other Technology" could have actually just came from 6 articles?

The same question applies to the n's for "Engagement through Virtual Care" section.

The result that there were more consultations than patient partnerships seems to be rather within expectations. It is also unclear to me what the significance of this means. If the author believe that it is an interesting result, please explain why. The author should also better justify why this is an important finding, and more clearly spell out the significance of it.

Reviewer #2: Thank you for the opportunity to review this manuscript which aimed to scope Covid-19 related patient engagement activities in health care during the early Covid pandemic period. Overall the manuscript was easy to follow, although I identified a number of conceptual and methodological gaps which I feel should be addressed to strengthen the project prior to publication.

Conceptually, I identified multiple issues:

1) the project is framed on the question of the importance of understanding, what, if any, patient engagement activities occurred during the pandemic. However, the authors have not sufficiently conveyed an argument about WHY this is an important question to answer. What are the implications of answering this question?

2) I’m also questioning to some extent the relevance of a review of peer-reviewed literature to search for Patient engagement in healthcare during covid-19, because the peer reviewed literature is academic in focus and I’m uncertain about the extent to which academic studies on delivery of healthcare would accurately represent the extent of patient engagement in care delivery. Even the grey literature search relied to some extent on a publication of some sort, and given the rapid evolution of the pandemic and strain on healthcare systems during this time, I’m not sure that published evidence is a reliable source to answer this particular question of interest.

3) The project is also framed around engagement of patients, families and caregivers in health care delivery and health care systems, and uses Carman et al’s definition and framework to guide this work. While I appreciated the attempt to use this framework as an overarching approach, I had a number of concerns with how it played out over the project, leading me to question its appropriateness for this analysis. First, by the authors’ admissions, components of the framework are at odds with the definition, whereby the stated definition of patient engagement emphasizes active partnership at various levels, but then goes on to also include passive forms of engagement within the framework as well. This proves problematic when the results of the scoping review are weighed so heavily towards the most passive types of engagement in covid-19 that I seriously question if we should be considering these as meaningful categories of engagement at all—to me virtual care delivery is simply that, and doesn’t in and of itself meet the bar for qualifying as engagement.

Methodologically, there are also several major issues:

1) The authors have not convinced me that they conducted an in-depth thematic analysis. Details of the methods are not at all described (one vague sentence only with no reference provided), and it seems to me to be closer to content analysis (debatable if conventional or directed content analysis). I recommend the authors add significantly more detail enhance the methodological coherence of the project.

2) The date range for analysis appears rather arbitrary, identified as “first stage of covid-19” and bounded between March 2020 and July 2020, without any substantive consideration of what that means. Also given that the search is almost a year old, this ties back to my earlier question of wanting to better justify why studying this particular period is important, given that we have arguably come a long way since then. Or if an update is possible, it would be perhaps of more use to compare if engagement approaches evolved over the pandemic.

Specific comments:

- Title emphases engagement activities during covid-19, but it would be more accurate to convey that its about PE activities about covid-19 as well, as it does not appear the review was looking for any engagement during the pandemic. This could be clarified throughout the manuscript.

- Basic covid-19 statistics in the opening paragraph should be updated as these are now out-of-date

- Please reference the statement on line 75-78: “At each level, there is a continuum of engagement from consultation, to involvement, to partnership and shared leadership. Each stage of the continuum involves increased participation and collaboration from those being engaged, as they progress from passive information sharing to active partnership in the development and evaluation of healthcare programs and policies”.

- Please reference the statement on line 88-89 that: “many patient and family advisory committees, at least in the Canadian context, were put on hold.”

- Within the research question, “ What is known in the literature about work that has been done internationally within healthcare, government and academic organizations on patient engagement during the COVID-19 pandemic?” I am unclear about the relevance about asking about patient engagement within academic organizations as this seems incongruent with the stated project focus on healthcare delivery, and ties back to some of my other identified issues.

- The results section reads less as a synthesis of findings and more as a narrative description of each of the included studies. This needs to be reworked.

- In light of my other comments, I do not follow all of the categories identified—and again, these feel like domain summaries, not themes. “Engagement through virtual care”- as noted I question delivery of care as engagement in the way it was presented in the introduction. The sub-headings and categories are not clearly explained so the organizational structure is difficult to follow. There are also cross-cutting themes that are not highlighted—such as the use of technology for connection—both through virtual care and beyond. Lessons learned are distinct from patient-reported barriers and facilitators, and I think this should be emphasized.

- In the discussion, the comment “Our findings showed a delineation between tools to support patients and caregivers in receipt of care interactions (most articles) and partnership activities in the design of care (few articles).” Is helpful, although engagement hasn’t been framed in this way at all to this point in the paper, this would be helpful to the reader much earlier in the introduction.

- In light of my comments, the discussion requires a significant revision. There is much focus on virtual care, but not much reflection or critical discussion about whether use of technology in itself constitutes engagement. Is this just merely a new mode of engagement? Virtual vs in person? Is the mode the critical aspect of engagement we are concerned with?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Sep 29;16(9):e0257880. doi: 10.1371/journal.pone.0257880.r002

Author response to Decision Letter 0


2 Jul 2021

Please note: all references to page and line numbers correspond to the track changed version of the manuscript.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

The manuscript meets all of the journal’s style requirements.

PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

The corresponding author has an ORCID ID and it is validated in Editorial Manager.

In the manuscript title page, it is not clear with which organisation 'Patient Partner, Canada' is affiliated.

Please amend your list of authors in the manuscript to ensure that each author is linked to an affiliation. Authors’ affiliations should reflect the institution where the work was done (if authors moved subsequently, you can also list the new affiliation stating “current affiliation:….” as necessary).

The author is a patient partner who contributed to both the project and manuscript and is not affiliated with a specific institution.

Reviewer 1:

This study aimed to determine what has been done in terms of patient engagement activities during the COVID-19 pandemic. The authors collected over 700 articles, performed screening, and selected 29 suitable articles for content analysis. The study identified 4 major topics related to patient engagement, and found that the majority of patient engagement activities were direct care consultation rather than patient partnership.

Patient engagement is a promising area in the field of health care education. Having patients articulate their experiences and viewpoints helps those taking part in training to appreciate the patient perspective and the importance of preserving trust between clinicians and patients. Thus, studying patient engagement activities during this COVID-19 pandemic may provide valuable insights to medical practitioners, patients and even the government to better prepare for future crises.

The analyses were carefully performed and the manuscript was well-written. Only some minor issues to be addressed:

Thank you for this comment.

On page 13, line 185, "Four main categories were identified: (1) Engagement through Virtual Care; (2) Engagement through Other Technology; (3) Engagement for Service Improvements/Recommendations; and (4) Factors Impacting Patient Engagement." How were the four categories derived? Were there more than 4 categories that were considered before the "4 main" were selected? Some better explanations could have given to how these four were identified.

We have added additional information to better explain how the four categories were developed. See pages 10-11, lines 215-222.

I understand each of the n represents an article, but for some of the n's, it was unclear whether they overlapped.

For example, on page 23, line 282-284, "Patient engagement activities through the use of other technology (e.g. social media, online-based interventions) were identified as a way of sharing information (n=4), creating connections (n=4) and gathering information (n=6)."

Did the n's came from different articles or the same articles? Since these subcategories are not mutually exclusive, does that mean the apparent 15 (4+4+6) articles of "Engagement through Other Technology" could have actually just came from 6 articles?

There was very minimal crossover of articles between subcategories, it was more common for there to be crossover in the main categories (e.g. virtual care and service improvement). We have added the references in the opening paragraphs for each of the categories/sub categories to help clarify this and show where any crossover occurred. See page 26, lines 358-360.

The same question applies to the n's for "Engagement through Virtual Care" section.

There was very minimal crossover of articles between subcategories, it was more common for there to be crossover in the main categories (e.g. virtual care and service improvement). We have added the references in the opening paragraphs for each of the categories/sub categories to help clarify this and show where any crossover occurred. See page 22, lines 250-253.

The result that there were more consultations than patient partnerships seems to be rather [unclear?] within expectations. It is also unclear to me what the significance of this means. If the author believe that it is an interesting result, please explain why. The author should also better justify why this is an important finding, and more clearly spell out the significance of it.

The result that there were more consultations than patient partnerships was not surprising to us, given the focus of the review was on activities during the first six months after the pandemic was declared. We believe that the pandemic created a platform that accelerated the focus and work around virtual care (see discussion page 33, line 519). This allowed patients and families to stay connected to providers, as well as the healthcare system more broadly; however, with the focus on virtual consultations, there were minimal examples of other forms of engagement along the continuum (partnership and shared leadership). The lack of engagement activities in these areas represents an area of future work to further explore. We have added this information to future work, see pages 39, lines 646-651.

Reviewer 2:

Thank you for the opportunity to review this manuscript which aimed to scope Covid-19 related patient engagement activities in health care during the early Covid pandemic period. Overall the manuscript was easy to follow, although I identified a number of conceptual and methodological gaps which I feel should be addressed to strengthen the project prior to publication.

Thank you for your comments.

Conceptually, I identified multiple issues:

1) the project is framed on the question of the importance of understanding, what, if any, patient engagement activities occurred during the pandemic. However, the authors have not sufficiently conveyed an argument about WHY this is an important question to answer. What are the implications of answering this question?

Thank you for this comment, we have significantly revised the introduction to better convey why it is important to understand patient engagement activities occurring during the pandemic. See pages 6-7, lines 127-133.

2) I’m also questioning to some extent the relevance of a review of peer-reviewed literature to search for Patient engagement in healthcare during covid-19, because the peer reviewed literature is academic in focus and I’m uncertain about the extent to which academic studies on delivery of healthcare would accurately represent the extent of patient engagement in care delivery. Even the grey literature search relied to some extent on a publication of some sort, and given the rapid evolution of the pandemic and strain on healthcare systems during this time, I’m not sure that published evidence is a reliable source to answer this particular question of interest.

We do acknowledge that a scoping review may not capture all of the patient engagement activities occurring during the first six months of the pandemic (noted in the limitations section); however, this approach is one way to synthesize evidence and was appropriate for identifying the extent and types of available evidence pertaining to this topic. By not limiting the review to peer-reviewed literature, we were able to identify additional patient engagement activities through the grey literature searches. A scoping review approach also allowed for us to scan international literature.

3) The project is also framed around engagement of patients, families and caregivers in health care delivery and health care systems, and uses Carman et al’s definition and framework to guide this work. While I appreciated the attempt to use this framework as an overarching approach, I had a number of concerns with how it played out over the project, leading me to question its appropriateness for this analysis. First, by the authors’ admissions, components of the framework are at odds with the definition, whereby the stated definition of patient engagement emphasizes active partnership at various levels, but then goes on to also include passive forms of engagement within the framework as well. This proves problematic when the results of the scoping review are weighed so heavily towards the most passive types of engagement in covid-19 that I seriously question if we should be considering these as meaningful categories of engagement at all—to me virtual care delivery is simply that, and doesn’t in and of itself meet the bar for qualifying as engagement.

This framework allowed us to identify both active and passive types of patient engagement. In doing so, we were able to categorize a variety of activities that were occurring to keep patients and families connected to the healthcare system. While we acknowledge that there was a disconnect between the definition (active) and the framework (active and passive), we think it was important to highlight all types of activities occurring along the continuum, in order to identify current gaps and where more work is needed. Our results weighed more heavily towards the more passive types of engagement because that was the state of the literature; however, it is important to note that other examples of more “authentic engagement” have also been highlighted. By using this framework, we were able to add to, and further, our conceptual understanding of patient engagement.

Methodologically, there are also several major issues:

1) The authors have not convinced me that they conducted an in-depth thematic analysis. Details of the methods are not at all described (one vague sentence only with no reference provided), and it seems to me to be closer to content analysis (debatable if conventional or directed content analysis). I recommend the authors add significantly more detail enhance the methodological coherence of the project.

We appreciate this comment and agree that our analysis approach aligns with conventional content analysis. We have added additional information and a reference about the analysis process in order to enhance the methodological coherence. See page 10, lines 213-220.

2) The date range for analysis appears rather arbitrary, identified as “first stage of covid-19” and bounded between March 2020 and July 2020, without any substantive consideration of what that means. Also given that the search is almost a year old, this ties back to my earlier question of wanting to better justify why studying this particular period is important, given that we have arguably come a long way since then. Or if an update is possible, it would be perhaps of more use to compare if engagement approaches evolved over the pandemic.

We appreciate this comment and have added information to better describe the timeframe in which this review is bounded (see page 9, lines 179-181). We have focused this review on the first 6 months after the pandemic was declared in order to gain a deeper understanding of the initial shift of activities. We agree with the comment that we have come a long way since the beginning of the pandemic and do think it is important to see how patient engagement has evolved over this time; however, since that is beyond the scope of this review, we have noted it as an area of future work (see pages 39-40, lines 653-656). We are also in the process of conducting case studies that will further explore patient engagement activities during the pandemic and how they have evolved over time.

Specific comments:

- Title emphases engagement activities during covid-19, but it would be more accurate to convey that its about PE activities about covid-19 as well, as it does not appear the review was looking for any engagement during the pandemic. This could be clarified throughout the manuscript.

We did not limit engagement activities to activities about COVID-19, despite the majority being specific to the pandemic. We have added some information to the methods and to the results to clarify that engagement activities did not have to be specific to COVID-19 for inclusion. See page 9, lines 177-179 and page 15, lines 244-245.

- Basic covid-19 statistics in the opening paragraph should be updated as these are now out-of-date

The COVID-19 statistics in the opening paragraph have been updated. See page 4, line 62-63.

- Please reference the statement on line 75-78: “At each level, there is a continuum of engagement from consultation, to involvement, to partnership and shared leadership. Each stage of the continuum involves increased participation and collaboration from those being engaged, as they progress from passive information sharing to active partnership in the development and evaluation of healthcare programs and policies”.

We have added a reference for this statement.

- Please reference the statement on line 88-89 that: “many patient and family advisory committees, at least in the Canadian context, were put on hold.”

We have added a reference for this statement.

- Within the research question, “What is known in the literature about work that has been done internationally within healthcare, government and academic organizations on patient engagement during the COVID-19 pandemic?” I am unclear about the relevance about asking about patient engagement within academic organizations as this seems incongruent with the stated project focus on healthcare delivery, and ties back to some of my other identified issues.

We had included academic organizations in the research question to ensure university-affiliated activities (within the healthcare context) were not excluded; however, we do understand how this may create confusion, so we have removed academic organizations from the research question (as the focus was on healthcare delivery and staying connected to the healthcare system).

- The results section reads less as a synthesis of findings and more as a narrative description of each of the included studies. This needs to be reworked.

Thank you for this comment; we have significantly revised the results to be more of a synthesis and reduce the narrative descriptions of the included studies. See pages 22-32.

- In light of my other comments, I do not follow all of the categories identified—and again, these feel like domain summaries, not themes. “Engagement through virtual care”- as noted I question delivery of care as engagement in the way it was presented in the introduction. The sub-headings and categories are not clearly explained so the organizational structure is difficult to follow. There are also cross-cutting themes that are not highlighted—such as the use of technology for connection—both through virtual care and beyond. Lessons learned are distinct from patient-reported barriers and facilitators, and I think this should be emphasized.

We have revised the analysis section of the methods to describe the process as a content analysis and thus, the sections of the results are frame as categories, rather than themes. We have also created a figure to help display the categories and sub-categories. Cross-cutting examples are highlighted in the Virtual Care for Clinical Service category (Tenforde and Annis references). We have added a line to explicitly state this. We have added a category to separate lessons learned from barriers and facilitators (see page 32, line 486).

- In the discussion, the comment “Our findings showed a delineation between tools to support patients and caregivers in receipt of care interactions (most articles) and partnership activities in the design of care (few articles).” Is helpful, although engagement hasn’t been framed in this way at all to this point in the paper, this would be helpful to the reader much earlier in the introduction.

We have added some detail in the introduction in order to better frame engagement and help orient readers that the review will include both active and passive patient engagement activities. See page 5, lines 88-106.

- In light of my comments, the discussion requires a significant revision. There is much focus on virtual care, but not much reflection or critical discussion about whether use of technology in itself constitutes engagement. Is this just merely a new mode of engagement? Virtual vs in person? Is the mode the critical aspect of engagement we are concerned with?

We appreciate this comment and have revised the discussion to include a paragraph that is more critical about what constitutes patient engagement. See page 34, lines 535-541.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Mariusz Duplaga

28 Jul 2021

PONE-D-20-38436R1

A scoping review of patient engagement activities during COVID-19: More consultation, less partnership

PLOS ONE

Dear Dr. Kuluski,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please consider the comments of the Reviewer 2 and try implement suggested amendments.

Please submit your revised manuscript by Sep 11 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Mariusz Duplaga, Ph.D., M.D., Ass. Prof.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: Thank you to the authors for reflecting on my feedback and revising the manuscript. I have only a few outstanding comments.

On further reflection, I realized that nowhere in the manuscript is the concept of engagement defined. Adding a definition in the introduction would increase clarity for readers. Also, could the authors please explain in the methods how engagement was determined—did papers self-identify as engagement and use the terminology, or did the reviewers identify engagement based on a comparison of their definition to reported descriptions in the included manuscripts? These points have implications for the interpretation of the findings, particularly in to the more superficial types of engagement in patient care noted by the authors.

I struggled with the statements in the study selection section around context. given publishing timelines, would it not be more relevant to clarify if the engagement activities occurred during the pandemic? Presumably would many studies published in early 2020 actually be reporting on issues/ activities from before the pandemic? I’m unclear how this was determined.

The organization and headings in table 2 are confusing to me. “Challenges” and “Lessons Learned” are not characteristics of strategies. Also, “Engagement category” column is reporting sub-categories. All told this table doesn’t align with the text reporting of results and is difficult to follow.

The revisions to the reporting of the findings through categories was generally helpful. However on further reflection, I question whether the sub-category “technology for sharing information” should be categorized as engagement, as this really seems to me to better align with classic definitions of dissemination of information and one way transmission of communication. Based on the descriptions provided, there is no evidence of any interaction, therefore I’m not sure it should be called engagement. This is also why adding definitions to clarify what the authors mean by engagement would be helpful here.

The statement on line 78-81, “While these examples refer to more ‘active’ forms of engagement, activities can be more broad in nature, ranging -- from clinical consultations to partnership activities (advisory groups and participation in policy decision making)” is important and requires a reference.

There are some incorrect references that need to be cleaned up (e.g. 21).

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Sep 29;16(9):e0257880. doi: 10.1371/journal.pone.0257880.r004

Author response to Decision Letter 1


29 Jul 2021

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Response: We have reviewed the reference list to ensure that it is complete and correct.

Reviewer #1: No response required

Reviewer #2: Thank you to the authors for reflecting on my feedback and revising the manuscript. I have only a few outstanding comments.

On further reflection, I realized that nowhere in the manuscript is the concept of engagement defined. Adding a definition in the introduction would increase clarity for readers. Also, could the authors please explain in the methods how engagement was determined—did papers self-identify as engagement and use the terminology, or did the reviewers identify engagement based on a comparison of their definition to reported descriptions in the included manuscripts? These points have implications for the interpretation of the findings, particularly in to the more superficial types of engagement in patient care noted by the authors.

Response: Thank you for noting this. Engagement was described, but we have re-integrated the definition in the introduction to increase clarity for the readers. Please refer to the Study Selection section of the methods for the explanation of how engagement was determined. The described activity had to align with at least one of the three core levels of engagement (along the continuum) as outlined in Carman and colleagues’ framework for patient and family engagement.

I struggled with the statements in the study selection section around context. given publishing timelines, would it not be more relevant to clarify if the engagement activities occurred during the pandemic? Presumably would many studies published in early 2020 actually be reporting on issues/ activities from before the pandemic? I’m unclear how this was determined.

Response: Please refer to our first inclusion criteria in the Study Selection section of the methods. Articles were required to be specific to COVID-19. So, while it is possible for studies published in early 2020 to be reporting on activities from before the pandemic, for this review, we required the articles to be specific to the context of the pandemic. If articles did not clearly state that the engagement activity was occurring during the pandemic, then it was excluded.

The organization and headings in table 2 are confusing to me. “Challenges” and “Lessons Learned” are not characteristics of strategies. Also, “Engagement category” column is reporting sub-categories. All told this table doesn’t align with the text reporting of results and is difficult to follow.

Response: We have changed the title of Table 2 to ‘Characteristics of patient engagement activities’ to reduce potential confusion around the challenges and lessons learned columns. These columns are specific to the context of the activities and provide important contextual information. We have revised the “Engagement Category” column heading to reflect what is reported. We have reorganized the table to better align with the text presentation of the results.

The revisions to the reporting of the findings through categories was generally helpful. However on further reflection, I question whether the sub-category “technology for sharing information” should be categorized as engagement, as this really seems to me to better align with classic definitions of dissemination of information and one way transmission of communication. Based on the descriptions provided, there is no evidence of any interaction, therefore I’m not sure it should be called engagement. This is also why adding definitions to clarify what the authors mean by engagement would be helpful here.

Response: We appreciate this comment and acknowledge that the use of technology for sharing information may be more of a one way transmission of communication. However, based on Carman and colleagues’ framework for patient and family engagement that was used to categorize engagement activities in this scoping review, these types of activities occur along the continuum of engagement and thus, we chose to include them. Please refer to the introduction for the definition of patient engagement, as well as an explanation of the framework used for conceptualizing and categorizing the engagement activities.

The statement on line 78-81, “While these examples refer to more ‘active’ forms of engagement, activities can be more broad in nature, ranging -- from clinical consultations to partnership activities (advisory groups and participation in policy decision making)” is important and requires a reference.

Response: We have added a reference to this statement.

There are some incorrect references that need to be cleaned up (e.g. 21).

Response: We have corrected the one invalid reference.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Mariusz Duplaga

14 Sep 2021

A scoping review of patient engagement activities during COVID-19: More consultation, less partnership

PONE-D-20-38436R2

Dear Dr. Kuluski,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Lucinda Shen, MSc

Staff Editor

on behalf of 

Mariusz Duplaga, Ph.D, M.D

Additional Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Mariusz Duplaga

20 Sep 2021

PONE-D-20-38436R2

A Scoping Review of Patient Engagement Activities during COVID-19: More Consultation, Less Partnership

Dear Dr. Kuluski:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Mariusz Duplaga

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. MEDLINE search strategy.

    (DOCX)

    S2 Table. Preferred reporting items for systematic reviews and meta-analyses extension for scoping reviews (PRISMA-ScR) checklist.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES