Abstract
The COVID-19 pandemic has resulted in reduced access to in-person mental health services, and a shift to virtual platforms. Youth may be uniquely impacted by physical distancing requirements during the pandemic, including limited socialization opportunities, closures of educational institutions, a lack of meaningful extracurricular activities and adverse implications on key developmental milestones. Due to the potential impact of COVID-19 on youth well-being, the need to rapidly transform services to be accessible, and the potential risks associated with this rapid transformation, it is imperative that youth continue to be engaged in research and service development. Young people’s perspectives, strengths and skills need to be considered to effectively adapt the delivery of mental health services. Continuing to center youth engagement in mental health research throughout the pandemic can ensure research questions, programs, and services align with the needs and preferences of youth. In this commentary, we pose three recommendations for conducting youth-engaged mental health research during the pandemic, including adapting youth engagement strategies when rapid decisions must be made, the use of tools for virtual engagement, and suggestions for evaluating youth engagement practices. These strategies and principles may be applicable to other scenarios where rapid research or system transformation would benefit from youth engagement, such as time-limited child research by trainees (e.g., dissertations) or natural disasters.
Key Words: youth engagement, mental health, COVID-19, rapid research
Résumé
La pandémie de la COVID-19 a entraîné un accès réduit aux services de santé mentale en personne, et une transition aux plateformes virtuelles. Les jeunes peuvent être particulièrement touchés par les consignes de distanciation physique durant la pandémie, notamment par les occasions limitées de socialisation, la fermeture des institutions éducatives, le manque d’activités parascolaires et les implications néfastes sur les principales étapes du développement. Étant donné l’impact potentiel de la COVID-19 sur le bien-être des jeunes, le besoin de transformer rapidement les services pour les rendre accessibles, et les risques potentiels associés à cette transformation rapide, il est impératif que les jeunes continuent de participer à la recherche et au développement des services. Les perspectives, les forces et les talents des jeunes gens doivent être pris en considération afin d’adapter efficacement la prestation des services de santé mentale. Continuer d’axer la participation des jeunes dans la recherche en santé mentale durant la pandémie peut faire en sorte que les questions, les programmes et les services de la recherche correspondent aux besoins et aux préférences des jeunes. Dans le présent commentaire, nous énonçons trois recommandations pour mener une recherche en santé mentale avec la participation des jeunes durant la pandémie, notamment adapter les stratégies de participation des jeunes lorsqu’il faut prendre des décisions rapidement, l’utilisation des outils de participation virtuelle, et des suggestions pour évaluer les pratiques de participation des jeunes. Ces stratégies et principes peuvent s’appliquer à d’autres scénarios quand la recherche rapide ou la transformation du système bénéficierait de la participation des jeunes, comme la recherche sur les enfants en temps limité par les stagiaires (p. ex., dissertation) ou des catastrophes naturelles.
Mots clés: participation des jeunes, santé mentale, COVID-19, recherche rapide
Background
Youth mental health service delivery has been affected by the rapid response of mental health systems to continue operations during COVID-19 (Young Minds, 2020). The global pandemic has led to reduced access to many non-essential services, including in-person outpatient mental health services, and a shift to virtual platforms (Ibrahim, 2020; Katapally & Kwabia, 2020; Smith & de Laplante, 2020). A recent Canadian commentary noted the COVID-19 pandemic has resulted in increased stress within households, with those who undergo quarantine being at risk for anxiety, depression, insomnia, and anger (Vigo et al., 2020). With closures of educational institutions and the need to maintain physical distancing, socialization is limited for young people. Pre-existing mood and anxiety disorders among youth may be exacerbated as a result of the pandemic with the loss of extracurricular activities and social interactions which typically provide structure and meaning (Courtney et al., 2020). While research on the impact of COVID-19 on intimate partner violence is scarce, community organizations reported a surge in cases related to interpersonal violence in the wake of the pandemic (Smith, 2020; Taub, 2020). In addition, stressors associated with caregiving, supervising educational activities and working from home amidst coping with economic and social losses may contribute to challenging family dynamics and increased risk of emotional consequences of COVID-19 on youth (Courtney et al., 2020). The aforementioned issues highlight the potential risks to youth well-being during lockdown. These factors may have important implications for how mental health services are delivered to youth and families, and how researchers engage youth in research during COVID-19.
Young people’s unique perspectives, strengths and skills need to be considered to effectively adapt the delivery of mental health services in light of the pandemic, especially given the potential implications of COVID-19 on youth mental health. There are risks associated with rapidly transformed services being misaligned with the needs of service users, including treatment disengagement and/or worsening mental health. Youth engagement (YE) in mental health research is a critical component of participatory research methodologies, where decision-making is shared between researchers and participants. We propose YE in mental health research remain a priority throughout COVID-19 to ensure research questions, programs and services align with the needs of those with lived experience.
Meaningful YE during COVID-19 should consider the level of engagement that is feasible when rapid decisions must be made and when social distancing measures are in place. Several frameworks, guidelines and models have been developed to operationalize YE practices in mental health research (Darnay et al., 2019; Heffernan et al., 2017; Henderson, Hawke, & Relihan, 2018; Iyer, Boksa, & Joober, 2019). The principles of valuing youth’s experiential knowledge, engaging in reciprocal learning and respecting the diversity of their opinions are critical to fostering an environment of meaningful YE (Hawke et al., 2018). We propose, however, that adaptations to existing YE frameworks are needed when social distancing practices are imposed, and rapid decisions must be made. In the context of COVID-19, new pressures are being placed on mental health researchers to identify innovative solutions for working with families. Rapid response funding initiatives may present challenges for researchers wishing to engage youth in mental health research (e.g., time to recruit youth partners). In this commentary, we pose recommendations for adapting YE strategies in response to COVID-19, the use of tools for virtual engagement, and suggestions for evaluating YE practices during the pandemic.
Recommendation #1: Adapt YE strategies when rapid decisions must be made during the pandemic
When the mental health system requires that rapid changes are needed in response to the pandemic, YE processes require adaptation. YE is defined as “the meaningful participation, and sustained involvement, of a young person in an activity, with a focus outside of him or herself” (Centre of Excellence for Youth Engagement, n.d., p. 1), with opportunities for decision-making, growth and leadership. YE typically takes place over an extended period of time, allowing for relationship-building and development of trust on an ongoing basis (Children and Youth Planning Table, n.d.). It may be difficult, however, to form meaningful and sustained partnerships with youth unknown to research teams when decisions must be made rapidly. The feasibility of recruiting, training and mentoring youth who have not been involved in research in the context of rapid response grant projects should be considered. In order to address these barriers, we suggest leveraging connections with pre-existing advisory council members, or community or tertiary care organizations with whom youth already have long-term or continuous relationships. Once youth partners are identified, asking them about their availability and preferred methods for providing input on research projects and priorities (i.e., virtual group meetings, one-on-one phone calls, online surveys) is strongly recommended. Given that timelines for youth involvement in rapid response research projects may differ from traditional engagement opportunities, having transparent dialogue with youth partners from the outset about the specific phases in which feedback will be sought and the phases in which they would like to provide their input is imperative. For example, opportunities for large group meetings may be limited in the early stages of grant writing with tight deadlines, however, more sustained and consistent engagement may take place as the project evolves and moves into different stages. Thus, providing youth the option to complete online surveys/polls when group meetings are not possible is suggested. Lastly, we have found it helpful in our own research to openly acknowledge the challenges associated with YE practices when rapid decisions are needed, and the tensions we feel with reduced opportunities for in-person engagement. These efforts may serve to enhance transparency, honesty and trust among researchers and youth partners. Mobilizing youth with diverse experiences remains essential even when requiring rapid meaningful engagement or establishing new advisory groups under these circumstances. We recommend careful consideration be given to how youth participate, collaborate and share their voices in meaningful ways. Further details about traditional YE practices and additional considerations during COVID-19 are presented in Table 1.
Table 1.
Recommendation | Traditional Youth Engagement Strategies | Additional Considerations During COVID-19 |
---|---|---|
#1. Adapt youth engagement strategies when rapid decisions must be made during the pandemic |
|
|
#2. Use tools for engaging youth using virtual platforms |
|
|
#3. Measure the impact of rapid youth engagement |
|
|
PPEET = Patient and Public Engagement Evaluation Tool
Recommendation #2: Use tools for engaging youth using virtual platforms
While best practice guidelines suggest using in-person methods for engaging youth in research, some of these strategies may require alternative delivery formats, including virtual meetings or videoconferencing, during the pandemic. There are well-documented benefits associated with leveraging technology for YE: greater accessibility for youth, the ability to bring together youth from diverse geographic locations, less financial strain associated with travel, and flexibility in the timing of meetings (Children and Youth Planning Table, n.d.; Guan & Subrahmanyam, 2009; James et al., 2017; Meenagh, 2015; Wurtele & Kenny, 2016). Youth may be more willing to engage in research virtually during the pandemic, given the sense of belonging this forum may provide at a time when social isolation is common.
There are unique challenges for researchers and youth using virtual platforms in the context of a pandemic. For example, it may be difficult for youth to find private spaces to share their personal perspectives about their mental health journeys. Ethical challenges or risks to youth safety may surface when asking youth to share their stories online with researchers and/or other youth they have never met in person. Privacy and security of data captured using online or virtual platforms may be a concern. As such, protocols are needed to ensure youth who become distressed while involved in a virtual meeting are able to access timely and appropriate supports. Additionally, given the overarching sentiments of uncertainty and anxiety amongst Canadians during the pandemic, researchers should be prepared to encounter and facilitate challenging conversations amongst youth and their colleagues online.
Another issue in doing YE using virtual platforms is achieving equitable and fair representation. The pandemic has shown there continues to be a digital divide and unequal access to internet/technology, and so certain youth voices may be missing. Capturing a diversity of perspectives using online methods may be particularly challenging for underserved youth, including those without access to reliable internet, cell phones or computers. This means researchers may be missing the voices of some youth, or may obtain perspectives that are not representative of the population at large. Efforts to creatively recruit and hear the perspectives of youth, particularly those who may be low-income or experiencing homelessness should be considered, for example: subsidies for shared laptops/internet, recorders for youth to share their stories, honoraria for youth who have lost income during the pandemic, or socially distanced in-person gatherings where appropriate. Additionally, we recommend researchers budget for equipment related to YE using digital platforms.
Finally, given restrictions on in-person meetings during the pandemic, special precautions could be taken by researchers and youth to foster connection with each other during online engagement activities. We will present some recommendations based on our experiences having shifted all in-person consultations with youth partners to virtual meetings since the pandemic. Icebreaker activities, clear articulation of goals for engagement, timelines, and roles should be established early on in collaboration with youth. Leveraging extended functionality on video-chatting platforms like breakout rooms, polling and the whiteboard function can afford youth opportunities for sharing verbally and using text. In our experience, using activities which allow youth to interact with one another (i.e., small group discussions in breakout rooms) enhances feelings of connection among participants. Giving youth the option to offer feedback on resources and materials outside of virtual meeting times using shared platforms (i.e., Dropbox) should competing priorities impede their ability to attend group consultations is also suggested. Asynchronous communication between researchers and youth partners may also take place through platforms like Slack, Telegram, WhatsApp, Discord or Wire. Indeed smartphone messaging applications have been shown to be particularly effective for engaging with young and digitally fluent populations in research (Chen & Neo, 2019). Providing opportunities for ongoing involvement, mentorship and community-building activities beyond the “rapid” engagement phase may incentivize ongoing involvement with rapid response projects, given opportunities for networking and collaboration are valued by youth partners (Heffernan et al., 2017).
Recommendation #3: Measure the impact of rapid YE
Evaluation of rapid YE may need to be modified during the pandemic. Generally, evaluating engagement and research outcomes takes time and expertise of researchers to account for different evaluation methods (surveys, interviews, etc.). Within participatory research methods, it is important to consider not only the outcomes of the research, but the process and experience of engaging in the research, which can be especially meaningful for the youth involved. Evaluating YE in research can help to ensure consistency in the way that engagement principles are implemented, can provide feedback on what is or is not working, and hold researchers accountable to youth partners, funders, and the larger community who may benefit from research (Boivin et al., 2018).
YE in mental health research has been measured in various ways. Darnay et al. (2019) produced a YE guidebook, which recommends multiple evaluation methods, including quantitative and qualitative methods. Evaluation tools may need to be adapted for an online or blended (online/offline) setting. For example, the Public and Patient Engagement Evaluation Tool (PPEET; Abelson, Wilson, Shields, Schneider & Boesveld, 2016; Abelson, Humphrey, Syrowatka, Bidonde, & Judd, 2018) is a series of questionnaires used to evaluate patient and public engagement in health systems and research. Hamilton et al.’s (2018) Patient Engagement In Research Scale (PEIRS) is another example of an instrument which was co-designed with patient partners to assess the quality of patient engagement in research projects. Tools like PPEET or PEIRS can be useful in rapid research where it may not be feasible to develop new evaluation tools. For instance, when asking if youth partners had the necessary resources to participate, these instruments can identify possible technological barriers, and research teams could hope to proactively support with reducing technological barriers. Questions specific to the pandemic can also be integrated into existing evaluation tools. Given the importance of ensuring evaluation of research and participation, having readily available and accessible tools that can be adapted in the face of rapid research is essential. While some research teams are collaborating with patients to develop and validate tools which assess stakeholder engagement in research (Abelson, Tripp, Kandasamy, Burrows, & PPEET Implementation Study Team, 2019; Goodman, Ackermann, Bowen, & Thompson, 2019; Hamilton et al., 2018), Boivin et al. (2018) note patients and the public are rarely involved in the design of evaluation tools or reporting of results. Scholars have argued evaluation of YE should not be considered separate and youth should be actively involved in this aspect, just as they are in the rest of the research (Boivin et al., 2018). To ensure effective evaluation is encompassed within rapid research, we recommend integrating multiple forms of evidence, including quantitative and qualitative data, and ensuring youth are part of this process.
Specifically, we propose the need to compare youth satisfaction, experience of engagement, the number of youth partners involved, the methods used for engagement, the phases in which youth are involved in research and the timeline for engagement in pre- versus post-pandemic research projects. We also acknowledge the importance of developing best practice guidelines for evaluating virtual and rapid engagement initiatives in collaboration with youth. This paper is positioned as a call to action for researchers, funders and mental health providers to leverage their connections with young people and think critically about how our work and the burden on youth partners are changing in light of the pandemic. The use of open-ended questions, in particular, is suggested in order to better understand what engagement means and how it is operationalized during the pandemic from the youth perspective. This will serve as a preliminary step in determining how to tailor and adapt existing tools for virtual or rapid engagement processes as well as evaluation processes. Finally, we need to continue to seek input from youth on whether YE methods should change within different phases of the pandemic. Given there have been different responses across Canada to the pandemic, we might also need to respond to regional and provincial differences in restrictions made on youth that could result in varying YE strategies.
Discussion
Due to the potential impact of COVID-19 on youth mental health, the need to rapidly transform services to be accessible in different ways, and the potential risks associated with this rapid transformation, it is imperative that youth remain engaged in research and service development. Continuing to center YE in mental health research throughout the pandemic can ensure research questions, programs, and services align with the needs of youth.
We have highlighted three recommendations for YE in research in the context of the COVID-19 pandemic. We recommend careful consideration be given to how youth can participate and engage in the research process, even when rapid system transformation is needed. Asking youth about their interest and availability to contribute to research during these unprecedented, uncertain and challenging times is a critical first step in this process. In our experience, youth were especially interested in being involved in research over the summer months during the pandemic out of a desire to give back to other youth and find a sense of purpose. We acknowledge, however, this may change and look different across provinces with increasing demands and competing priorities with schools and workplaces opening up. We recommend researchers attend to the risks/benefits of virtual platforms and consider how youth can be involved beyond rapid engagement at the beginning of research. The utility of different tools and methods for obtaining input from youth (including synchronous and asynchronous methods) should be explored. Finally, we recommend researchers continue to measure the impact of rapid YE by comparing pre- and post-pandemic engagement processes and incorporating the youth perspective when developing evaluation procedures.
This pandemic has illustrated the need to be adaptable, flexible, and prepared throughout the research process. While our recommendations are presented specifically in terms of COVID-19, these strategies and principles are applicable to other scenarios. For example, global and environmental disasters such as floods or fires, or time-limited dissertation research may require researchers to move rapidly. Understanding the risks and benefits of utilizing virtual platforms for YE in research may be important for engaging geographically diverse or underserved young people. Future directions in YE could include bringing together youth, researchers, clinicians and funders to share lessons learned about rapid research and consider how to collectively advance the field in Canada.
Acknowledgements
B.A. acknowledges financial support received from the Canadian Institutes of Health Research Patient-Oriented Research Transition to Leadership Fellowship and the Alberta Innovates Graduate Studentship. O.C. acknowledges financial support received from the Social Sciences and Humanities Research Council. The authors acknowledge and thank Keighley Schofield, young adult engagement partner, for her thoughtful feedback and input on Table 1.
Footnotes
Conflicts of Interest
The authors have no financial relationships to disclose.
References
- Abelson J, Humphrey A, Syrowatka A, Bidonde J, Judd M. Evaluating patient, family and public engagement in health services improvement and system redesign. Healthcare Quarterly. 2018;21:61–67. doi: 10.12927/hcq.2018.25636. [DOI] [PubMed] [Google Scholar]
- Abelson J, Li K, Wilson G, Shields K, Schneider C, Boesveld S. Supporting quality Public and patient engagement in health system organizations: development and usability testing of the Public and Patient Engagement Evaluation Tool. Health Expectations. 2016;19(4):817–827. doi: 10.1111/hex.12378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Abelson J, Tripp L, Kandasamy S, Burrows K PPEET Implementation Study Team. Supporting the evaluation of public and patient engagement in health system organizations: Results from an implementation research study. Health Expectations. 2019;22(5):1132–1143. doi: 10.1111/hex.12949. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boivin A, L’Espérance A, Gauvin FP, Dumez V, Macaulay AC, Lehoux P, Abelson J. Patient and public engagement in research and health system decision making: A systematic review of evaluation tools. Health Expectations. 2018;21(6):1075–1084. doi: 10.1111/hex.12804. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Centre of Excellence for Youth Engagement. What is Youth Engagement? n.d. https://web.archive.org/web/20110301091649/http://www.engagementcentre.ca/files/Whatis_WEB_e.pdf.
- Children and Youth Planning Table. Less telling, more asking: Meaningful youth engagement at a glance. n.d. https://childrenandyouthplanningtable.ca/wp-content/uploads/2019/07/Less-Telling-More-Asking-Meaningful-youth-engagement-at-a-glance.pdf.
- Chen J, Neo P. Texting the waters: An assessment of focus groups conducted via the WhatsApp smartphone messaging application. Methodological Innovations. 2019;12:1–10. [Google Scholar]
- Courtney D, Watson P, Battaglia M, Mulsant BH, Szatmari P. COVID-19 impacts on child and youth anxiety and depression: Challenges and opportunities. The Canadian Journal of Psychiatry. 2020;65(10):688–691. doi: 10.1177/0706743720935646. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Darnay K, Hawke LD, Chaim G, Henderson the INNOVATE Research Team. INNOVATE Research: Youth Engagement Guidebook for Researchers. Toronto, ON: Centre for Addiction and Mental Health; 2019. [Google Scholar]
- Goodman MS, Ackermann N, Bowen DJ, Thompson V. Content validation of a quantitative stakeholder engagement measure. Journal of Community Psychology. 2019;47(8):1937–1951. doi: 10.1002/jcop.22239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guan SA, Subrahmanyam K. Youth internet use: Risks and opportunities. Current Opinion in Psychiatry. 2009;22(4):351–356. doi: 10.1097/YCO.0b013e32832bd7e0. [DOI] [PubMed] [Google Scholar]
- Hamilton CB, Hoens AM, McQuitty S, McKinnon AM, English K, Backman CL, Li LC. Development and pre-testing of the Patient Engagement In Research Scale (PEIRS) to assess the quality of engagement from a patient perspective. PLOS ONE. 2018;13(11):e0206588. doi: 10.1371/journal.pone.0206588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hawke LD, Relihan J, Miller J, McCann E, Rong J, Darnay K, Docherty S, Chaim G, Henderson JL. Engaging youth in research planning, design and execution: Practical recommendations for researchers. Health Expectations. 2018;21(6):944–949. doi: 10.1111/hex.12795. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heffernan OS, Herzog TM, Schiralli JE, Hawke LD, Chaim G, Henderson JL. Implementation of a youth-adult partnership model in youth mental health systems research: Challenges and successes. Health Expectations. 2017;20(6):1183–1188. doi: 10.1111/hex.12554. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Henderson JL, Hawke LD, Relihan J. Youth engagement in the YouthCan IMPACT trial. Canadian Medical Association Journal. 2018;190(Suppl):S10–S12. doi: 10.1503/cmaj.180328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ibrahim H. Crisis helpline sees increased demand, other mental health services pivot to digital. CBC News. 2020. Mar 25, https://www.cbc.ca/news/canada/new-brunswick/chimo-crisis-helpline-covid-19-mental-health-1-5508758.
- Iyer SN, Boksa P, Joober R. Editorial: How youth mental healthcare is being transformed in diverse settings across Canada: Reflections on the experience of the ACCESS Open Minds network. Early Intervention in Psychiatry. 2019;13(Suppl 1):8–11. doi: 10.1111/eip.12811. [DOI] [PubMed] [Google Scholar]
- James C, Davis K, Charmaraman L, Konrath S, Slovak P, Weinstein E, Yarosh L. Digital life and youth well-being, social connectedness, empathy, and narcissism. Pediatrics. 2017;140(5 Supp 2):S71–S75. doi: 10.1542/peds.2016-1758F. [DOI] [PubMed] [Google Scholar]
- Katapally T, Kwambia E. Countering COVID-19 mental health crises with digital health policy interventions. Johnson Hoyama Graduate School of Public Policy: Policy Brief. 2020. Apr 30, https://www.schoolofpublicpolicy.sk.ca/documents/research/policy-briefs/jsgs-policybriefs-covid-series-mental-health.pdf.
- Meenagh J. Flirting, dating, and breaking up within new media environments. Sex Education. 2015;15(5):458–471. [Google Scholar]
- Smith A. COVID-19 force specialized domestic violence unit to adapt. Calgary Herald. 2020. Jun 29, https://calgaryherald.com/news/local-news/0623-dcrt-update.
- Smith AL, de Laplante N. Pressures of COVID-19 could be catastrophic for mental health system. CBC News. 2020. Apr 1, https://www.cbc.ca/news/opinion/opinion-covid-19-mental-health-1.5513201.
- Taub A. A new COVID-19 crisis: domestic abuse rises worldwide. New York Times. 2020. Apr 14, https://www.nytimes.com/2020/04/06/world/coronavirus-domestic-violence.html.
- Vigo D, Patten S, Pajer K, Krausz M, Taylor S, Rush B, Yatham L. Mental health of communities during the COVID-19 Pandemic. The Canadian Journal of Psychiatry. 2020;65(10):1–7. doi: 10.1177/0706743720926676. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wurtele SK, Kenny MC. Technology-related sexual solicitation of adolescents: A review of prevention efforts. Child Abuse Review. 2016;25(5):332–344. [Google Scholar]
- Young Minds. Coronavirus: Impact on young people with mental health needs. 2020. https://youngminds.org.uk/media/3904/coronavirus-report-summer-2020-final.pdf.