Abstract
Involving young people with lived experience in youth mental health research is important. In recognition of the value of collaborating with experts by experience, international funders are increasingly mandating that mental health research is developed by teams that include individuals from the population of study. Yet, research into how Patient Public Involvement, specifically co‐production and co‐design, is implemented in youth mental health research is limited to date. The current review examined this question and identified common practices for collaborating with experts by experience in young people's mental health research. Academic databases were systematically searched for studies that had involved young people in mental health research, had described these activities, and had reported some demographic information about the experts by experience. From a total of 2130 studies that were screened, 37 studies were eligible for inclusion. The use of co‐production and co‐design spanned a wide range of topics, including interventions, digital support tools and psychometric studies. Interactive workshops were the primary method of engaging experts by experience, although some studies utilised interviews or focus groups. From the reviewed studies we identified common methodological practices including: Scene setting, utilising a cyclical process, ensuring appropriate engagement and recognition of the cultural context. We draw on these findings to suggest common methods for conducting co‐production and co‐design activities, and emphasise the importance of ensuring experts by experience are respected and safeguarded throughout their collaboration in research. We also outline areas that deserve future attention and development, and include a response from two young people aged 16–18 and their suggestions for improving and extending co‐production methods.
Keywords: co‐design, co‐production, developmental psychopathology, participatory research, PPI
Involving young people with lived experience in youth mental health research is important. The current review examined this question and identified common practices for collaborating with experts by experience in young people's mental health research. From the reviewed studies we identified common methodological practices including: Scene setting, utilising a cyclical process, ensuring appropriate engagement and recognition of the cultural context. We draw on these findings to suggest common methods for conducting co‐production and co‐design activities, and emphasise the importance of ensuring experts by experience are respected and safeguarded throughout their collaboration in research.
Key points.
Involving individuals with lived experience with mental health problems in research is important, but there is limited information about common practices used in Patient Public Involvement (PPI) methods, such as co‐production and co‐design.
We review studies using PPI methods, including co‐production and co‐design, finding common methods based around the themes of: Scene setting, cyclical engagement, appropriate engagement and cultural context.
PPI methods can be improved to ensure experts by experience are safeguarded during their collaboration, are encouraged to engage in research using collaborative methods, are appropriately remunerated, and represent the diversity of populations that experience mental health problems.
INTRODUCTION
Involving the views of individuals with lived experience in mental health research is important and international funders are increasingly mandating that mental health research is developed by teams that include individuals from the population of study. For example, the Wellcome Trust, the UK Research and Innovation (UKRI) and the National Institute for Health and Care Research (NIHR) all stipulate that research projects should include co‐production or co‐design with experts by experience (Farr et al., 2021; NIHR, 2020; UKRI, 2022). Despite the recognised importance of embedding the views of experts by experience within research on young people's mental health (e.g., Foulkes & Stapley, 2022; Whitmore & Mills, 2022), we do not currently have a clear overview of how co‐production, co‐design are typically implemented within the research cycle. Here, we define experts by experience as individuals with knowledge of a mental health topic due to having lived with psychopathology, or used mental health services, relevant to the subject (Happell et al., 2023). Unlike academic experts, whose experience comes from their training, experts by experience have gained their understanding through personal experience relevant to the mental health problem being studied. The current paper will review how PPI, specifically co‐production and co‐design, have commonly been implemented in mental health research involving young people.
Mental health research is costly in terms of both fiscal and human resources (MQ Mental Health, 2019; Woelbert et al., 2021) and including those with lived experience in the research process can be vital for informing research and implementation questions. In the case of developmental psychopathology research, we cannot assume that the same testing protocols or interventions that work for adults are necessarily suited for young people without adaptations. As an example, a recent large‐scale mindfulness intervention trial delivered in schools (Kuyken et al., 2022) failed to find improvement in mood disorder symptoms of young people, despite mindfulness interventions being effective for treating mood disorders in adults (e.g., Reangsing et al., 2021). The authors speculated that the school setting and universal participation may not have been optimal for all young people and that a co‐design element to adapt the intervention to the school setting could have improved the intervention (Montero‐Marin et al., 2022). To maximise the benefits of mental health research, it is important to ask young people what they find engaging, acceptable and meaningful. Such questions, and others that are vital to the success of mental health research, can be answered by working alongside experts by experience (Foulkes & Stapley, 2022).
Collaborating with experts by experience is referred to Patient and Public Involvement (PPI) in research (Perowne et al., 2024). Patient Public Involvement is an umbrella term that includes a range of approaches to collaborating with experts by experience, with different levels of power sharing between researchers and experts by experience. For example, PPI can refer to projects where experts by experience are consulted on a project, but do not have the ability to make decisions about the study. In contrast, PPI methods such as co‐production and co‐design often assign greater responsibility to experts by experience, meaning they have greater power to implement change within a research project. Co‐production, for example, is an approach to PPI in which experts by experience are equitable partners within a project and often collaborate throughout the research cycle (e.g., Pavarini et al., 2019). Experts by experience are similarly considered equitable partners in co‐design, though these activities are typically restricted to the development of interventions, services or products (e.g., Bevan Jones et al., 2020).
One framework for understanding how the views of experts by experience can be embedded in research is the ‘ladder of participation’ (Hart, 1992). Derived from a theory of civic participation (Arnstein, 1969), the ladder of participation identifies the extent to which the intended users of a service or intervention can engage in decision‐making related to their participation. At the bottom of the ladder, individuals with lived experience have minimal participation and are passive recipients of decisions made by those who, relationally, hold positions of power (e.g., academic researchers, clinicians, or service providers). At the top of the ladder are activities initiated by individuals from the population, referred to as ‘citizen control’ (Arnstein, 1969). In developmental psychopathology, citizen control would involve young people directing their own research into mental health and examples of this type of activity are limited within this field. Patient Public Involvement, including co‐production and co‐design, can occur at different points along the ladder of participation. For example, research that is initiated by adults but in which young people have shared decision‐making about the design of research materials would qualify as PPI though this form of participation is found lower on the ladder (see Sellars et al., 2021; Siston et al., 2023). The ladder of participation can be utilised to identify how decisions are made within a project and whether the relationships between academic researchers and those with lived experience are equal and reciprocal (for one example, see Funk et al., 2012). Although the ladder of participation can be helpful when considering different types of involvement within mental health research, the tool has been critiqued insofar as it assumes participation is exclusively positive and does not recognise unintended and possibly negative consequences from greater involvement in research (Cahill & Dadvand, 2018). Furthermore, the ladder could be taken to suggest ‘better’ and ‘worse’ ways of PPI and that every research project should strive for ‘citizen control’ in all aspects of the study. This may not be appropriate, or possible, for example, given the expertise and training required to design certain aspects of study protocol. In response to these critiques, other models have been proposed that recognise the complexity of the relationship between researchers and experts by experience (e.g., the 7P Model; Cahill & Dadvand, 2018).
There are several existing resources that discuss how to work alongside experts by experience within research. For example, the NIHR highlights that sharing power in co‐production may involve deciding which parties are involved in which decisions, rather than all stakeholders being expected to contribute to every decision (NIHR, 2020). Indeed, transparency in how decisions are made, and by whom, is crucial for collaborating with experts by experience in research while respecting the relative expertise of each group (McPin Foundation, n.d.). Yet, to our knowledge, there is limited guidance on how best to conduct co‐production and co‐design with adolescents. This absence is notable, as power imbalances that may already exist between researchers and experts by experience may be further compounded by ‘invisible’ dynamics when working with adolescents, such as age, financial or educational dynamics (Perera, 2018).
Alongside benefits to academics and their research, embedding co‐production or co‐design within mental health research also has demonstrable benefits for the young people who collaborate on these projects. Involvement in the co‐production or co‐design of research can empower young people to engage with research methodologies (Campbell et al., 2019), provide educational value (Watson et al., 2023; Whitmore & Mills, 2022), develop their self‐confidence (Foulkes & Stapley, 2022), self‐efficacy (Hawke et al., 2020), and allow them to meet new people (Pavarini et al., 2019).
Identifying and developing common methods for implementing PPI methods such as co‐production or co‐design in mental health research is also important in the context of the Open Science movement. Open Science refers to the commitment to make research practices and data openly available to researchers and the wider community (Nosek et al., 2015). To ensure that co‐production and co‐design can be transparently described as part of the research process, it is valuable to establish frameworks or a taxonomy that capture the range of methodologies currently used in co‐production and co‐design (Bergin et al., 2020). In doing so, best practices can be supported, and research outputs can be critically evaluated in relation to the nature of quality of PPI work undertaken.
A further reason to identify common methods used in co‐production and co‐design is to establish a taxonomy of methodological tools that can be used by researchers seeking to adopt co‐production and co‐design methods in their research. In addition, by identifying methods currently used, this review may also facilitate focus on areas that deserve further attention and development. Establishing common methods in this field will ensure that experts by experience are more likely to have a consistent experience when collaborating in mental health research, as well as having a benchmark with which to compare their experience. As co‐production and co‐design methodologies do not necessarily require approval from an ethics review board (Co‐Production Collective, 2022), establishing a basic methodological benchmark through identifying common practices will ensure that researchers can be accountable to a minimum standard when designing, conducting and reporting PPI work with young people.
Here we conduct a scoping review on how PPI, including co‐production and co‐design, have been implemented in developmental psychopathology research—that is, mental health research that involves young people. Given the relative dearth of literature in this field, we did not consider a systematic review the most appropriate evidence synthesis method. Rather, we conducted a scoping review to examine how PPI methods are utilised in developmental psychopathology and identify gaps in this methodology (Munn et al., 2018). Using this approach, we draw on the existing literature to suggest common practice methods for conducting co‐production and co‐design activities to integrate the views of young people into mental health research in a robust, methodologically rigorous manner. Such development work may also support future endeavours to conduct more precise syntheses of evidence in this field, such as systematic reviews (Munn et al., 2018). We also outline areas that deserve future attention and development and include a response from two young people aged 16–18 (authors RS and AA), with their suggestions for improving and extending co‐production and co‐design methods. The objective of this review is to identify common methods currently used when conducting co‐production and co‐design with young people to study developmental psychopathology. Further, a secondary objective is to review common reporting standards used to describe this methodology in published research.
METHODOLOGY
Eligibility criteria
Studies were deemed suitable for inclusion if they meet the following criteria:
Included participants aged between 10 and 18.
Conducted research on children and young people's mental health.
Included co‐production or co‐design.
Reported demographic characteristics of the experts by experience. Specifically, studies were required to include a minimum of information about the age of experts by experience, to allow us to compare studies against criterion 1.
Provided a description of at least one PPI activity.
Was available in English language and published in a peer‐reviewed journal.
The decision to include a minimum age for eligible studies was based on a soft search, which did not identify any studies that recruited experts by experience with aged below 10. We opted to only include studies that reported information relevant to the eligibility criteria in the manuscript, rather than contacting authors to clarify additional details (e.g., demographic information of experts by experience of remuneration provided). The rationale for this decision was based on the framing of the review in context of the Open Science Movement; specifically, we aimed to review studies based on the information they reported in text that would allow independent researchers to replicate their method. Therefore, authors of studies identified during the screening phase were not contacted for information relevant to the eligibility criteria.
Search strategy
We conducted searches of EMBASE, MEDLINE and PsycINFO (using the OVID interface), and Web of Knowledge. We did not opt to search grey literature for research conducted in community or charity settings as one of the aims of this review was to consider how PPI is reported in academic research. However, we point anyone interested in PPI in non‐academic research to Robotham et al. (2023) and Peer Power (2021). We completed the searches of the academic databases between May and June 2023. The search term we utilised was derived from the Patient, Intervention, Comparison and Outcome (PICO) framework. However, as our review does not include a comparison intervention, our search only included terms for patients, ‘intervention’ (i.e., use of co‐production or co‐design), and outcomes. The search terms we used was: adolesc* OR child* AND psychiatry OR psychopatholog* OR mental health AND PPI OR co‐produc* OR co‐design*. We include the phrase child* in the search criteria as some studies conduct PPI with adolescents on the topic of child mental health. The reference lists of included publication were also searched. See Figure 1 for a PRISMA flow chart outlining the number of articles excluded after initial screening. As traditional tools for assessing research quality (e.g., the Assessment tool for cross sectional studies; Downes et al., 2016) include criteria that are not relevant to PPI methods (e.g., criteria to establish statistical significance), we did not include a formal assessment of quality of each included paper.
Study selection and data extraction
Identified studies were screened against the eligibility criteria agreed by the first author (AL). In cases where there was uncertainty about the eligibility of a study, the authors discussed the issue and reached a consensus about whether the study was suitable for inclusion. An additional two authors (TW and LL) examined 10 studies each (five that were considered eligible to be included and five that were considered ineligible; 13.89% of the total number of reports assessed for eligibility) against the eligibility criteria to reduce bias in the screening procedure. Where there was disagreement, the authors met together to reach a consensus about whether the study met the inclusion criteria, which happened in the case of five studies. Once the eligibility of studies had been determined, AL then extracted the following data from eligible studies into a Microsoft excel file:
Study characteristics: Authors list, year of publication, country, design of the co‐production, co‐design or PPI activities, recruitment method for experts by experience, inclusion and exclusion criteria for experts by experience, topic of study and sample size.
Population details: Age, gender, ethnicity, socioeconomic information, and expertise of those recruited.
Co‐production, co‐design or PPI characteristics: Description of the activity, stage of the research cycle the experts by experience collaborated on, number of sessions, length of sessions, output or impact of the collaboration, training and supervision offered, and remuneration received.
Data synthesis
As the outcome of interest was the operationalisation of PPI, including as co‐production and co‐design, within the included studies, we did not conduct any quantitative analysis. Further, as there was significant variability in the level of detail reported in the included studies, we were unable to conduct a qualitative synthesis of the methods used in included studies. Rather, results were synthesised in a narrative review which allowed us to identify common themes in the methods used to conduct the PPI sessions. Specifically, we synthesised findings by identifying the methods that were most commonly reported by authors. We synthesised findings while taking an neutral approach to the effectiveness of these methods, which allowed us to consider the advantages and disadvantages of commonly used methods, as well as how the effectiveness of these approaches may differ between populations of experts by experience. Through this approach to data synthesis, we were able to address the aims of this review to identify common methods used in co‐production and co‐design, consider how these methods are reported, and identify avenues for future research to improve PPI methods.
RESULTS
Summary of studies
Demographic variables and study characteristics
Thirty‐seven studies met our inclusion criteria. These studies included a total of 1383 PPI contributors, though the sample sizes within each study varied greatly (ranging from 4 to 134). The majority of included studies exclusively reported results from their PPI activities (N = 23), whereas the remaining 14 studies were research reports that also detailed results from PPI work. The topics of study varied across the manuscripts and included research on specific mental health problems (N = 16), intervention development (N = 12), service development (N = 4) and psychometric research (N = 1). Within these studies six focused on anxiety, four focused on depression, one focused on conduct problems, one focused on eating disorders and one focused on psychosis, whereas the remaining studies focused on general mental health, help‐seeking or service provision. The reporting on demographic variables was variable and a common limitation identified in most studies was that experts by experience involved in the research were not representative of the wider population (See Supplemental Information I and Supplementary Table 1 for information about the demographic features of experts by experience in the included studies, as well as the topics studied using these methods). Studies were conducted in a range of countries, though we note these were predominantly from the Global North and included Australia (N = 10), Canada (N = 2), India (N = 1), Indonesia (N = 1). Ireland (N = 2), Italy (N = 1), New Zealand (N = 1), the UK (N = 17) and the USA (N = 1). Only one study was conducted in multiple countries for the same study (specifically Spain, Italy, Denmark and Iceland).
Implementation of co‐production, co‐design or patient public involvement
All included studies utilised either interviews and focus groups (N = 14) or workshops (N = 24) to collaborate with experts by experience. Interviews and focus groups were utilised to solicit young people's views on the topic of study, whereas workshops were typically utilised for broader purposes, including developing stimuli, providing feedback on study designs, and reviewing findings from studies. For example, several studies utilised workshops to create narratives that were introduced into interventions for psychopathology during the development stage (Abel et al., 2020; Christie et al., 2019; Gabrielli et al., 2020; Gellatly et al., 2019; Li et al., 2022; Povey et al., 2020; Syed Sheriff et al., 2022). Experts by experience collaborated across the research cycle and in some cases, across multiple stages of the research cycle within the same study (Bennett et al., 2020a, 2020b; Davison et al., 2022; Gellatly et al., 2019; Hill et al., 2022; Li et al., 2022; Mindel et al., 2022; Neill et al., 2022; Povey et al., 2020). Twenty‐seven studies recruited experts by experience in the initial design of the study, and seven studies asked experts by experience to feedback on content or findings from their research (see Supplementary Table 1). Only four studies (Bennett et al., 2020a, 2020b; Mindel et al., 2022; Thomson et al., 2022) asked experts by experience to collaborate on analysing or interpreting findings of the research.
Co‐production and co‐design were used to inform the study of young people's mental health across a range of research areas. Collaborating with experts by experience led to important adaptations to these studies, with the aim of increasing the likelihood they will be acceptable and beneficial to individuals in the target population. From the methods described by the included studies, we identified common themes in the methods used to conduct co‐production or co‐design with adolescents, which we describe below.
Scene setting
Across interviews, focus groups and workshops, researchers described a period of ‘scene setting’, whereby experts by experience were provided with information about the project. This process included important information regarding informed consent, confidentiality, and safeguarding procedures (Davison et al., 2022; Edridge et al., 2018; Hill et al., 2022; Li et al., 2022; Moltrecht et al., 2022; Morote et al., 2022). Scene setting was used to emphasise and clarify the contribution of these individuals and explain that they had unique knowledge about the topic, as experts in their own experience, which could directly benefit the research project (Culbong et al., 2022; Moltrecht et al., 2022; Morote et al., 2022). This explanation provided context for the role of the experts by experience, helping to identify them as equal contributors in the co‐production or co‐design activities (Cheng et al., 2021; Moltrecht et al., 2022; Morote et al., 2022).
While scene setting, researchers also outlined the aims of the PPI activity and the desired outcomes from collaborating with the experts by experience (Morote et al., 2022). Through outlining these aims, researchers were able to focus the session on elements of the project that the experts by experience were able to contribute to, with the aim of maximising the usefulness of the sessions (Cheng et al., 2021; Moltrecht et al., 2022; Morote et al., 2022). This suggests the importance of identifying features of the project that experts by experience can contribute to a priori.
Ensuring appropriate engagement
Several studies reported considering how to collaborate with experts by experience while ensuring they were safeguarded from risks that could arise through their role. Due to the topics of study, many of the experts by experience had current or previous experience of mental health problems (including anxiety, depression, or psychosis; Bennett et al., 2022a; Edridge et al., 2018; Latif et al., 2017; Libon et al., 2023; Realpe et al., 2020), which raises ethical considerations when working with potentially vulnerable populations (Lloyd‐Richardson et al., 2015). To mitigate any such risks to participating experts by experience, several studies utilised creative workshops, most commonly when co‐designing research. Creative methods were deemed a less direct method of discussing the topic, helping to avoid inducing negative affect in experts by experience or creating conditions where experts by experience were expected, or might feel pressurised, to disclose personal information (Povey et al., 2022). For example, Brooks and colleagues (2021a) used activities such as drawing, model making, and sculpting to elicit young people's views on proposed content for a novel intervention to improve mental health literacy in Indonesia without requiring young people to disclose information about their own experiences of mental health problems.
Cyclical processes
Twenty‐six out of 37 studies conducted more than one co‐production or co‐design session with experts by experience (Bennett et al., 2022a, 2022b; Björling et al., 2019; Brooks et al., 2021a, 2021b; Cheng et al., 2021; Christiea et al., 2019; Culbong et al., 2022; Davison et al., 2022; Gellatly et al., 2019; Gobat et al., 2021; Gonsalves et al., 2019; Hackett et al., 2018; Hill et al., 2022; Hugh‐Jones et al., 2022, 2023; Li et al., 2022; Libon et al., 2023; Mindel et al., 2022; Moltrecht et al., 2022; O’Brien et al., 2022; Povey et al., 2020; Povey et al., 2022; Realpe et al., 2020; Syed Sheriff et al., 2022; Stoyanov et al., 2021; Thomson et al., 2022; Thorn et al., 2020; Zieschank et al., 2021). These studies reported that their collaborations with experts by experience were conducted in an iterative manner, whereby feedback from sessions were used to inform the design of the study, which was subsequently presented to experts by experience again for further feedback (Bennett et al., 2022a, 2022b; Davison et al., 2022; Gobat et al., 2021; Povey et al., 2020). Using this iterative, cyclical process ensured the views of experts by experience were embedded throughout the project and allowed their ideas to be further refined, compared to studies where only single PPI sessions were utilised (Davison et al., 2022; Zieschank et al., 2021). Notably, studies that had several co‐production or co‐design sessions did not necessarily collaborate with the same experts by experience in each session, though it was unclear whether this was by design, due to attrition, or a practical consideration from the researchers (Björling et al., 2019; Cheng et al., 2021; Davison et al., 2022; Gobat et al., 2021; Hackett et al., 2018; Povey et al., 2020; Realpe et al., 2020; Thorn et al., 2020).
Cultural context
There were some notable examples of studies that explicitly addressed and embedded the culture of experts by experience within their co‐production or co‐design activities. For example, Culbong et al. (2022) conducted ‘yarns’ with Aboriginal experts by experience, a method of communication used by Aboriginal communities to facilitate discussion. This technique utilises storytelling to draw out views on topics that individuals may not want to directly disclose, with researchers also sharing some information about themselves to establish a reciprocal relationship between individuals involved in the yarn (Bessarab & Ng'Andu, 2010). Through utilising this culturally appropriate method, the researchers were able to elicit views from the experts by experience about mental health service access and provision that are not typically discussed by Aboriginal young people (Culbong et al., 2022). Several other studies also reported adapting the co‐production or co‐design activities to the cultural context of the experts by experience (Brooks et al., 2021a; Christiea et al., 2019; Gonsalves et al., 2019; Povey et al., 2022). Through collaborating with experts by experience using methods that were more familiar to them, researchers aimed to establish better working partnerships and elicit more authentic views from these individuals (Brooks et al., 2021a; Culbong et al., 2022; Gonsalves et al., 2019; Povey et al., 2022). Indeed, adapting PPI activities to the cultural context of experts by experience may be one method to improve the representativeness of experts by experience in mental health research.
Impact of co‐production and co‐design
Across the studies reviewed, experts by experience made a significant impact as collaborators. In studies developing a new mental health intervention, the involvement of experts by experience meant that fundamental changes were made to the design of these interventions to make them more relatable (Björling et al., 2019; Gabriell et al., 2020; Gonsalves et al., 2019), engaging (Grové, 2021; Hill et al., 2022; Hugh‐Jones et al., 2022, 2023; O’Brien et al., 2022; Povey et al., 2020, 2022; Realpe et al., 2020; Stoyanov et al., 2021), and accessible (Hill et al., 2022; Moltrecht et al., 2022; O’Brien et al., 2022) to young people. For example, Realpe and colleagues (2020) based the aesthetic design for their phone‐based application on input from experts by experience and added features such as contact details for emergency services. Notably, adjustments made across different studies removed barriers that may have prevented young people from engaging with these novel interventions (Realpe et al., 2020), which can impact their efficacy (Davison et al., 2022). By involving young people from a wide range of communities, interventions were tailored for young people from diverse backgrounds, including those from cultures where there is social stigma around mental health (Gonsalves et al., 2019). This finding highlights the importance of co‐production approaches for developing study protocols for populations that are typically underrepresented in mental health research (i.e., Western, educated, industrialised, rich and democratic (WEIRD) populations).
Other notable examples of the impact of collaborating with experts by experience included these individuals helping to identify themes from qualitative interviews (Bennett et al., 2022a), interpreting the findings of qualitative interviews (Bennett et al., 2022b), or developing age‐appropriate stimuli in the creation and validation of new scales (Davison et al., 2022). Several studies also collaborated with experts by experience to inform the delivery of mental health care, highlighting barriers and facilitators to the provision of these services to general populations of adolescents (Brooks et al., 2021b; Hackett et al., 2018) and those from minority ethnic groups (Culbong et al., 2022).
DISCUSSION
The current review summarised common methodologies used in co‐production and co‐design with young people in mental health research. We have highlighted that scene setting, ensuring appropriate engagement, using a cyclical process, and understanding the cultural context of experts by experience are commonly used methods for collaborating with young people in mental health research. These methods allowed researchers to form meaningful collaborations with experts by experience and use their views to improve the acceptability of research to the target population. However, our review also highlighted significant limitations in current practices, including a lack of representativeness in experts by experience, a lack of training provided to experts by experience, and a lack of remuneration for their collaboration. Further development of co‐production and co‐design methods are required to address these points to ensure that young people can engage as meaningful partners in mental health research.
Despite the limitations of existing studies, we can draw on these findings to suggest a number of common practice methods for conducting PPI, such as co‐production or co‐design, activities. These recommendations are based on exemplars of good practice identified in the reviewed studies. Specifically, these recommendations were based on reflections from researchers in which the rationale for their co‐production or co‐design activities were justified. We therefore report these recommendations as methodological details that should be reported in future research when describing co‐production and co‐design in mental health studies. Further, we encourage researchers to consider the appropriateness of these approaches for specific populations of experts by experience:
Scene setting. Scene setting should be utilised to provide experts by experience with important information about their role as collaborators including areas of the project that they can contribute toward and the time commitment involved (i.e., single or multiple sessions). Setting the scene to explain how experts by experience can inform the project also recognises that there are some aspects of research that experts by experience may not be able to contribute toward. For example, it may be inappropriate to expect experts by experience to have sufficient knowledge about statistical analyses to contribute to decisions about how to analyse and interpret the outcomes of quantitative research, as such knowledge requires training often outside the scope of co‐production activities. However, it is important to note that some studies delivered training to experts by experience to mitigate these issues: Bennett et al. (2022a, 2022b) trained experts by experience in qualitative data analysis, allowing them to share decision‐making about how the findings of the study were analysed.
Safeguarding. The extent and nature of the collaboration should be carefully considered and experts by experience safeguarded throughout the collaboration. It is important for researchers to monitor the wellbeing of these individuals throughout their role, recognising that these methods can elicit negative feelings for experts by experience (Pavarini et al., 2021). For example, one study recruiting adolescents with lived experience of suicidal ideation reported that some individuals reported feeling suicidal because of their participation in the workshop (Thorn et al., 2020). As PPI, such as co‐production and co‐design, do not qualify as formal research participation, this methodology often does not require institutional ethical review (see Co‐Production Collective, 2023). Therefore, there is a heightened need for robust safeguarding procedures to be established within research teams before co‐production and co‐design is employed with vulnerable young people. Such safeguarding procedures will need to account for whether experts by experience are involved in co‐producing research, in which case ongoing monitoring over multiple sessions may be appropriate, vs. single co‐design sessions where extensive debriefing may instead be required.
Sensitivity and care in selecting experts by experience. It is important to weigh up who may most appropriately contribute to a particular research project. For example, one study working with experts by experience to improve mental health service provision for Aboriginal young people specifically recruited individuals who were not active clients of the service to avoid potential conflicts of interest (Culbong et al., 2022). However, this does not preclude collaborating with experts by experience who are current users of the service being examined, as several studies restricted their inclusion criteria to current service users because they had the most expertise on the study topic (Edridge et al., 2018; Hackett et al., 2018; Latif et al., 2017; Realpe et al., 2020). A further consideration when recruiting experts by experience is the need to actively include individuals from underserved communities. For example, this may involve specifically recruiting individuals from minority ethnic groups, care experienced young people, or those with language and communication disorders, as these individuals are typically underrepresented in mental health research.
Degree and variety of engagement. Researchers should weigh up whether to work with the same group of experts by experience or separate groups across the project. Collaborating with different groups of experts by experience may be beneficial for integrating diverse views. However, working with the same group of experts by experience can provide an opportunity for ideas to be further refined (Davison et al., 2022) and produce stronger collaborations as experts become more familiar with the research process (Bennett et al., 2022a, 2022b; Thomson et al., 2022). Further, collaborating with the same group of experts by experience can provide opportunities for researchers to demonstrate how views of experts by experience have been integrated into the project (Davison et al., 2022), thus emphasising their role as equal partners within the research process. An ideal approach to co‐production and co‐design would strive for a diverse set of experts by experience from the outset and cultivate a relationship of trust and mutual collaboration over time, though co‐design methods may incur less involvement compared to co‐producing research.
Fair remuneration for work undertaken. To create a fair and respectful co‐working environment, the experts by experience should be appropriately remunerated for their contribution. Most studies included in the review (N = 21) did not report whether experts by experience were remunerated for their role. This does not, however, mean that experts by experience were unpaid in these studies, as we did not contact authors about information that was not reported in their manuscripts. Nevertheless, a lack of financial compensation can act as a barrier to maintaining participation and may contribute to the lack of representativeness in experts by experience. However, it is important to ensure that financial compensation does not introduce coercive power dynamics between researchers and experts by experience. For example, the introduction of monetary compensation may lead some experts by experience to feel that they are required to agree with the researchers or risk losing their payment (Perera, 2018). This issue can be mitigated through explaining to experts by experience that their genuine views are being sought and disagreement will not affect their remuneration.
Our recommendations are based on common practices currently employed when conducting co‐production and co‐design with young people. This review contributes to this literature by providing guidance for researchers planning on using these methodologies, along with avenues to improve PPI methods. We acknowledge that some of the suggestions we have raised have been identified by other organisations using PPI methods. For example, the Co‐Production Collective (2022) provide guidance on remunerating experts by experience and the McPin Foundation has several resources for conducting co‐production (https://mcpin.org/resources/). We suggest that improved transparency in reporting standards around the use of co‐production will better allow for these methods to be audited and improved upon, as some studies included in the review did not report key information about the experts by experience in the studies included in this review (see Supplementary Table 1). Future research could, for example, establish quality assessment tools for PPI methods similar to other tools used to assess research quality (e.g., the Appraisal tool for cross sectional research; Downes et al., 2016).
In addition to these methodological developments, future research should also evaluate whether experts by experience meet the criteria to be authors on journal articles. A minority of studies included in the current review also included experts by experience as authors on academic publications (see Supplementary Information). According to some guidelines, such as those of the American Psychological Association (American Psychological Association, 2020), experts by experience may not meet the criteria for co‐authorship (see Bakermans‐Kranenburg & Ijzendoorn, 2024, for a discussion). Yet, guidelines such as the Contributor Roles Taxonomy (CRediT; Brand et al., 2015) detail several areas under which work by experts by experience might qualify them for authorship. These areas include (but are not limited to): Conceptualisation of research goals, methodological contributions to the design of studies, and—given recent emphasis in involving expert by experience in grant applications (Farr et al., 2021; NIHR, 2020; UKRI, 2022)—funding acquisition. These considerations, as well as the preferences of experts by experience, should be carefully managed when determining whether experts by experience meet the criteria for authorship of journal articles.
Young people's response
Following the review, and drawing on our personal experiences (authors AA and RS), it is notable that scene setting is a valuable tool used in the eight studies (Cheng et al., 2021; Culbong et al., 2022; Davison et al., 2022; Edridge et al., 2018; Hill et al., 2022; Li et al., 2022; Moltrecht et al., 2022; Morote et al., 2022), and it is important that it is used in the future. Scene setting validates experts‐by‐experience, making us feel more equal (which may not be common due to the potential power imbalances between researchers and experts‐by‐experience), which is also a principal value of co‐production. Not only this, but scene setting allows for experts‐by‐experience to fully understand their role, allowing their contributions to be more refined. Interviews, focus groups and workshops are all equally constructive when tailored to the study's aims. Creative methods are beneficial for younger experts‐by‐experience (Brooks et al., 2021a; Povey et al., 2022), though we understand that creative methods may be less effective for older experts‐by‐experience due to limitations in communication of complex topics. In our role as young people's advisors for a recent project we participated in, scene setting by the researcher helped us understand precisely what the project was about, our roles in each stage and how we would be supported. This helped us feel more confident before the meetings because we knew what exactly was expected of us.
Whilst the studies reviewed here made an impressive effort to foster the participation of young people in research, there are certain aspects the studies have done less well. In 27 studies, the experts‐by‐experience were included at the initial study design, however only four studies included the experts by experience in analysis and interpretation of research. The limited involvement in studies means there was not an opportunity for ideas or suggestions made by young people to be clarified by experts‐by‐experience before they were implemented in the research. In our role as a member of the young people advisory group for a recent project, the researcher made sure to include the young people in the interpretation of research. Not only did this help us feel valued, it also made sure the interpretation fully reflected the views of people who will directly benefit from future research.
Additionally, less than half of the studies recorded financial compensation and two studies among this recorded voucher payments (Latif et al., 2017; O’Brien et al., 2022) which are often not the preferred means of payment. It is important to have adequate payment to strengthen the values of co‐production or co‐design and evidence of a sense of equality between the experts‐by‐experience and the researchers. Persons with lived experience play a crucial role in research and should be compensated accordingly for their expertise.
Despite the previous efforts in co‐production and co‐design, there is a lot of work which needs to be done in future research to truly implement the values of the methodology, ethically and accurately. For instance, using the same groups of diverse experts‐by‐experience with a cyclical methodology would help them refine their ideas, make them more comfortable and confident in their opinion while increasing their understanding of the project. Those outcomes are reflected in our own experience of being involved in prior research, where the above methodology was used.
Payment guidance should be developed and shared with experts‐by‐experience before their involvement. Experts by experience need to know exactly what compensation they will receive to help them manage their expectations. Before we began our roles as young people's advisors for a recent research project, we were informed of the compensation we would receive and were able to make the informed decision to participate. This information is important to not only give a sense of equality, but also to prevent putting the experts‐by‐experience in a difficult position. It is also important to ensure paid training should be given for roles that require understanding of technical materials, and researchers should emphasise that such payments and any subsequent remunerations should not stop experts‐by‐experience from giving honest feedback.
Furthermore, safeguarding and ethics should be top priority and experts‐by‐experience should be treated the same as formal research participants. By informing experts‐by‐experience of their rights and that there is a support system available if they need any help, especially for particularly sensitive topics, experts‐by‐experience can and will feel more comfortable in the group and working with the researchers; allowing for both ethics to be completely upheld and for the opinions given by experts‐by‐experience to be more valid.
Limitations and conclusion
There are some important limitations to consider with the current review. First, the restriction on English‐language publications could mean that we did not identify PPI work being conducted in non‐English speaking settings, such as the Global South. This limitation is notable as it could mean we overlooked more culturally diverse methods used in co‐production and co‐design. A further limitation is that we did not contact authors to enquire about information that was missing from the published manuscripts (e.g., demographic information or remuneration policies). This decision was made as we wanted to review how co‐production and co‐design were reported, as well as omissions to information that was reported that would hinder replicability of these methods in context of the Open Science Movement. Nevertheless, in opting not to contact authors, this review may not capture details in the PPI methods that were not reported in published manuscripts.
In sum, we have reviewed current methods used in co‐production and co‐design in mental health research with young people. The common themes we identified have been used to provide a guide for future researchers conducting PPI. While our review was limited to research on mental health, the methods identified may be informative for other research areas, though additional considerations may be required to tailor these methods to other populations (e.g., Chinn & Pelletier, 2020). This review has demonstrated that there is significant heterogeneity in reporting standards for PPI. This heterogeneity is particularly notable in context of the recognised importance of Open Science and the need for research to be reported transparently. We have suggested improvements that future research can make to co‐production and co‐design methods that can support the robust and rigorous implementation of these methods (for example, pre‐registering whether co‐production or co‐design will be utilised). Such improvements will be necessary as these methods become increasingly mandated by major funders of mental health research. Nevertheless, embedding PPI in research on children and young people's mental health has the potential to significantly improve the quality of research in this area and the benefits to young people experiencing mental health problems.
AUTHOR CONTRIBUTIONS
Alex Lloyd: Conceptualization; investigation; methodology; writing ‐ original draft; writing ‐ review & editing. Tom (Chin‐Han) Wu: Formal analysis; writing ‐ review & editing. Laura Lucas: Formal analysis; project administration; writing ‐ review & editing. Adeola Agunbiade: Writing ‐ original draft. Romana Saleh: Writing ‐ original draft. Pasco Fearon: Conceptualization; methodology; supervision; writing ‐ review & editing. Essi Viding: Conceptualization; methodology; supervision; writing ‐ review & editing.
CONFLICT OF INTEREST STATEMENT
The authors have declared that they have no competing or potential conflicts of interest.
ETHICS CONSIDERATIONS
Not applicable to this research review.
Supporting information
ACKNOWLEDGMENTS
This review was funded by the UK Research and Innovation (UK) MRC Grant Ref: MR/W002485/1 awarded to PF and EV.
Lloyd, A. , Wu, T. (C.‐H.). , Lucas, L. , Agunbiade, A. , Saleh, R. , Fearon, P. , & Viding, E. (2024). No decision about me, without me: Collaborating with young people in mental health research. JCPP Advances, 4(4), e12291. 10.1002/jcv2.12291
Pasco Fearon and Essi Viding are Joint senior author.
DATA AVAILABILITY STATEMENT
Data sharing is not applicable to this article as no new data were created or analyzed in this study.
REFERENCES
- Abel, K. M. , Bee, P. , Gega, L. , Gellatly, J. , Kolade, A. , Hunter, D. , Carter, L. A. , Meacock, R. , Bower, P. , Stanley, N. , Calam, R. , Wolpert, M. , Stewart, P. , Emsley, R. , Holt, K. , Linklater, H. , Douglas, S. , Stokes‐Crossley, B. , & Green, J. (2020). An intervention to improve the quality of life in children of parents with serious mental illness: The young SMILES feasibility RCT. Health Technology Assessment, 24(59), 1–136. 10.3310/hta24590 [DOI] [PMC free article] [PubMed] [Google Scholar]
- American Psychological Association . (2020). Publication manual of the American psychological association (7th ed.). 10.1037/0000165-000 [DOI]
- Arnstein, S. R. (1969). A ladder of citizen participation. Journal of the American Institute of Planners, 35(4), 216–224. 10.1080/01944366908977225 [DOI] [Google Scholar]
- Bakermans‐Kranenburg, M. J. , & van Ijzendoorn, M. H. (2024). Anything goes for participant, patient and public involvement in youth mental health research. JCPP Advances, e12258. 10.1002/jcv2.12258 [DOI] [Google Scholar]
- Bennett, V. , Gill, C. , Miller, P. , Lewis, P. , Ypag, N. , Hamilton‐Giachritsis, C. , & Lavi, I. (2022b). Developing a novel co‐produced methodology to understand ‘real‐world’help‐seeking in online peer–peer communities by young people experiencing emotional abuse and neglect. Health Expectations, 25(6), 3124–3142. 10.1111/hex.13621 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bennett, V. , Gill, C. , Miller, P. , Wood, A. , Bennett, C. , Ypag, N. , & Singh, I. (2022a). Co‐production to understand online help‐seeking for young people experiencing emotional abuse and neglect: Building capabilities, adapting research methodology and evaluating involvement and impact. Health Expectations, 25(6), 3143–3163. 10.1111/hex.13622 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bergin, A. D. , Vallejos, E. P. , Davies, E. B. , Daley, D. , Ford, T. , Harold, G. , Kidner, M. , Long, Y. , Merry, S. , Morriss, R. , Sayal, K. , Sonuga‐Barke, E. , Robinson, J. , Torous, J. , & Hollis, C. (2020). Preventive digital mental health interventions for children and young people: A review of the design and reporting of research. NPJ digital medicine, 3(1), 133. 10.1038/s41746-020-00339-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bessarab, D. , & Ng'Andu, B. (2010). Yarning about yarning as a legitimate method in Indigenous research. International Journal of Critical Indigenous Studies, 3(1), 37–50. 10.5204/ijcis.v3i1.57 [DOI] [Google Scholar]
- Bevan Jones, R. , Stallard, P. , Agha, S. S. , Rice, S. , Werner‐Seidler, A. , Stasiak, K. , Simpson, S. A. , Alvarez‐Jimenez, M. , Rice, F. , Evans, R. , & Merry, S. (2020). Practitioner review: Co‐design of digital mental health technologies with children and young people. Journal of Child Psychology and Psychiatry, 61(8), 928–940. 10.1111/jcpp.13258 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Björling, E. A. , Cicero, R. , Sankar, A. , & Sekar, A. (2019). Thought disposal: Co‐designing a virtual interaction to reduce stress in teens. In Proceedings of the 18th ACM international conference on interaction design and children (pp. 562–567). [Google Scholar]
- Brand, A. , Allen, L. , Altman, M. , Hlava, M. , & Scott, J. (2015). Beyond authorship: Attribution, contribution, collaboration, and credit. Learned Publishing, 28(2), 151–155. 10.1087/20150211 [DOI] [Google Scholar]
- Brooks, H. , Syarif, A. K. , Pedley, R. , Irmansyah, I. , Prawira, B. , Lovell, K. , Ardisasmita, A. , Tanjung, I. S. , Renwick, L. , Salim, S. , & Bee, P. (2021a). Improving mental health literacy among young people aged 11–15 years in Java, Indonesia: The co‐development of a culturally‐appropriate, user‐centred resource (the IMPeTUs intervention). Child and Adolescent Psychiatry and Mental Health, 15, 1–18. 10.1186/s13034-021-00410-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brooks, R. , Lambert, C. , Coulthard, L. , Pennington, L. , & Kolehmainen, N. (2021b). Social participation to support good mental health in neurodisability. Child: Care, Health and Development, 47(5), 675–684. [DOI] [PubMed] [Google Scholar]
- Cahill, H. , & Dadvand, B. (2018). Re‐Conceptualising youth participation: A framework to inform action. Children and Youth Services Review, 95, 243–253. 10.1016/j.childyouth.2018.11.001 [DOI] [Google Scholar]
- Campbell, S. , Gazard, B. , Woodhead, C. , Harber‐Aschan, L. , Beards, S. , Harber‐Aschan, J. , Gazzard, M. , Yaman, E. , Murugesu, A. , & Hatch, S. L. (2019). Involving young people through co‐production and widening participation approaches: Reflections from school‐based engagement. Research for All, 3(1), 42–58. 10.18546/RFA.03.1.05 [DOI] [Google Scholar]
- Cheng, V. W. S. , Piper, S. E. , Ottavio, A. , Davenport, T. A. , & Hickie, I. B. (2021). Recommendations for designing health information technologies for mental health drawn from self‐determination theory and co‐design with culturally diverse populations: Template analysis. Journal of Medical Internet Research, 23(2), e23502. 10.2196/23502 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chinn, D. , & Pelletier, C. (2020). Deconstructing the co‐production ideal: Dilemmas of knowledge and representation in a co‐design project with people with intellectual disabilities. Journal of Intellectual & Developmental Disability, 45(4), 326–336. 10.3109/13668250.2020.1795820 [DOI] [Google Scholar]
- Christie, G. I. , Shepherd, M. , Merry, S. N. , Hopkins, S. , Knightly, S. , & Stasiak, K. (2019). Gamifying CBT to deliver emotional health treatment to young people on smartphones. Internet interventions, 18, 100286. 10.1016/j.invent.2019.100286 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Co‐Production Collective . (2022). Our Co‐producer payment policy. Retrieved from https://assets.website‐files.com/5ffee76a01a63b6b7213780c/63643eaea54b9be86aae60ef_CoProCo_PaymentPolicyFULL_Oct22V1.pdf
- Co‐Production Collective . (2023). All about ethics. Retrieved from https://www.coproductioncollective.co.uk/news/all‐about‐ethics
- Culbong, T. , Crisp, N. , Biedermann, B. , Lin, A. , Pearson, G. , Eades, A. M. , & Wright, M. (2022). Building a Nyoongar work practice model for Aboriginal youth mental health: Prioritising trust, culture and spirit, and new ways of working. Health Sociology Review, 31(2), 173–192. 10.1080/14461242.2022.2087534 [DOI] [PubMed] [Google Scholar]
- Davison, J. , Maguire, S. , McLaughlin, M. , & Simms, V. (2022). Involving adolescents with intellectual disability in the adaptation of self‐reported subjective well‐being measures: Participatory research and methodological considerations. Journal of Intellectual Disability Research, 66(7), 628–641. 10.1111/jir.12936 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Downes, M. J. , Brennan, M. L. , Williams, H. C. , & Dean, R. S. (2016). Development of a critical appraisal tool to assess the quality of cross‐sectional studies (AXIS). BMJ Open, 6(12), e011458. 10.1136/bmjopen-2016-011458 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Edridge, C. L. , Edbrooke‐Childs, J. , Martin, K. , Delane, L. , Averill, P. , Feltham, A. , Jeremy, G. , Chapmen, L. , Craven, M. , & Wolpert, M. (2018). Power Up: Patient and public involvement in developing a shared decision‐making app for mental health. The Journal of Health Design, 3(1), 63–74. 10.21853/jhd.2018.40 [DOI] [Google Scholar]
- Farr, M. , Davies, P. , Andrews, H. , Bagnall, D. , Brangan, E. , & Davies, R. (2021). Co‐Producing knowledge in health and social care research: Reflections on the challenges and ways to enable more equal relationships. Humanities and Social Sciences Communications, 8(1), 105. 10.1057/s41599-021-00782-1 [DOI] [Google Scholar]
- Foulkes, L. , & Stapley, E. (2022). Want to improve school mental health interventions? Ask young people what they actually think. Journal of Philosophy of Education, 56(1), 41–50. 10.1111/1467-9752.12649 [DOI] [Google Scholar]
- Funk, A. , Van Borek, N. , Taylor, D. , Grewal, P. , Tzemis, D. , & Buxton, J. A. (2012). Climbing the “ladder of participation”: Engaging experiential youth in a participatory research project. Canadian Journal of Public Health, 103(4), e288–e292. 10.1007/bf03404237 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gabrielli, S. , Rizzi, S. , Carbone, S. , & Donisi, V. (2020). A chatbot‐based coaching intervention for adolescents to promote life skills: Pilot study. JMIR human factors, 7(1), e16762. 10.2196/16762 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gellatly, J. , Bee, P. , Kolade, A. , Hunter, D. , Gega, L. , Callender, C. , & Abel, K. M. (2019). Developing an intervention to improve the health related quality of life in children and young people with serious parental mental illness. Frontiers in Psychiatry, 10, 155. 10.3389/fpsyt.2019.00155 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gobat, N. , Littlecott, H. , Williams, A. , McEwan, K. , Stanton, H. , Robling, M. , Murphy, S. , & Evans, R. (2021). Developing a whole‐school mental health and wellbeing intervention through pragmatic formative process evaluation: A case‐study of innovative local practice within the school health research network. BMC Public Health, 21, 1–16. 10.1186/s12889-020-10124-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gonsalves, P. P. , Hodgson, E. S. , Kumar, A. , Aurora, T. , Chandak, Y. , Sharma, R. , & Patel, V. (2019). Design and development of the “POD Adventures” smartphone game: A blended problem‐solving intervention for adolescent mental health in India. Frontiers in Public Health, 7, 238. 10.3389/fpubh.2019.00238 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grové, C. (2021). Co‐developing a mental health and wellbeing chatbot with and for young people. Frontiers in Psychiatry, 11, 606041. 10.3389/fpsyt.2020.606041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hackett, C. L. , Mulvale, G. , & Miatello, A. (2018). Co‐designing for quality: Creating a user‐driven tool to improve quality in youth mental health services. Health Expectations, 21(6), 1013–1023. 10.1111/hex.12694 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Happell, B. , Gordon, S. , Sharrock, J. , Donovan, A. O. , Kenny, N. , & Warner, T. (2023). There is something about oppression: Allies' perspectives on challenges in relationships with experts by experience. International journal of mental health nursing, 32(3), 744–754. 10.1111/inm.13117 [DOI] [PubMed] [Google Scholar]
- Hart, R. A. (1992). Children's participation: From tokenism to citizenship (No. inness92/6).
- Hawke, L. D. , Darnay, K. , Brown, M. , Iyer, S. , Ben‐David, S. , Khaleghi‐Moghaddam, M. , Barbic, S. , Lachance, L. , Mathias, S. , Halsall, T. , Kidd, S. A. , Soklaridis, S. , & Henderson, J. (2020). INNOVATE Research: Impact of a workshop to develop researcher capacity to engage youth in research. Health Expectations, 23(6), 1441–1449. 10.1111/hex.13123 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hill, C. , Reardon, T. , Taylor, L. , & Creswell, C. (2022). Online support and intervention for child anxiety (OSI): Development and usability testing. JMIR Formative Research, 6(4), e29846. 10.2196/29846 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hugh‐Jones, S. , Pert, K. , Kendal, S. , Eltringham, S. , Skelton, C. , Yaziji, N. , & West, R. (2022). Adolescents accept digital mental health support in schools: A co‐design and feasibility study of a school‐based app for UK adolescents. Mental Health & Prevention, 27, 200241. 10.1016/j.mhp.2022.200241 [DOI] [Google Scholar]
- Hugh‐Jones, S. , Ulor, M. , Nugent, T. , Walshe, S. , & Kirk, M. (2023). The potential of virtual reality to support adolescent mental well‐being in schools: A UK co‐design and proof‐of‐concept study. Mental Health & Prevention, 30, 200265. [Google Scholar]
- Kuyken, W. , Ball, S. , Crane, C. , Ganguli, P. , Jones, B. , Montero‐Marin, J. , Raja, A. , Taylor, L. , Tudor, K. , Viner, R. M. , Allwood, M. , Aukland, L. , Dunning, D. , Casey, T. , Dalrymple, N. , De Wilde, K. , Farley, E. R. , Harper, J. , & Nuthall, E. , & MYRIAD, & Team . (2022). Effectiveness and cost‐effectiveness of universal school‐based mindfulness training compared with normal school provision in reducing risk of mental health problems and promoting well‐being in adolescence: The MYRIAD cluster randomised controlled trial. Evidence‐Based Mental Health, 25(3), 99–109. 10.1136/ebmental-2021-300396 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Latif, A. , Carter, T. , Rychwalska‐Brown, L. , Wharrad, H. , & Manning, J. (2017). Co‐producing a digital educational programme for registered children’s nurses to improve care of children and young people admitted with self‐harm. Journal of Child Health Care, 21(2), 191–200. 10.1177/1367493517697853 [DOI] [PubMed] [Google Scholar]
- Li, S. H. , Achilles, M. R. , Spanos, S. , Habak, S. , Werner‐Seidler, A. , & O’Dea, B. (2022). A cognitive behavioural therapy smartphone app for adolescent depression and anxiety: Co‐design of ClearlyMe. The Cognitive Behaviour Therapist, 15, e13. 10.1017/s1754470x22000095 [DOI] [Google Scholar]
- Libon, J. , Alganion, J. , & Hilario, C. (2023). Youth perspectives on barriers and opportunities for the development of a peer support model to promote mental health and prevent suicide. Western Journal of Nursing Research, 45(3), 208–214. 10.1177/01939459221115695 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lloyd‐Richardson, E. E. , Lewis, S. P. , Whitlock, J. L. , Rodham, K. , & Schatten, H. T. (2015). Research with adolescents who engage in non‐suicidal self‐injury: Ethical considerations and challenges. Child and Adolescent Psychiatry and Mental Health, 9(1), 1–14. 10.1186/s13034-015-0071-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McPin Foundation Top tips for Co‐production in research. (n.d.). Retrieved from https://mcpin.org/wp‐content/uploads/2023/02/Resources‐Infographic‐Tips‐for‐coproducing‐research.png
- Mindel, C. , Salhi, L. , Oppong, C. , & Lockwood, J. (2022). Alienated and unsafe: Experiences of the first national UK COVID‐19 lockdown for vulnerable young people (aged 11–24 years) as revealed in Web‐based therapeutic sessions with mental health professionals. Counselling and Psychotherapy Research, 22(3), 708–724. 10.1002/capr.12533 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moltrecht, B. , Patalay, P. , Bear, H. A. , Deighton, J. , & Edbrooke‐Childs, J. (2022). A transdiagnostic, emotion regulation app (Eda) for children: Design, development, and lessons learned. JMIR Formative Research, 6(1), e28300. 10.2196/28300 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Montero‐Marin, J. , Allwood, M. , Ball, S. , Crane, C. , De Wilde, K. , Hinze, V. , Lord, L. , Nuthall, E. , Raja, A. , Taylor, L. , Tudor, K. , Blakemore, S. J. , Byford, S. , Dalgleish, T. , Ford, T. , Greenberg, M. T. , Ukoumunne, O. C. , Williams, J. M. G. , Kuyken, W. , …, & Jones, B. , & MYRIAD Team . (2022). School‐based mindfulness training in early adolescence: What works, for whom and how in the MYRIAD trial? Evidence‐Based Mental Health, 25(3), 117–124. 10.1136/ebmental-2022-300439 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morote, R. , Las Hayas, C. , Izco‐Basurko, I. , Anyan, F. , Fullaondo, A. , Donisi, V. , Gudmundsdottir, D. G. , Ledertoug, M. M. , Olafsdottir, A. S. , Gabrielli, S. , Carbone, S. , Mazur, I. , Królicka‐Deręgowska, A. , Knoop, H. H. , Tange, N. , Kaldalóns, I. V. , Jónsdóttir, B. J. , González Pinto, A. , & Hjemdal, O. (2022). Co‐creation and regional adaptation of a resilience‐based universal whole‐school program in five European regions. European Educational Research Journal, 21(1), 138–164. 10.1177/1474904120947890 [DOI] [Google Scholar]
- MQ Mental Health . (2019). UK mental health research funding 2014–2017. Retrieved from https://www.mqmentalhealth.org/wp‐content/uploads/UKMentalHealthResearchFunding2014‐2017digital.pdf
- Munn, Z. , Peters, M. D. , Stern, C. , Tufanaru, C. , McArthur, A. , & Aromataris, E. (2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18, 1–7. 10.1186/s12874-018-0611-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- National Institute for Health and Care Research . (2020). Co‐Production in action: Number three. Retrieved from https://www.nihr.ac.uk/documents/co‐production‐in‐action‐number‐three/26382
- Neill, R. D. , Lloyd, K. , Best, P. , Williamson, J. , Allen, J. , & Tully, M. A. (2022). Development and modelling of a school‐based mental health intervention: The co‐production of the REACT programme. Current Psychology, 42(10), 1–12. 10.1007/s12144-022-03195-8 36468159 [DOI] [Google Scholar]
- Nosek, B. A. , Alter, G. , Banks, G. C. , Borsboom, D. , Bowman, S. D. , Breckler, S. J. , Chambers, C. D. , Chin, G. , Christensen, G. , Contestabile, M. , Dafoe, A. , Eich, E. , Freese, J. , Glennerster, R. , Goroff, D. , Green, D. P. , Hesse, B. , Humphreys, M. , & Yarkoni, T. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. 10.1126/science.aab2374 [DOI] [PMC free article] [PubMed] [Google Scholar]
- O'Brien, A. , Anderson, R. , Mazzucchelli, T. , & Egan, S. J. (2022). A protocol for unguided internet self‐help cognitive behaviour therapy for perfectionism in adolescents at‐risk of eating disorders. Internet Interventions, 29, 100565. 10.1016/j.invent.2022.100565 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pavarini, G. , Lorimer, J. , Manzini, A. , Goundrey‐Smith, E. , & Singh, I. (2019). Co‐producing research with youth: The NeurOx young people's advisory group model. Health Expectations, 22(4), 743–751. 10.1111/hex.12911 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pavarini, G. , Smith, L. M. , Shaughnessy, N. , Mankee‐Williams, A. , Thirumalai, J. K. , Russell, N. , & Bhui, K. (2021). Ethical issues in participatory arts methods for young people with adverse childhood experiences. Health Expectations, 24(5), 1557–1569. 10.1111/hex.13314 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peer Power Youth . (2021). Co‐Creation and participation in the youth justice system. Retrieved from https://www.peerpower.org.uk/wp‐content/uploads/2021/09/Long‐Report‐YJB‐Design‐by‐Lizzie‐Reid‐final‐1.pdf
- Perera, K. (2018). How might we think about power? Retrieved from https://www.nesta.org.uk/blog/how‐might‐we‐think‐about‐power/
- Perowne, R. , Rowe, S. , & Gutman, L. M. (2024). Understanding and defining young people's involvement and under‐representation in mental health research: A Delphi study. Health Expectations, 27(3), e14102. 10.1111/hex.14102 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Povey, J. , Sweet, M. , Nagel, T. , Lowell, A. , Shand, F. , Vigona, J. , & Dingwall, K. M. (2022). Determining priorities in the aboriginal and islander mental health initiative for youth app second phase participatory design project: Qualitative study and narrative literature review. JMIR formative research, 6(2), e28342. 10.2196/28342 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Povey, J. , Sweet, M. , Nagel, T. , Mills, P. P. J. R. , Stassi, C. P. , Puruntatameri, A. M. A. , Shand, F. , & Dingwall, K. (2020). Drafting the aboriginal and islander mental health initiative for youth (AIMhi‐Y) app: Results of a formative mixed methods study. Internet Interventions, 21, 100318. 10.1016/j.invent.2020.100318 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Realpe, A. , Elahi, F. , Bucci, S. , Birchwood, M. , Vlaev, I. , Taylor, D. , & Thompson, A. (2020). Co‐designing a virtual world with young people to deliver social cognition therapy in early psychosis. Early Intervention in Psychiatry, 14(1), 37–43. 10.1111/eip.12804 [DOI] [PubMed] [Google Scholar]
- Reangsing, C. , Rittiwong, T. , & Schneider, J. K. (2021). Effects of mindfulness meditation interventions on depression in older adults: A meta‐analysis. Aging & Mental Health, 25(7), 1181–1190. 10.1080/13607863.2020.1793901 [DOI] [PubMed] [Google Scholar]
- Robotham, D. , Hazzard, R. , Gibson, J. , Chipp, B. , Joseph, D. , & Pinfold, V. (2023). Co‐production at McPin. Retrieved from https://mcpin.org/resource/10‐for‐10‐co‐production‐at‐mcpin/
- Sellars, E. , Pavarini, G. , Michelson, D. , Creswell, C. , & Fazel, M. (2021). Young people’s advisory groups in health research: Scoping review and mapping of practices. Archives of Disease in Childhood, 106(7), 698–704. 10.1136/archdischild-2020-320452 [DOI] [PubMed] [Google Scholar]
- Siston, F. R. , Murta, S. G. , de Alcântara Mendes, J. A. , Ferreira, J. A. , de Lima Santos, V. H. , Seabra, B. T. R. , da Cunha, R. d. O. , & Pavarini, G. (2023). A collective autoethnography of coproduction in mental health research by academic researchers and young people in Brazil. BMJ Global Health, 8(11), e012443. 10.1136/bmjgh-2023-012443 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stoyanov, S. R. , Zelenko, O. , Staneva, A. , Kavanagh, D. J. , Smith, C. , Sade, G. , & Hides, L. (2021). Development of the niggle app for supporting young people on their dynamic journey to well‐being: Co‐Design and qualitative research study. JMIR mHealth and uHealth, 9(4), e21085. 10.2196/21085 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Syed Sheriff, R. J. , Vuorre, M. , Riga, E. , Przybylski, A. K. , Adams, H. , Harmer, C. J. , & Geddes, J. R. (2022). A co‐produced online cultural experience compared to a typical museum website for mental health in people aged 16–24: A proof‐of‐principle randomised controlled trial. Australian and New Zealand Journal of Psychiatry, 00048674221115648. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomson, A. , Peasgood, E. , & Robertson, S. (2022). The youth patient and public involvement café—A youth‐led model for meaningful involvement with children and young people. Health Expectations, 25(6), 2893–2901. 10.1111/hex.13597 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thorn, P. , Hill, N. T. , Lamblin, M. , Teh, Z. , Battersby‐Coulter, R. , Rice, S. , Gibson, K. L. , Finlay, S. M. , Blandon, R. , de Souza, L. , West, A. , Cooksey, A. , Sciglitano, J. , Goodrich, S. , & Robinson, J. (2020). Developing a suicide prevention social media campaign with young people (the# Chatsafe project): Co‐design approach. JMIR mental health, 7(5), e17520. 10.2196/17520 [DOI] [PMC free article] [PubMed] [Google Scholar]
- UK Research and Innovation . (2022). Co‐production in research. Retrieved from https://www.ukri.org/about‐us/policies‐standards‐and‐data/good‐research‐resource‐hub/research‐co‐production/
- Warne, N. , Rook, S. , Jones, R. B. , Brown, R. , Bates, L. , Hopkins‐Jones, L. , Hall, J. , Langley, K. , Thapar, A. , Walters, J. , Murphy, S. , Moore, G. , Rice, F. , & Collishaw, S. (2022). Collecting genetic samples and linked mental health data from adolescents in schools: Protocol coproduction and a mixed‐methods pilot of feasibility and acceptability. BMJ Open, 12(2), e049283. 10.1136/bmjopen-2021-049283 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watson, R. , Burgess, L. , Sellars, E. , Crooks, J. , McGowan, R. , Diffey, J. , Naughton, G. , Carrington, R. , Lovelock, C. , Temple, R. , Creswell, C. , & McMellon, C. (2023). A qualitative study exploring the benefits of involving young people in mental health research. Health Expectations. 26(4), 1491–1504, 10.1111/hex.13722 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Whitmore, L. B. , & Mills, K. L. (2022). Co‐creating developmental science. Infant and Child Development, 31(1), e2273. 10.1002/icd.2273 [DOI] [Google Scholar]
- Woelbert, E. , Lundell‐Smith, K. , White, R. , & Kemmer, D. (2021). Accounting for mental health research funding: Developing a quantitative baseline of global investments. The Lancet Psychiatry, 8(3), 250–258. 10.1016/s2215-0366(20)30469-7 [DOI] [PubMed] [Google Scholar]
- Zieschank, K. , Day, J. , Ireland, M. J. , & March, S. (2021). Co‐design and qualitative validation of animated assessment item content for a child‐reported digital distress screener. Internet Interventions, 24, 100381. 10.1016/j.invent.2021.100381 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Data sharing is not applicable to this article as no new data were created or analyzed in this study.