Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 May 5;18(5):e0283178. doi: 10.1371/journal.pone.0283178

Practice, governance, and culture characteristics of lived experience organisations, and evidence of efficacy: A scoping review protocol

Jessica E Opie 1,2,*, An Vuong 1,2, Alexandra Macafee 3, Hanan Khalil 2, Natalie Pearce 4, Erandathie Jayakody 3, Christropher Maylea 2, Jennifer E McIntosh 1,2
Editor: Jonas Preposi Cruz5
PMCID: PMC10162514  PMID: 37146030

Abstract

Background

Mental health policy and service design is increasingly recognizing the importance of the lived experience voice and its inclusion in all aspects of work. Effective inclusion requires a deeper understanding of how best to support lived experience workforce and community members to meaningfully participate in the system.

Objectives

This scoping review aims to identify key features of organizational practice and governance that facilitate the safe inclusion of lived experience in decision-making and practice within mental health sector contexts. Specifically, the review focuses on mental health organizations devoted to lived experience advocacy or peer support or those in which lived experience membership (paid or voluntary) is central to advocacy and peer support operations.

Methods

This review protocol was prepared with the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols and registered with the Open Science Framework. The review will be guided by the Joanna Briggs Institute methodology framework and is being conducted by a multidisciplinary team including lived experience research fellows. It will include published and grey literature, including government reports, organizational online documents, and theses. Included studies will be identified through comprehensive searches of five databases: PsycINFO (Ovid), CINAHL (EBSCO), EMBASE (Ovid), MEDLINE (Ovid), and ProQuest Central. Studies published in English from 2000 onwards will be included. Data extraction will be guided by pre-determined extraction instruments. Results will be presented in a Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews flow chart. Results will be presented in tabular form and narratively synthesized. The planned commencement and completion dates for this review were July 1, 2022 and April 1, 2023.

Discussion

It is anticipated that this scoping review will map the current evidence base underpinning organizational practices in which lived experience workers are involved, specifically in the mental health system. It will also inform future mental health policy and research.

Trial registration

Registration: Open Science Framework (registered: July 26, 2022; registration DOI: 10.17605/OSF.IO/NB3S5).

Introduction

Trends in mental health policy and practice in Australia and internationally have increasingly acknowledged and prioritized the importance of consumer participation in service provision and design [1]. Despite a public policy priority of lived experience inclusion, structural barriers and power imbalances currently limit meaningful collaboration and effective participation for consumers [2]. Thus, there remains a continual and pressing need for consumer workforce development, including improved career pathways, support and supervision, and the leadership of lived experience workers [3]. Presently, consumers are at a disadvantage both as service users and in the mental health sector workforce, and successful reform is dependent on these challenges being mitigated and the lived experience voice having a central and meaningful role in operations and governance.

Consumers have their own individual experience of mental health challenges, recovery, and using mental health services. As such, they also represent a collective and unique discipline of mental health known as ‘consumer perspective’ in the Australian context [4]. In Australia, the mental health system is attempting to realign its processes in line with a rapidly evolving focus on consumer informed care and respect for human rights, to address widespread experiences of consumer disempowerment and disadvantage [5]. Related failings of the system to date have been brought into sharp relief by sector reviews, such as the Victorian Royal Commission in Mental Health [6], and include deeply embedded systemic problems entrenched in existing organization structures and norms that have dictated service design and delivery to date. In turn, solutions at the whole of systems-level are recommended, placing the consumer voice and consumer leadership at the centre of reform [6]. With this comes a need to develop the roles and opportunities for effective participation and leadership of people with lived experience, supported by a new government agency led by consumers [5]. While these opportunities are emerging across the mental health sector, demand for consumer participation is accelerating at a rate that is not yet fully supported by the capacity of the lived experience workforce and the readiness of sector organizations.

Barriers to inclusion of consumers in decision-making include inherent power imbalances within the mental health sector, and limited trust between consumer and clinicians and policymakers [7]. Victoria’s lived experience engagement framework stresses the importance of consumer participation activities addressing safety and power–recognising that consumers have often experienced significant powerlessness in their interactions with the mental health system and that being in decision-making spaces can be intimidating and disempowering [8]. The existing culture of traditional workplaces is often alienating for consumers, with lived experience workers often lacking confidence due to a fear of being seen as unprofessional in spaces where consumer values are not entrenched in the organization, particularly at the executive management level [9]. Organizational readiness and commitment are critical to supporting and empowering lived experience workers, with best practice examples involving organizations embracing long term organizational and cultural change influenced by lived experience values [9]. Strategies for addressing the imbalance of power and empowering consumers are discussed in literature on co-production and characterised as “endless” [4]. Power re-distribution and supporting consumers is a complex undertaking that does not lend itself to single prescriptive measures, and thus further research and consolidation of that work is critical in establishing a code of best practice and organizational framework.

Effective engagement of consumer workers and leaders in the mental health system is dependent on understanding the optimal support and practice structures that promote the safe inclusion of expertise from those with lived experience. Approaches to consumer participation risk being tokenistic–seeking support after decisions have been made, relying on a single lived experience representative to advocate for an entire community and discipline, and providing limited career opportunities and remuneration for lived experience work [5]. Creation of sustainable opportunities for leadership for consumers would enhance respect for this unique knowledge base, and likely decrease stigmatization of mental illness and distress that encourage consumers to be transparent about their lived experience and to more confidently take on positions of leadership [6].

Within a fast-paced and ambitious reform agenda in Australia, government and organizations must be able to access comprehensive strategies for facilitating lived experience leadership in an evolving system. Professional training in areas of strategic and technical expertise within well considered governance and support structures is needed, yet best practice guidelines to date do not exist [10].

The primary purpose of the current review is to contribute to this new knowledge base, bringing academic and consumer voices together to consider how an organization can effectively support all levels of consumer workers and act as a voice for its lived experience membership and community members. Specifically, the review methodology and synthesis will be informed by consultation with the Victorian Mental Illness Awareness Council (VMIAC), the peak consumer body in Victoria and a consumer-run and led organization. As the lived experience workforce expands in the new mental health system, the organization is experiencing a period of significant growth and change, which may differ in important ways from typical organizational expansion. The challenges of scaling up and shifting operations will be informed by the results of this review.

Aim and objectives of the scoping review

The objectives of this scoping review are to identify key organizational features that facilitate safe inclusion of lived experience in decision-making and practice. The focus is on mental health services that i) are lived experience advocacy or peer support organizations in the mental health sector/s or ii) where lived experience membership (paid or voluntary) is central to advocacy and peer support operations. This scoping review aims to identify:

  1. The critical organizational elements of practice, governance, and culture that characterize mental health lived experience organizations, and thus identify potential mechanisms of efficacy.

  2. The evidence that exists for the impact of elements of lived experience organizations on members of their workforce.

  3. Synthesize forms of evidence, limitations & knowledge gaps, and recommendations in this content area.

Methods

The review will be guided by the Joanna Briggs Institute (JBI) methodology framework and is being conducted by a multidisciplinary team including lived experience research fellows. This protocol was also developed in line with the and Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) [11]. See S1 File for a complete PRISMA-P checklist for this protocol [12]. The final review will be conducted in line with the scoping review methodology published by Peters [13]. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) (www.prisma-statement.org/Extensions/ScopingReviews) will be used to structure the relevant items for reporting the full review, ensuring transparency and reproducibility. This scoping review protocol was registered in Open Science Framework database (registered: July 26, 2022; registration DOI: 10.17605/OSF.IO/NB3S5). The intended commencement and completion dates for this review are July 1, 2022 and April 1, 2023.

Inclusion criteria

The Population, Concept, and Context framework [14] will be used to determine studies that will be eligible for inclusion.

Participants

For the purpose of this review, participants include organizations for lived experience advocacy or peer support in the mental health sector/s. We will include organizations where lived experience membership (paid or voluntary) is central to advocacy and peer support operations. Lived/living experience workforces will refer to peers/consumers or carers who apply their own experience of mental health issues or experience with caring for those with mental health issues to support others in a work context (paid or voluntary).

Concept

The concept will comprise the characteristics of the organizations (i.e., elements of organizations that are set up around lived experience and mental illness and successfully support lived experience consumers (e.g., mental health and trauma)). These elements will include organizational practice, governance, and culture that support lived experience workforces. Examples of characteristics will include types of services provided, training and conduct of advocacy work, as well as elements of member support (e.g., recruitment, engagement, training, mentoring/supervision, career progression, trauma-informed interactions, and cultural safety with diverse populations [e.g., First Nations people]).

Context

This scoping review will consider any mental health setting, for children, youth, and adults. No geographical restrictions will be applied.

Types of sources

This scoping review will include published quantitative, qualitative, and mixed methods data of any study design including primary studies and reviews. Organizational reports, evaluations, and descriptive data on organizational and/or mental health outcomes (e.g., organizational elements and member support) will also be considered. Only references published in English will be considered for inclusion due to time and resource constraints.

Search strategy

A three-step search strategy will be utilized in this review. An initial limited search of PsycINFO will be undertaken, followed by analysis of the text words contained in the title and abstract, and of the index terms used to describe the article. A second search using all identified keywords and index terms will be across all included databases. The following databases will be searched: PsycINFO, MEDLINE, CINAHL, ProQuest, and EMBASE. Following recommendations by Aromataris and Riitano [15], unpublished studies and grey literature will also be examined. The unpublished literature search will include ProQuest Dissertations and Theses, Google, Google Scholar, and will also include searching pertinent government and lived experience organization website data to identify white papers (i.e., government reports) and research reports. We will check the reference lists of all included studies and relevant systematic reviews to identify additional studies missed from the original search (for example, unpublished or in-press citations). Studies published in English will be included. Studies published since 2000 will be included as the past two decades has seen considerable growth and advancements in the peer support workforce [16]. See S2 File for the complete MEDLINE search strategy and with explanatory contextual narrative. See S3 File for the complete grey literature search strategy.

Following the search, all identified citations will be uploaded into EndNote V.X9 bibliographic software management program. All duplicates will be removed in Endnote before exporting to Covidence systematic review software [17] for screening. Data will be extracted by two independent reviewers (AV and AM) using data extraction instruments that were pre-determined by the research team (see S4 and S5 Files). Depending on the volume of papers that are retrieved, other team members may also be involved in the extraction process. To ensure consistency is met, two reviewers (AV and AM) will pilot test the data extraction instruments by independently charting the data from a select sample (i.e., ≥5 articles). Any disagreements will be resolved through discussion with a third reviewer (JO). Once the pilot-tested data extraction instruments are approved for consistency, data from each included full-text article will be charted by one member and checked by a second member to ensure all relevant information is charted. The draft data extraction tool will be refined as necessary during the process of extracting data from each included paper. If modifications occur, they will be detailed in the review. Where necessary, authors of studies will be contacted to obtain missing information.

Data to be extracted will be separated into two data extraction instruments based on the following themes:

  1. Characteristics of included studies (see S4 File)

  2. Effectiveness of CRO elements (see S5 File)

Critical appraisal of individual sources of evidence

While not necessary for inclusion in a scoping review, a critical appraisal of the references included will be performed using relevant tools from the JBI [18]. One reviewer will rate study risk of bias, with full verification of all judgments (and support statements) by a second reviewer. In addition, the AACODS Checklist will be used to appraise grey literature based on the following criteria: authority, accuracy, coverage, objectivity, date, and significance [19].

Data management and mapping the results

As recommended by the JBI [18], we will narratively analyze and synthesize the evidence, drawing on lived experience organizational elements to thematically group study findings in the results and discussion sections of the manuscript. The data extracted will be presented in a tabular format using an inductive approach as per Pollock [20] and Pollock [21]. We will analyse the data by quantifying text and completing frequency counts of data extraction items [14, 18]. The items extracted will address the aims of the scoping review. This analysis will emphasise established and emergent recurring characteristics of organizational practice, governance, and culture to present an overview of prominent features of lived experience organizations according to the literature (see S4 and S5 Files). We are particularly interested in how the data defines organizational structure and values–how the organization is governed and operated and according to which ideological principles. S4 File details further investigation of the specific supports for the organization’s membership and workforce, with the expectation that these aspects will be the most unique to lived experience organizations.

We will also be collecting and reporting on the outcomes of the organizations represented in the review to map both how positive outcomes are defined for lived experience organizations and what characteristics are involved in these outcomes. These outcomes will be, where possible, summarised in tables according to S5 File. It is anticipated that outcomes will be significantly varied across organizations and studies and will not be pre-categorised in the manner of the organizational elements and features. Trends and recurring themes observed through mapping organization and study-specific outcomes will be logically summarised and discussed to draw together a clear picture of what the evidence is saying about the impact of these lived experience organizations on their workforce and membership.

To highlight the most and least frequently observed CRO elements, data will be charted in both tabular and graphical form. See S6 File for a tabular template. All information will be contextualised according to S4 File, which defines the study from which the organizational data has been extracted as well as key demographic information about the organizations in question. These reporting methodologies and the tables represented in S4S6 Files may be further refined once we have the results of the searches, with any modifications being reported in the review.

Stakeholder engagement

Stakeholders and end users of the scoping review will be involved in the co-creation of this scoping review from review commencement to completion [22]. Stakeholder participation will be to provide essential advice and guidance. Stakeholders will include VMIAC and The Australian Centre for Social Innovation (TACSI). VMIAC and TACSI have regularly consulted with researchers (JM, JO, AV, AM) conducting the review to co-develop all review elements. The development of the review’s published and unpublished grey literature search strategies has been conducted by consulting a senior health-science librarian (NP).

Ethics and dissemination

Ethical approval is not required for this scoping review given it is comprised of publicly available secondary data. Review findings will be disseminated in a peer reviewed journal and shared with lived experience organization stakeholders (i.e., VMIAC and TACSI) through meetings and conferencing.

Discussion

It is anticipated that this scoping review will map out the current evidence base underpinning best organizational practices in which lived experience workers are involved, particularly in the mental health system. The included evidence will likely highlight tensions between traditional organizational structures and the lived experience workforce and indicate alternate organizing principles and characteristics. Mapping the features of existing organizations will provide an overview of what a lived experience organization looks like according to current evidence, and how this image might develop in a rapidly changing landscape. This broad interrogation of what has been done to date will be valuable in identifying gaps in current service systems, and opportunities informing further work needs to be done to address them in research, policy, and practice.

This scoping review will map both the organizational features and outcomes reported in the literature, and therefore provide a means of evaluating the best practice approaches amongst the included studies. Where outcomes have been particularly successful and relevant, the characteristics of the organization will be especially useful for researchers and decision-makers moving forward. Significant organizational challenges will also be examined to identify necessary mental health lived experience organization growth areas. The review will act as a critical overview of what policymakers, researchers, and sector-leaders can and should investigate further in the ongoing development of lived experience inclusion and the lived experience workforce. This scoping review will be immediately utilised by associated stakeholders to inform their organizational development and planning work, and it is anticipated that the review will also be of value to the mental health sector at large in informing ongoing work in this emerging and critical aspect of the field.

Supporting information

S1 File. PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols) 2015 checklist.

(DOCX)

S2 File. Published MEDLINE database search strategy (searched July 26, 2022).

(DOCX)

S3 File. Unpublished and grey literature search strategy.

(DOCX)

S4 File. Data extraction instrument 1—Characteristics of included studies separated by study design.

(DOCX)

S5 File. Data extraction instrument 2 –Effectiveness of CRO elements.

(DOCX)

S6 File. Frequent CRO elements identified.

(DOCX)

S7 File. Data extraction instrument 4 –Impact of lived experience organizations on outcomes for members of their workforce.

(DOCX)

Acknowledgments

We wish to thank the wider project group and stakeholders at VMIAC and TACSI for their conceptual and contextual contributions.

Data Availability

No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.

Funding Statement

This scoping review is conducted with funding from the Victorian Department of Health and the Victorian Mental Illness Awareness Council (VMIAC). VMIAC lived experience staff had and will have a role in study design, data collection and analysis, decision to publish, and preparation of the manuscript. This collaboration was formed in order to mentoring a lived experience researcher officer who is based at VMIAC.

References

Decision Letter 0

Nyanyiwe Masingi Mbeye

20 Jan 2023

PONE-D-22-21212Characteristics of Mental Health Lived Experience Workforce Organizations: A Scoping Review ProtocolPLOS ONE

Dear Dr. Opie,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 06 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Nyanyiwe Masingi Mbeye, Ph.D

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please amend your authorship list in your manuscript file to include all authors.

3. Please amend your list of authors on the manuscript to ensure that each author is linked to an affiliation. Authors’ affiliations should reflect the institution where the work was done (if authors moved subsequently, you can also list the new affiliation stating “current affiliation:….” as necessary).

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

5. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #1: Partly

Reviewer #2: Yes

********** 

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

********** 

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The title contains four determinants (mental health, lived experience, workforce, organizations) which make it semantically confusiing. I may suggest "The lived experience workforce: A scoping review from mental health organizations". The literature review should highlight the top features that characterize organizations where lived experience workforce has a true voice rather than capitalizing on how essential it is to have this category of workforce. Moreover, researchers can consider one of the most significant challenges such as power imbalance as the center of the argument; this will help them too in having a well defined search for publications/documents. Furthermore, more details need to be given on the inclusion/exclusion criteria and keep them unchanged all through (line 22- "No restriction on date of publication", page 9, line 7 "Studies published since 2000 will be included". Finally, I suggest the inclusion of the planned statistical tests.

Reviewer #2: 1. This is an important scoping study. The study has already been registered at OSF registries (DOI:10.17605/OSF.IO/NB3S5) where the details of the methods have been described. Data collection began on 1st July and ended 1st December 2022. Rather than publishing the protocol again here I would rather you analyse the data and instead publish the results.

2. Somewhere in the protocol it is stated that "Studies published in English will be included with no restriction on date of publication." However, on page 9 you include the following statement, "Studies published in English will be included. Studies published since 2000 will be included as the past two decades has seen considerable growth .........." Please clarify which period this scoping review will cover.

3. The protocol does not include the key words that will be used to identify the eligible published articles or unpublished reports or policy statements.

4. This scoping review targets to achieve three aims. The 3rd aim "Identify forms of evidence to date and knowledge gaps" is not clear to me. Please clarify this aim further by stating exactly what you intend to do

********** 

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Nariman Ghader

Reviewer #2: Yes: Francis Kiweewa

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 May 5;18(5):e0283178. doi: 10.1371/journal.pone.0283178.r002

Author response to Decision Letter 0


24 Jan 2023

To the editorial office: Thank you for arranging this thorough and thoughtful review of our manuscript. We have responded to each comment below, point-by-point.

Reviewer 1, comment 1: The title contains four determinants (mental health, lived experience, workforce, organizations) which make it semantically confusing. I may suggest "The lived experience workforce: A scoping review from mental health organizations".

Authors’ Reply: We appreciate this feedback and have changed the title of the scoping review to "Characteristics of mental health consumer-run organizations: A scoping review protocol".

Reviewer 1, comment 2: The literature review should highlight the top features that characterize organizations where lived experience workforce has a true voice rather than capitalizing on how essential it is to have this category of workforce.

Authors’ Reply: We thank the reviewer for this helpful feedback. In response, the study now aims to identify

1. The critical organizational elements of practice, governance, and culture that characterize mental health CROs, and thus identify potential mechanisms of CRO efficacy.

2. The evidence that exists for the impact of CRO elements on members of their workforce.

3. Synthesize forms of evidence, limitations & knowledge gaps, and recommendations in this content area.

Reviewer 1, comment 3: Moreover, researchers can consider one of the most significant challenges such as power imbalance as the center of the argument; this will help them too in having a well-defined search for publications/documents.

Authors’ Reply: We thank the reviewer for this helpful feedback. In response, we will highlight significant challenges as a point of emphasis in the Scoping Review Results and Discussion sections. We have also revised the following text from:

“This scoping review will map both the organizational features and outcomes reported in the literature, and therefore provide a means of evaluating the best practice approaches amongst the included studies. Where outcomes have been particularly successful (or unsuccessful) and relevant, the characteristics of the organization will be especially useful for researchers and decision-makers moving forward.”

To: “This scoping review will map both the organizational features and outcomes reported in the literature, and therefore provide a means of evaluating the best practice approaches amongst the included studies. Where outcomes have been particularly successful and relevant, the characteristics of the organization will be especially useful for researchers and decision-makers moving forward. Significant organizational challenges will also be examined to identify necessary CRO growth areas.”

Reviewer 1, comment 4: Furthermore, more details need to be given on the inclusion/exclusion criteria and keep them unchanged all through (line 22- "No restriction on date of publication", page 9, line 7 "Studies published since 2000 will be included".

Authors’ Reply: Thank you for this comment, a publication limitation has been added to the abstract. This now reads: “Included studies will be identified through comprehensive searches of five databases: PsycINFO (Ovid), CINAHL (EBSCO), EMBASE (Ovid), MEDLINE (Ovid), and ProQuest Central. Studies published in English from 2000 onwards will be included”

Reviewer, comment 5: Finally, I suggest the inclusion of the planned statistical tests.

Authors’ Reply: As this is a scoping review, there will be no statistical tests completed. We will narratively synthesize the result, as reported on page 10 and 11 of the manuscript.

Reviewer 2, comment 1: This is an important scoping study. The study has already been registered at OSF registries (DOI:10.17605/OSF.IO/NB3S5) where the details of the methods have been described. Data collection began on 1st July and ended 1st December 2022. Rather than publishing the protocol again here I would rather you analyse the data and instead publish the results.

Authors’ Reply: Thank you for seeing the value in this body of work. We will complete the review proper in the coming months and will then submit that for publication also.

Reviewer 2, comment 2: Somewhere in the protocol it is stated that "Studies published in English will be included with no restriction on date of publication." However, on page 9 you include the following statement, "Studies published in English will be included. Studies published since 2000 will be included as the past two decades has seen considerable growth .........." Please clarify which period this scoping review will cover.

Authors’ Reply: Thank you for this comment, a publication limitation has been added to the abstract. This now reads: “Included studies will be identified through comprehensive searches of five databases: PsycINFO (Ovid), CINAHL (EBSCO), EMBASE (Ovid), MEDLINE (Ovid), and ProQuest Central. Studies published in English from 2000 onwards will be included”

Reviewer 2, comment 3: The protocol does not include the key words that will be used to identify the eligible published articles or unpublished reports or policy statements.

Authors’ Reply: Thank you for this feedback, in response the key words have been to: “Consumer run organization, lived experience organization, lived experience workforce, mental health, scoping review, protocol”

Reviewer 2, comment 4: This scoping review targets to achieve three aims. The 3rd aim "Identify forms of evidence to date and knowledge gaps" is not clear to me. Please clarify this aim further by stating exactly what you intend to do

Authors’ Reply: Thank you for this comment. The study aims have now been changed to:

1. The critical organizational elements of practice, governance, and culture that characterize mental health CROs, and thus identify potential mechanisms of CRO efficacy.

2. The evidence that exists for the impact of CRO elements on members of their workforce.

3. Synthesize forms of evidence, limitations & knowledge gaps, and recommendations in this content area.

Editorial office, comment 1: Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Authors’ Reply: The PLOS ONE style templates have been reviewed and the current manuscript adheres to all stylistic requirements.

Editorial office, comment 2: Please amend your authorship list in your manuscript file to include all authors.

Authors’ Reply: This has now been amended – see cover page document.

Editorial office, Comment 3: Please amend your list of authors on the manuscript to ensure that each author is linked to an affiliation. Authors’ affiliations should reflect the institution where the work was done (if authors moved subsequently, you can also list the new affiliation stating “current affiliation:….” as necessary).

Authors’ Reply: All current author affiliations were the institution were the author worked while completing the review for the review protocol. Author affiliations have now been revised to:

Jessica E. Opie Ph.D. ab*, An Vuong BPsych ab, Alexandra Macafee BA c , Natalie Pearce BPsySc d, Erandathie Jayakody BCom LLB b, Christropher Maylea DSW b , Hanan Khalil Ph.D. b, Jennifer E. McIntosh Ph.D. ab

a Bouverie Centre La Trobe University, Melbourne, Australia, 3056.

b La Trobe University, Melbourne, Australia, 3000.

c The Victorian Mental Illness Awareness Council (VMIAC), Melbourne, Australia, 3057.

d Library, Latrobe University, Bendigo, Australia, 3551.

Editorial office, comment 4: Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Authors’ Reply: We thank the reviewer for noting this. The manuscript already includes titles for all Supporting information. If a caption is always required this can be identical to the title.

Editorial office, comment 5: Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Authors’ Reply: All manuscript references have been reviewed, and are complete and correct. No retracted paper has been cited in the present manuscript.

Decision Letter 1

Jonas Preposi Cruz

20 Feb 2023

PONE-D-22-21212R1Characteristics of mental health consumer-run organizations: A scoping review protocolPLOS ONE

Dear Dr. Opie,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Apr 06 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jonas Preposi Cruz

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The author has introduced appropriate changes. I still don't see any adjustment to the study title, though. As far as it is for the protocol itself, planned data management is still not fully explained. In response to the author's reply to Reviewer 1- comment 5 and Reviewer 2-comment 1, it is well understood that no statitistical tests will be done in the protocol; however, the manuscript shall fully disclose the researchers' statistical analysis plan that will be implemented at a later stage.

Reviewer #2: The authors have done a great job in addressing the previous review comments and the necessary revisions have made to provide more clarity.

I am satisfied with the responses to the issues I had previously raised.

I have no additional comments.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Nariman Ghader

Reviewer #2: Yes: Francis Kiweewa

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 May 5;18(5):e0283178. doi: 10.1371/journal.pone.0283178.r004

Author response to Decision Letter 1


21 Feb 2023

To the editorial office: Thank you for arranging this thorough and thoughtful review of our manuscript. We have responded to each comment below, point-by-point.

Comment 1: Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

Authors’ Reply: We are glad the manuscript has met this criterion.

Comment 2: Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

Authors’ Reply: We are glad the manuscript has met this criterion.

Comment 3: Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Authors’ Reply: We are glad the manuscript has met this criterion.

Comment 4: Have the authors described where all data underlying the findings will be made available when the study is complete?

Authors’ Reply: In response, the following text has been included on page 14 of the manuscript:

“Data availability statement: All relevant data from this study will be made available upon study completion.”

Comment 5: Is the manuscript presented in an intelligible fashion and written in standard English?

Authors’ Reply: We are glad the manuscript has met this criterion.

Comment 6:

Reviewer #1: The author has introduced appropriate changes. I still don't see any adjustment to the study title, though. As far as it is for the protocol itself, planned data management is still not fully explained. In response to the author's reply to Reviewer 1- comment 5 and Reviewer 2-comment 1, it is well understood that no statistical tests will be done in the protocol; however, the manuscript shall fully disclose the researchers' statistical analysis plan that will be implemented at a later stage.

Authors’ Reply: Thank you for this feedback. We have changed the title from “Characteristics of mental health consumer-run organizations: A scoping review protocol” to “Practice, governance, and culture characteristics of lived experience organisations, and evidence of efficacy: A Scoping Review Protocol”

Regarding the data management plan, scoping reviews are a type of evidence synthesis that aim at identifying and mapping the literature on a particular topic within a specific context. Unlike, systematic reviews, they do not have any statistical analysis due to the heterogeneity of the types of studies included. Data synthesis includes a narrative synthesis of the results to address the research question as per Pollock et al. (2022a) and Pollock et al. (2022b).

We have included the following paragraph on page 11:

“The data extracted will be presented in a tabular format using an inductive approach as per Pollock et al. (2022a) and Pollock et al. (2022b). We will analyse the data by quantifying text and completing frequency counts of data extraction items (Aromataris & Munn, 2020; Peters et al., 2022). The items extracted will address the aims of the scoping review. This analysis will emphasise established and emergent recurring characteristics of organizational practice, governance, and culture to present an overview of prominent features of lived experience organizations according to the literature (see Supporting Information 4).”

References:

Aromataris E, Munn Z, editors. JBI manual for evidence synthesis. Adelaide: The Joanna Briggs Institute; 2020. http://dx.doi.org/10.46658/ JBIMES-20-01

Peters, M. D., Godfrey, C., McInerney, P., Khalil, H., Larsen, P., Marnie, C., ..., & Munn, Z. (2022). Best practice guidance and reporting items for the development of scoping review protocols. JBI Evid Synth, 20(4), 953-968.

Pollock D, Tricco AC, Peters MD, Mclnerney PA, Khalil H, Godfrey CM, Alexander LA, Munn Z. Methodological quality, guidance, and tools in scoping reviews: a scoping review protocol. JBI Evidence Synthesis. 2022a Apr 1;20(4):1098-105

Pollock D, Peters MD, Khalil H, McInerney P, Alexander L, Tricco AC, Evans C, de Moraes ÉB, Godfrey CM, Pieper D, Saran A. Recommendations for the extraction, analysis, and presentation of results in scoping reviews. JBI evidence synthesis. 2022b Sep 8:10-1124.

Reviewer #2: The authors have done a great job in addressing the previous review comments and the necessary revisions have made to provide more clarity. I am satisfied with the responses to the issues I had previously raised. I have no additional comments.

Authors’ Reply: We thank you kindly for this feedback and for taking the time to review this paper.

Decision Letter 2

Jonas Preposi Cruz

6 Mar 2023

Practice, governance, and culture characteristics of lived experience organizations, and evidence of efficacy: A scoping review protocol

PONE-D-22-21212R2

Dear Dr. Opie,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Jonas Preposi Cruz

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols) 2015 checklist.

    (DOCX)

    S2 File. Published MEDLINE database search strategy (searched July 26, 2022).

    (DOCX)

    S3 File. Unpublished and grey literature search strategy.

    (DOCX)

    S4 File. Data extraction instrument 1—Characteristics of included studies separated by study design.

    (DOCX)

    S5 File. Data extraction instrument 2 –Effectiveness of CRO elements.

    (DOCX)

    S6 File. Frequent CRO elements identified.

    (DOCX)

    S7 File. Data extraction instrument 4 –Impact of lived experience organizations on outcomes for members of their workforce.

    (DOCX)

    Data Availability Statement

    No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES