Skip to main content
PLOS One logoLink to PLOS One
. 2022 Aug 18;17(8):e0273361. doi: 10.1371/journal.pone.0273361

Using systems-mapping to address Adverse Childhood Experiences (ACEs) and trauma: A qualitative study of stakeholder experiences

Thi Hoang Vu 1,*, Jared Bishop 2, Leigh McGill 2, Luke Valmadrid 2, Shelley Golden 2, Dane Emmerling 2, Seth Saeugling 3
Editor: Sara Rubinelli4
PMCID: PMC9387783  PMID: 35980992

Abstract

Adverse childhood experiences (ACEs) and trauma have been linked to decreased psychosocial and physiological health functioning. While various individual and community-level interventions to address ACEs have been reported, one novel approach that has not been explored in detail is a community-engaged causal loop diagramming project, or systems mapping project (SMP), in which diverse stakeholders work together to document the forces that are creating the outcomes and patterns within the community. To better document and understand the impact of participation in an SMP, we conducted in-depth, qualitative interviews with 16 stakeholders who were involved in a systems-mapping process facilitated by a local nonprofit in Eastern North Carolina. We used an iterative, content analysis coding process to generate and analyze themes from these interviews. Three major themes emerged: 1) Recognition and understanding of own trauma, 2) Trauma as both a community issue and an individual issue, and 3) Systems-mapping as a conceptual tool with practical benefits. All participants strongly recommended the systems-mapping approach to other communities and believed that it is a valuable tool for empowerment and provided several considerations for future organizers of similar systems-mapping projects. Our findings suggest that systems mapping is a feasible, transferable, and promising modality for understanding and addressing ACEs at the individual, interpersonal, and community-levels, as well as for putting community voices at the forefront of efforts to address ACEs.

Introduction

Adverse childhood experiences (ACEs) are stressful, traumatic events experienced by children that can result in substantial emotional and chronic stress, and continue to impact their lives as adults. Some examples of ACEs include neglect, abuse, experiencing discrimination, bullying, and witnessing events like maltreatment of family members and community violence [1]. Data from 23 states in the 2014 Behavioral Risk Factor Surveillance System survey reported that 62% of 214,157 survey participants had experienced at least 1 ACE and 25% reported having experienced 3 or more ACEs, defined by the survey as incidences of physical, sexual, or emotional abuse, as well as household mental illness, household substance use, incarcerated household member, parental separation or divorce, and household domestic violence, before the age of 18 [2]. Communities of color and lower-income communities face higher risks for experiencing ACEs compared to white and higher income populations [3]. Additionally, a 2018 report from the National Advisory Committee on Rural Health and Human Services suggest that nearly 29% of children living in rural areas experience two or more ACEs compared to 21% of children living in urban areas, and that rural children were more likely to experience abuse and neglect compared to urban children [4].

ACEs and chronic trauma exposure in childhood can result in both immediate and long-lasting health outcomes [5, 6], including increased risk of lung cancer, diabetes, cardiovascular disease, and obesity; mental health conditions like PTSD and depression; and changes to brain structure [7]. Additionally, health-risk behaviors with strong social and environmental determinants, like tobacco use and substance abuse [6, 811] have also been linked to ACEs and chronic trauma exposure. Furthermore, higher numbers of ACEs have been associated with less health care use and access [12]. Drawing on studies between 1998 and 2017 in North America, the estimated total healthcare costs of diseases associated with ACEs, such as anxiety, depression, cardiovascular disease, cancer, diabetes, and respiratory disease was $748 billion [13]. Due to the compounding nature of both the morbidities mentioned and health care utilization, persons with ACEs face multiplicative, intersecting barriers to achieving their optimal health [14].

ACEs are heavily shaped by social, historical, and environmental determinants. Thus, the last few decades of literature surrounding ACEs and traumatic stress have highlighted the importance of systemic approaches to address and prevent trauma across multiple societal sectors [10]. However, many primary and secondary prevention efforts are still focused on individuals and families [10]. A systematic review of interventions to improve outcomes for persons who have experienced ACEs found that the most common types of interventions represented in the literature include cognitive-behavioral therapy, motivational interviewing, family therapy, and parent/guardian training to improve mental resilience [15]. Even though people exposed to ACEs have diverse and complex needs beyond the individual-level, community-level interventions that consider broader environmental stressors were sparsely represented [15]. Moving beyond trauma-specific services to trauma-informed systems could not only reduce the negative consequences of trauma and promote healing for individuals [16], but also diversify the evidence base for development of future programs and policies [15]. One promising modality of creating trauma-informed systems is community-based system thinking processes.

In public health, systems thinking views each element that impact individual and community health as interrelated and dynamic [17] and involves looking at how the relationships between individual factors and larger structural and social forces influence health outcomes at the individual and population level [18]. Therefore, systems thinking allows stakeholders and organizations connect upstream and downstream factors specific to a community and identify critical points for interventions across multiple societal levels [19, 20]. One specific tool employed in systems thinking is the creation of a causal loop diagram, more commonly known as a systems map, of feedback loops that illustrate the patterns of forces that are causing and influencing observable outcomes [21]. Relationships between each element in a diagram are represented through arrows. Positive relationships between elements where both elements progress in the same direction are represented through “pluses,” and negative relationships between elements where each element progress in opposite directions are represented through “minuses” next to the arrows [21]. Systems thinking, specifically systems mapping, has provided direction and novel insights for actions taken by community organizations and researchers [22, 23] and have also significantly influenced program implementation and resource allocation of state-level and county-level health initiatives [24, 25]. In particular to ACEs, however, systems thinking has mainly been used to identify potential leverage points for interventions [26, 27]. For example, causal loop diagrams have been developed by researchers to understand how community programs, social services, and the built environment interact to promote social and emotional well-being in children [26] as well as how parental opioid use can be predictors of child maltreatment and children’s’ maladaptive coping behaviors, thereby perpetuating the cycle of ACEs [27].

In practice, systems-mapping usually happens in an academic setting where the participants doing the mapping are often professional and privileged individuals, such as professors, funders, and researchers [28, 29]. Systems thinking projects are rarely developed through co-creation with local community leaders and community members, especially in contexts such as the rural southern United States [30]. There are few examples that document the impact of systems-mapping within the context of a grassroots community and alongside under-resourced community members with lived experience and proximity to the challenges that are being mapped [28].

Thus, this paper describes a collaborative, community-led systems-mapping project (SMP) facilitated by Rural Opportunity Institute (ROI) and the sub-project (qualitative interviews) of analyzing the impact of the mapping efforts on community members. We seek to add knowledge and examples of how this process can be used with and alongside community members, and how lived experience and insights can drive the mapping process to inform interventions. We engaged ROI stakeholders who participated in the SMP, or who have worked with ROI on initiatives informed by the SMP. The aim of this study is to better understand: 1) individual and community-level impacts of systems-mapping; 2) how systems thinking can be leveraged to address ACEs and trauma; and 3) lessons-learned and recommendations for communities looking to apply systems thinking to addressing health issues.

Methods

Context: The ROI systems-mapping process

ROI is a non-profit operating in Edgecombe County, North Carolina, USA. Edgecombe County is a rural county in eastern North Carolina with a population of almost 52,000 in 2019 [31]. The median household income in 2019 was approximately $36,000. About 21% of the population live below the poverty line [31]. The overall objective of ROI’s systems science work is to increase the capacity of public agencies within Edgecombe County to more effectively address the trauma/ACEs faced by members of the community and end generational cycles of trauma and poverty. Through building networks, strengthening capacity, and supporting existing programs and public agencies within the system to implement best practices around becoming trauma-informed, ROI aims to support a holistic community effort where the dominant response across public agencies within the system is to provide healing, restorative practices, and skill building as a response to trauma [32].

Between September 2017 and May 2018, ROI hosted eight community meetings to create the systems-map (Fig 1). The meetings happened every eight weeks and were held at rotating locations in trusted spaces in the community, such as a local recreation center, a public school, the community college, the county government auditorium, and a local business. Meetings were open to the public and engaged 413 community members in total (an average of 52 members per meeting) [33]. Demographic information for these stakeholders can be found in S1 Table. At these meetings, community members discussed forces that contribute to the current level of ACEs/trauma in Edgecombe County, as well as forces that help provide healing. First, community members shared their experiences of where trauma and stress show up in their lives and in the community, along with what spaces, programs, organizations, and people support healing and recovery. For each theme identified in the first step, for example, “high rates of teen pregnancy in our community,” community members then brainstormed upstream causes and downstream impacts. Using notecards, sticky notes, and poster paper, community members built a rough draft of the systems map to visualize the interactions between the themes, causes, and impacts identified [33]. Using the rough draft built by stakeholders (Fig 2), ROI then contracted with Engaging Inquiry, a purpose-built consulting practice that supports communities to use participatory systems mapping [34], to create the final map (Fig 3). ROI and Engaging Inquiry then facilitated a Leverage Workshop with cross-sector community leaders to identify high-leverage intervention points within the map [33].

Fig 1. A meeting engaging community members to brainstorm ideas for the systems-map.

Fig 1

Fig 2. A rough draft of a working systems-map.

Fig 2

Fig 3. The final systems-map.

Fig 3

The final outcome of the map and workshop was the creation of a three-part strategy to address trauma defined by community members: 1) Learn: increase knowledge and skills about what trauma/resilience is, and how to best manage stress; 2) Heal: shift practices and policies away from the currently dominant punitive response and towards a more restorative approach that helps people build skills; and 3) Connect: reconnect youth and adults with educational and professional opportunities [33]. ROI then formed a training collaborative of about 20 community members to research evidence-based practices that align with these strategies. To do so, the training collaborative spent about 3 months meeting with 5–8 other communities across the USA that were also conducting trauma and resilience work to learn more about their practices and how they can be applied to Edgecombe County [33]. The systems mapping process guided the development of several initiatives, such as: 1) a local training collaborative that has reached over 13,000 individuals through programs such as evidence-informed Reconnect for Resilience Trainings, listening circles, and awareness-building presentations; 2) a community accountability board made up of residents who oversee the training work; and 3) a biofeedback breathing program using HeartMath technology implemented in a local detention center and middle school [35].

Study design

This study adopted a qualitative design consisting of semi-structured, one-on-one interviews with ROI stakeholders to answer the following research questions: 1) What were the perceived individual, interpersonal, and societal level impacts of the SMP? and 2) How can systems-thinking be leveraged in other communities to address ACES and other public health issues?

ROI collaborated with a group of public health graduate students (THV, JB, LM, and LV) with field experience and didactic training in qualitative methods at a public research university in North Carolina to design and implement this study. This study was reviewed prior to the start of participant recruitment and deemed exempt by the University of North Carolina Institutional Review Board (#20–1983). This study’s methods and findings are reported following COREQ guidelines for qualitative research [36].

Sampling

We used purposive sampling and recruited participants electronically by posting an announcement in ROI’s monthly email newsletter, distributing electronic fliers, and making social media posts. These efforts reached approximately 200 individuals. Interested individuals then contacted the students determine eligibility and schedule an interview. Participants were eligible if they either participated in any activity of the SMP, and/or were involved in initiatives informed by the SMP.

Interview guides

The students (THV, JB, LM, and LV) conducted semi-structured, one-on-one interviews with current and former ROI stakeholders. All interviewers followed two semi-structured interview guides with questions and probes developed collaboratively between ROI staff (SS), faculty (SG), and graduate students (THV, JB, LM, LV, DE) at the university. We used the social-ecological framework to develop the interview guides in order to capture the interplay between individual, interpersonal, community, and societal impacts of the SMP [37]. Those who participated in initiatives informed by the SMP were asked about the personal and interpersonal impacts of the SMP, community-level impacts of the SMP, and recommendations and advice for other communities looking to conduct a similar project. Those who were directly involved in the SMP were also specifically asked about their individual experiences and involvement with creating the map itself. Each interview session consisted of only one interviewer and one participant, and the interviewers had no prior relationship or interactions with any of the participants. Participants provided verbal consent and received a $30 electronic gift card for completing the interview. Interview guides can be found in the S2 Table.

Data collection and analysis

Interviews were conducted through Zoom (version 5.4.8), a video and voice conferencing platform [38]. Interviews were conducted over video call (n = 11), and voice call (n = 5). All interviews were transcribed by Zoom, and then cleaned and checked for accuracy by the interviewer. Transcripts were uploaded into Dedoose version 8.3.45, 2020 [39], a qualitative coding software, for analysis. We performed content analysis [40] using a thematic approach [41]. In the deductive coding phase, THV, JB, LM, and LV (i.e., the coding team) developed a preliminary codebook based on topics covered in the interview guide. All coders then reviewed a sample of the same two transcripts to re-familiarize themselves with the data. Next, each coder independently coded the sample transcripts to apply preliminary codes and develop emerging codes in the inductive phase. All coders then met to discuss coding application and emergent codes. All coders worked together to refine the codebook and approve a final codebook. Coders were then split into two teams of two (THV and JB; LM and LV). The transcripts, including ones used as samples, were divided among the two teams. Within each team, coders then independently coded each transcript and met with each other upon coding completion to resolve any discrepancies in the coding application and make changes to the codebook as necessary. Transcripts were re-coded as needed after coders came to an agreement. Thus, each transcript was coded and reviewed for discrepancies by at least two coders. This process was followed for all transcripts to ensure strong inter-coder reliability. We generated code reports that indicated where and how each code was applied across interviews and used these reports to create initial themes. Coders refined and cross-checked themes with each other and then discussed with the larger research team to ensure consensus. No new codes and/or themes emerged after about half of the interviews were coded, but we continued with the coding process for the remaining transcripts to ensure data saturation, as recommended in the qualitative literature [4244]. The entire study team (all authors) approved of the final list of themes and illustrative quotes.

Results

Participant characteristics

The student team interviewed stakeholders who directly participated in the SMP (n = 8) and stakeholders who were involved in initiatives informed by the SMP (n = 8). The average age for all participants was 53.6 (range 32–73). 47% of participants identified as Black, 60% identified as female, and all participants had completed high school. Additional participant characteristics are found in Table 1.

Table 1. Self-reported characteristics of interview participants.

Characteristic Overall (n = 16)a Participated in SMP (n = 8)b Did Not Participate in SMP (n = 8)
Mean age (range), years 53.6 (32–73) 54.7 (32–73) 52.6 (45–61)
Racial Identity
 Black 7 3 4
 White 8 4 4
Gender
 Female 9 1 8
 Male 6 6 0
Highest Level of Education
 High School 1 0 1
 Some College 1 1 0
 Bachelor’s 4 2 2
 Master’s 7 2 5
 Doctorate or more 2 2 0

aOne participant’s demographic information was not obtained. Percentages were calculated excluding that missing information.

bOne participant declined to share their age. Values were calculated excluding that missing information.

Themes

The analysis resulted in three major themes: 1) The SMP helped participants better understand their own trauma; 2) The SMP fostered greater interpersonal connections in the community and allowed participants to view trauma as both a community issue and individual issue; and 3) Participants viewed the SMP as useful conceptual and practical tool. Participants also offered suggestions for other communities looking to conduct a similar SMP. These include ensuring a diversity of stakeholders, letting community members play a leading role in design and implementation, and the importance of genuine relationship-building between non-profit organizers and community members.

Theme 1: Participants felt a greater recognition and understanding of their own trauma

All participants expressed that the SMP helped them better understand trauma broadly, as well as how it has manifested in their personal lives, by highlighting instances where they shared aspects of their own identities, upbringing, and past traumatic experiences. For example, one participant shared how the SMP was an introspective process that prompted them to recognize their own trauma:

even as an older adult, you know, you still deal with these traumas that may be buried, you know; and so, you know, you know, a lot of things came back and having to deal with those things or rethink, you know

(Higher education representative)

Stakeholders expressed that recognition of trauma is one of the first steps in addressing the effects of trauma. One participant, for example, spoke about how the perception that trauma is “just a way of life” masks the effects of traumatic experiences and hinders efforts to address them:

Something would be diagnosed as trauma, but growing up, it was just a way of life. I mean it, this is what it is. So you don’t see it being something that’s trauma or whatever because your friends are going through the same thing you were going through. So this is like a way of life versus, you know, something that shouldn’t have to take place, you know? And I think that process kind of opened some eyes in the room on what adverse childhood trauma is.

(Nonprofit employee)

Theme 2: Participants came to see trauma as both a community issue and an individual issue

Participants reported greater connection to other community members through their participation in the SMP. All participants highlighted how their involvement in the SMP put them in contact with individuals they would have never been connected to otherwise, especially individuals from different sectors, organizations, and backgrounds:

So there are things, for example, like relationships built for community members that would have never spoken before, so I as a principal wouldnt necessarily have navigated. But now all of a sudden I have these connections to new people. So were able to build partnerships for support I didn’t know existed.

(Principal)

The SMP also facilitated a discussion about ACEs that took away individual blame on any one person or agency, to instead create a shared understanding around systemic causes of trauma and foster a greater sense of compassion and empathy. In short, participants experienced a shift to a mindset that was less focused on punishment and control, and more focused on healing, skill-building, and restoration both with themselves and with their neighbors.

I think that we need to make sure that people understand that it can happen to everyone, that, it’s not somebody else’s problem. It’s the community’s problem. And lots of people have experienced trauma, but they’ve kept it to themselves. And they, I mean, thats proventhat a lot of people have experienced trauma and just never discussed itbut just help people understand that there’s nothing to be ashamed of, that what they’ve experienced is not their fault. Yeah, removing the blame.

(Community college staff member)

Theme 3: Participants viewed systems-mapping as a conceptual tool with practical benefits

Stakeholders highlighted that the visualization aspect of systems thinking, specifically systems-mapping, is a unique asset that shines a spotlight on individual, interpersonal, and structural causes of trauma. Systems thinking allowed participants to translate their stories into visual feedback loops, and then to see how these stories and loops connected with each other. Visualizing these stories allowed participants to take a step back and reflect on how their own personal experiences with trauma relate to larger systemic and intergenerational causes of trauma. Not only could participants see their experiences represented in the systems-map, but they also observed interconnections with the experiences of their neighbors.

If you look at the map itself, there are these areas that have like plus signs and minus signs. And that’s kind of like, you know, the areas that the loop is reinforced or weakened, and I thought that it was just really interesting to think about. It’s just life right? That like right there are some things compounded that are good and some things that are compounded that are bad. And let’s make meaning of the outcome. And I just thought that was really interesting reflection, because again I hadn’t considered that beforeThis is like super interesting to see all those circles and cycles working in tandem to create the site problem and or solution

(Principal)

There are also practical benefits of the SMP. For example, active participation of community members in development and creation of the SMP generated community investment and ownership in the initiatives that arose from the findings of the project. As one participant stated, “people start gaining interest and they start gaining a voice and by having that voice, they have ownership to what’s being done with being said, which is going to increase their commitment. So I don’t think they would have the commitment, the level of buy-in had they not done that mapping process” (Counselor and Licensed Therapist).

Additionally, five participants spoke about how the knowledge gained from the SMP affected how they address trauma in their everyday work. One participant, for example, said that how they approach students as an educator has changed as a result of their participation:

We want students to understand that we know that you go through things as wellwhen you come to school, ‘how can we make school life better, even though you have these things going on?’ And building that relationship with the students in order to allow them to be the best student as a whole, instead of just their academics. ‘How is home?’ You know, ‘is there anything that I can do to help you to help make things better for you at home,’ as opposed to just come into school learning math, science, social studies and language arts.

(Guidance Counselor)

Another participant who worked in healthcare noted an increased confidence working with clients on issues surrounding trauma as a result of the SMP:

I’m learning new things andI would say its given me some renewed confidence and working with children and adults that have been impacted by trauma.

(Health Care Provider)

Considerations for organizers of future systems-mapping projects

Stakeholders who directly participated in the SMP (n = 8) were asked specific questions about their experience with the process itself. All participants emphasized that ROI organizers played an important role in how they perceived the SMP. Participants suggested having dedicated leaders and organizers who are genuine, compassionate, and intentional in their efforts is crucial to stakeholder experience and successful project outcomes. Participants repeatedly emphasized their positive experiences with ROI leadership as one of the reasons they started working with and are continuing to do work around trauma and resilience in partnership with the organization. In particular, participants stressed that it is not enough for organizers to simply include the community; they must also let community stakeholders play a leading role. This includes organizers being open to receiving feedback and making changes as necessary:

They were very open to feedback and because with the feedback they could improve on what they would do if we gave them honest feedback and the leadership were always open to all, sometimes even criticism about the program. And they were always willing to fix whatever they thought might be broken.

(Community volunteer)

In addition, all participants expressed that organizers made genuine efforts to connect with community members on a deeper level, both within and outside of the SMP. By making themselves fully available to the community and fully invested in the community, participants felt that organizers were able to form trusting relationships with community members. These efforts created a space that was safe and affirming for community members to share their experiences with trauma.

They met with everybody you know, and you know you meet with people you let them know you’re, you’re not here to tear down, youre here to build them up, youre here to participate. Not, you know, observe and you want to pull people together not, you know, pull them apart, you want to, you want to be a part of the solution, not a part of the problem you, you want to help, not hurt. You know, so all those things. I think they did that and they took their time and they listen, listen to everybody.

(Higher education representative)

Lastly, all participants highlighted that the diversity of voices included in the SMP contributed to its success, noting the varied set of experiences and knowledge that each stakeholder brought to the discussion were extremely valuable. Three participants specifically attributed the diverse representation to the efforts of SMP organizers to invite and include everyone who wanted to take part in the SMP. Stakeholders found it extremely valuable to be able to look at an issue from different perspectives and hear directly from those who have experiences different from their own.

it was very interesting to hear from healthcare professionals or probation officers, or clergymen and to be talking about the same area and the same issues, but I thought through the lens of not only how they impact events, but what they were doing about it. And so it was the first time that I saw that like, the issue that I see can be solved in more than one way. And I think that that gave me a lot of hope.

(Principal)

While all participants expressed that the SMP facilitated by ROI was an extremely valuable process, they also noted several areas for improvements that organizers should consider when implementing a similar systems-mapping project. First, despite efforts to include diverse perspectives in the SMP, seven out of the eight participants we interviewed who directly participated in the mapping process itself felt there were still voices that were missing from the discussion. In particular, participants noted that representation from government officials, youth, and residents of neighboring counties was lacking.

Second, participation in the systems-mapping process prompted stakeholders to share personal identities and experiences that were re-traumatizing for some. One participant, for example, mentioned how participating in the SMP prompted him to talk about the loss of loved ones and revisit potential sources of trauma. In addition to emotional investment, participants also emphasized that there is no “quick fix” to systemic and intergenerational trauma, and communities should recognize that the systems mapping approach also requires substantial time and energy:

Again feet on the ground, hands to the handle. Its just going to take that sort of thingit has taken generations to break and be broken, and it’s going to take generations to fix. We got to have people who are willing to change, willing to fix things, willing to self-disclose, willing to self-examine, and, and so yes it’ll take a lot of work in every community.

(Director of Student Support Services)

A complete list of illustrative quotes can be found in S3 Table.

Discussion

In this study, we documented the stakeholder perceptions, experiences, and impact of participating in an SMP to address ACEs in rural county in Eastern North Carolina. All participants expressed that participation in the SMP generated individual, interpersonal, and community-level benefits, and they would strongly recommend a similar project in other communities looking to address complex health problems. Overall, these findings suggest that systems mapping is a viable and transferable approach with potential to address ACEs at multiple levels by engaging community voices to inform actionable solutions.

Our findings have several important implications. First, while various interventions to address ACEs and trauma have been described in the literature such as psychosocial and behavioral training [4547]; educational programs [4850], and arts-based therapies [5153], there is a dearth of information on the impact of community-engaged interventions, specifically a systems-thinking approach. Yet, there is already some preliminary evidence for the potential of systems-thinking to address public health issues. For example, one study engaged members of a rural Australian community to create a systems-map of determinants of childhood obesity to inform future prevention strategies at the community and policy level [54]. Another study from England engaged staff at various public health institutions to create a systems-map of mental health influences that could help further improve organizational approaches to improve population mental health [55]. Our study adds to the existing literature by illustrating that systems-mapping is a feasible and effective method to address another complex health issue—ACEs and trauma. In addition, our findings add to the evidence-base for how to leverage systems-mapping in a rural, Southern United States context.

Second, the available literature on systems-mapping projects in public health has called for projects to engage a wider, more diverse range of stakeholders. Participants of one project to promote physical activity in the United Kingdom noted that insufficient engagement across the full range of sectors and stakeholders created “gaps” in the map. While the process and final map they created were insightful, there were still missing pieces from limited community engagement that restricted the strength and credibility of the findings [56]. Similar recommendations have been put forth in other studies of systems-mapping projects [54, 55]. In fact, one of the limitations cited by Smith et al.’s causal loop diagramming project focused on parental opioid use and children’s emotional and mental wellbeing is that greater engagement of stakeholders with lived experiences would have strengthened the map’s effectiveness as a tool to identify intervention points [27]. Friel et al., [57] also noted that engaging only specific groups in the community, such as experts and professionals, may create biased mapping results. Our project expands on these recommendations by engaging many members of the community, all with different backgrounds and experiences, with a particular focus on grassroots community members who do not have affiliations in local formal organizations like the school system, health department, or law enforcement agency. Stakeholders we interviewed expressed that participation of people from so many facets of the community further illuminated the multiple systemic factors underpinning ACEs, as well as connections between systems that perpetuate trauma within communities. Despite this fact, several stakeholders felt that there were still missing voices. Thus, organizers of future systems-mapping projects should prioritize participant recruitment and engagement early in the process and continuously evaluate their engagement efforts throughout.

Third, there has been a call for systems-thinking projects to provide evidence of “real-world” benefits [58]. Systems-mapping projects pertaining to trauma and ACEs often do not report on the next steps, i.e., the programs and initiatives that come out of the project [26, 27, 29]. Participants in our study felt that diverse representation and inclusion in the SMP created community investment in the process and outcomes of the effort to foster tangible, coordinated, and community-led actions addressing ACEs. At the community-level, participants expressed that the process of creating the map and the map itself resulted in visible changes in how the community responds to trauma. First, findings from the training collaborative have informed programs such as Reconnect for Resilience Trainings, listening circles, and awareness-building presentations that have reached over 13,000 individuals in the community [35]. Residents also formed a community advisory board that oversaw education and training initiatives. To date, over 15,000 people have been trained in what trauma-informed practices look like and how stress impacts the brain and body [35]. Additionally, the systems-mapping process helped support a biofeedback breathing and meditation program implemented in a local detention center and middle school to alleviate anxiety symptoms among participants, as well as the hiring of clinical social workers in schools to work with students who have been expelled or suspended [35]. At the individual and interpersonal levels, participants saw changes in themselves and how they relate to others in their community due to the SMP and the programs resulting from it. Several participants mentioned that they have greater confidence talking about sensitive topics in their line of work, such as being a counselor and educator. All participants felt that without the project and the subsequent programs it informed, they would have never been connected to so many of their fellow community members. Participants described an increased sense of belonging and purpose through these enhanced connections. Our results are in accordance with existing research illustrating that stakeholder engagement can significantly improve the effectiveness of programs by building on existing community efforts and resources [54, 59].

Another powerful takeaway of the individual-level impact is that physically mapping out the feedback loops helped participants who were directly involved in creating the map have a better understanding of ACEs and their own experiences with trauma, even prior to implementation of any programmatic efforts mentioned above. This suggests that the SMP can be an intervention within itself. For example, participants expressed that the act of mapping the loops allowed them to see the formerly invisible forces more explicitly, thereby helping to remove individual blame and a punitive mindset in understanding their own trauma and ACEs. A scoping review of how causal-loop diagramming has been used in public health found that the majority of studies used causal-loop diagramming to inform policy and practice, identify intervention points, and illustrate system complexity [29]. While the review found that there is a wide scope of public health issues represented, such as obesity, community violence, and infectious diseases, only three of the 23 studies captured by the review intended to use systems-mapping to help improve participants’ understanding of the public health issue [29]. These results, combined with our study’s findings, suggest that there is untapped opportunity to use the act of systems-mapping as an intervention itself to improve individual awareness and understanding of various public health concerns.

Lastly, our findings highlight that it is not enough for systems- mapping efforts to simply include the community, they must also engage the community as leaders and facilitators of these efforts. In doing so, systems-mapping projects can also more accurately capture the health needs and concerns of marginalized populations to more effectively reduce, racial, ethnic and class disparities in health [58]. However, stakeholders we interviewed noted caveats to successful stakeholder engagement that organizers must consider when implementing a systems-mapping project. Not only should organizers make targeted efforts to ensure diverse representation, but they should also consider how participation in such a project may require substantial time and energy from community members and can create emotional burden for stakeholders, especially when sensitive topics associated with ACEs come up, such as abuse. These findings are in accordance with current trauma-informed research on participant burden [60, 61]. Several participants expressed that while they valued the insight they gained about their own trauma and the trauma in their community, it was still difficult at times to share their experiences. Therefore, it is crucial that organizers of systems-mapping projects addressing trauma create an open and inclusive environment built on shared goals, understanding, compassion, and empathy.

Limitations and implications for future research

This study summarized the reactions of 16 people to a process that engaged over 400 community stakeholders in total. Although respondents were demographically diverse and represented different sectors of the community, some participant opinions may not be represented. In particular, participants who did not value the process may have removed themselves from ROI communications and not been aware of, or interested in, contributing to this study. Additionally, participant recall bias may have impacted participant responses, given that the systems-mapping project took place in 2017–2018 and the interviews in 2020–2021.

Despite these limitations, this study highlights many promising benefits of the systems mapping process engaging members of a community in a rural, majority African-American southern county in the United States. Future research should explore how systems thinking can be leveraged to address ACEs within different community contexts and with various groups of stakeholders, as well as more downstream effects of a systems-mapping project.

Supporting information

S1 Table. Demographics of all stakeholders who directly participated in the systems mapping project.

(DOCX)

S2 Table. Interview guides.

(DOCX)

S3 Table. List of themes and additional illustrative quotes.

(DOCX)

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

SS was a consultant for the Rural Opportunity Institute (ROI) project which led this community-based systems mapping process that was funded by The Anonymous Trust. The funder had no role in any way in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The funder does not have a website, but here is the ProPublica link about the funder (https://projects.propublica.org/nonprofits/organizations/266220561).

References

  • 1.Alhowaymel F, Kalmakis K, Jacelon C. Developing the Concept of Adverse Childhood Experiences: A Global Perspective. Journal of Pediatric Nursing. 2021. Jan;56:18–23. doi: 10.1016/j.pedn.2020.10.004 [DOI] [PubMed] [Google Scholar]
  • 2.Merrick MT, Ford DC, Ports KA, Guinn AS. Prevalence of Adverse Childhood Experiences From the 2011–2014 Behavioral Risk Factor Surveillance System in 23 States. JAMA Pediatr. 2018. Nov 1;172(11):1038. doi: 10.1001/jamapediatrics.2018.2537 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Kia‐Keating M, Barnett ML, Liu SR, Sims GM, Ruth AB. Trauma‐Responsive Care in a Pediatric Setting: Feasibility and Acceptability of Screening for Adverse Childhood Experiences. Am J Community Psychol. 2019. Dec;64(3–4):286–97. doi: 10.1002/ajcp.12366 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Belanger K, Benson W, Borders T, Dalton K, Emanuel-McClain C, Evans K, et al. Exploring the Rural Context for Adverse Childhood Experiences (ACEs) [Internet]. Department of Health and Human Services; 2018 Aug [cited 2022 Jan 22]. (National Advisory Committee on Rural Health and Human Services). https://www.hrsa.gov/sites/default/files/hrsa/advisory-committees/rural/publications/Rural-Context-for-ACEs-August2018.pdf
  • 5.Gilgoff R, Singh L, Koita K, Gentile B, Marques SS. Adverse Childhood Experiences, Outcomes, and Interventions. Pediatric Clinics of North America. 2020. Apr;67(2):259–73. doi: 10.1016/j.pcl.2019.12.001 [DOI] [PubMed] [Google Scholar]
  • 6.Overstreet S, Mathews T. Challenges associated with exposure to chronic trauma:Using a public health framework to foster resilient outcomes among youth. Psychol Schs. 2011. Aug;48(7):738–54. [Google Scholar]
  • 7.Anda RF, Felitti VJ, Bremner JD, Walker JD, Whitfield Ch, Perry BD, et al. The enduring effects of abuse and related adverse experiences in childhood: A convergence of evidence from neurobiology and epidemiology. Eur Arch Psychiatry Clin Neurosci. 2006. Apr;256(3):174–86. doi: 10.1007/s00406-005-0624-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Brown DW, Anda RF, Felitti VJ, Edwards VJ, Malarcher AM, Croft JB, et al. Adverse childhood experiences are associated with the risk of lung cancer: a prospective cohort study. BMC Public Health. 2010. Dec;10(1):20. doi: 10.1186/1471-2458-10-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Chapman DP, Dube SR, Anda RF. Adverse Childhood Events as Risk Factors for Negative Mental Health Outcomes. Psychiatr Ann. 2007. May;37(5):00485713–20070501–7. [Google Scholar]
  • 10.Oral R, Ramirez M, Coohey C, Nakada S, Walz A, Kuntz A, et al. Adverse childhood experiences and trauma informed care: the future of health care. Pediatr Res. 2016. Jan;79(1–2):227–33. doi: 10.1038/pr.2015.197 [DOI] [PubMed] [Google Scholar]
  • 11.Dong M, Giles WH, Felitti VJ, Dube SR, Williams JE, Chapman DP, et al. Insights Into Causal Pathways for Ischemic Heart Disease: Adverse Childhood Experiences Study. Circulation. 2004. Sep 28;110(13):1761–6. doi: 10.1161/01.CIR.0000143074.54995.7F [DOI] [PubMed] [Google Scholar]
  • 12.Alcalá HE, Valdez-Dadia A, von Ehrenstein OS. Adverse childhood experiences and access and utilization of health care. Journal of Public Health. 2018. Dec 1;40(4):684–92. doi: 10.1093/pubmed/fdx155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Bellis MA, Hughes K, Ford K, Ramos Rodriguez G, Sethi D, Passmore J. Life course health consequences and associated annual costs of adverse childhood experiences across Europe and North America: a systematic review and meta-analysis. The Lancet Public Health. 2019. Oct;4(10):e517–28. doi: 10.1016/S2468-2667(19)30145-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Barnes AJ, Anthony BJ, Karatekin C, Lingras KA, Mercado R, Thompson LA. Identifying adverse childhood experiences in pediatrics to prevent chronic health conditions. Pediatr Res. 2020. Jan;87(2):362–70. doi: 10.1038/s41390-019-0613-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Lorenc T, Lester S, Sutcliffe K, Stansfield C, Thomas J. Interventions to support people exposed to adverse childhood experiences: systematic review of systematic reviews. BMC Public Health. 2020. Dec;20(1):1–0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Loomis B, Epstein K, Dauria EF, Dolce L. Implementing a Trauma-Informed Public Health System in San Francisco, California. Health Educ Behav. 2019. Apr;46(2):251–9. doi: 10.1177/1090198118806942 [DOI] [PubMed] [Google Scholar]
  • 17.Leischow SJ, Best A, Trochim WM, Clark PI, Gallagher RS, Marcus SE, et al. Systems thinking to improve the public’s health. American journal of preventive medicine. 2008. Aug 1;35(2):S196–203. doi: 10.1016/j.amepre.2008.05.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Trochim WM, Cabrera DA, Milstein B, Gallagher RS, Leischow SJ. Practical challenges of systems thinking and modeling in public health. American journal of public health. 2006. Mar;96(3):538–46. doi: 10.2105/AJPH.2005.066001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.BeLue R, Carmack C, Myers KR, Weinreb-Welch L, Lengerich EJ. Systems Thinking Tools as Applied to Community-Based Participatory Research: A Case Study. Health Educ Behav. 2012. Dec;39(6):745–51. doi: 10.1177/1090198111430708 [DOI] [PubMed] [Google Scholar]
  • 20.Gillen EM, Hassmiller Lich K, Yeatts KB, Hernandez ML, Smith TW, Lewis MA. Social Ecology of Asthma: Engaging Stakeholders in Integrating Health Behavior Theories and Practice-Based Evidence Through Systems Mapping. Health Educ Behav. 2014. Feb;41(1):63–77. doi: 10.1177/1090198113486804 [DOI] [PubMed] [Google Scholar]
  • 21.Kiekens A, Dierckx de Casterlé B, Vandamme AM. Qualitative systems mapping for complex public health problems: A practical guide. PloS one. 2022. Feb 25;17(2):e0264463. doi: 10.1371/journal.pone.0264463 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Holliday CN, Morse SM, Irvin NA, Green-Manning A, Nitsch LM, Burke JG, et al. Concept Mapping: Engaging Urban Men to Understand Community Influences on Partner Violence Perpetration. J Urban Health. 2019. Feb;96(1):97–111. doi: 10.1007/s11524-018-0297-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Hennessy E, Economos CD, Hammond RA, Sweeney LB, Brukilacchio L, Chomitz VR, et al. Integrating Complex Systems Methods to Advance Obesity Prevention Intervention Research. Health Educ Behav. 2020. Apr;47(2):213–23. doi: 10.1177/1090198119898649 [DOI] [PubMed] [Google Scholar]
  • 24.Trochim WMK, Milstein B, Wood BJ, Jackson S, Pressler V. Setting Objectives for Community and Systems Change: An Application of Concept Mapping for Planning a Statewide Health Improvement Initiative. Health Promotion Practice. 2004. Jan;5(1):8–19. doi: 10.1177/1524839903258020 [DOI] [PubMed] [Google Scholar]
  • 25.Adams N. Using Community Engagement to Map Pathways of Opioid Use and Recovery. Journal of Community Health Nursing. 2020. Jan 2;37(1):1–8. doi: 10.1080/07370016.2020.1693089 [DOI] [PubMed] [Google Scholar]
  • 26.Poon BT, Atchison C, Kwan A. Understanding the Influence of Community-Level Determinants on Children’s Social and Emotional Well-Being: A Systems Science and Participatory Approach. International Journal of Environmental Research and Public Health. 2022. Jan;19(10):5972. doi: 10.3390/ijerph19105972 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Smith JC, Alderman L, Attell BK, Avila Rodriguez W, Covington J, Manteuffel B, et al. Dynamics of Parental Opioid Use and Children’s Health and Well-Being: An Integrative Systems Mapping Approach. Frontiers in psychology. 2021:2402. doi: 10.3389/fpsyg.2021.687641 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Cilenti D, Issel M, Wells R, Link S, Lich KH. System dynamics approaches and collective action for community health: an integrative review. American Journal of Community Psychology. 2019. Jun;63(3–4):527–45. doi: 10.1002/ajcp.12305 [DOI] [PubMed] [Google Scholar]
  • 29.Baugh Littlejohns L, Hill C, Neudorf C. Diverse Approaches to Creating and Using Causal Loop Diagrams in Public Health Research: Recommendations From a Scoping Review. Public Health Reviews. 2021:24. doi: 10.3389/phrs.2021.1604352 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Moore T, Bakken LL, Wallace B. The importance of systems thinking, context, and inclusion when studying the feasibility of expanding the FoodShare (SNAP) outreach program to rural communities of Northern Wisconsin. Evaluation and Program Planning. 2019. Jun 1;74:10–7. doi: 10.1016/j.evalprogplan.2019.02.003 [DOI] [PubMed] [Google Scholar]
  • 31.U.S Census Bureau. Quick Facts: Edgecombe County, North Carolina [Internet]. 2019 [cited 2021 Apr 14]. https://www.census.gov/quickfacts/fact/table/edgecombecountynorthcarolina/PST045219
  • 32.Rural Opportunity Institute. Rural Opportunity Institute: Supporting trauma-informed and resilient communities [Internet]. 2021 [cited 2022 Jun 22]. https://www.ruralopportunity.org/
  • 33.Saeugling S. Community-Based Systems Mapping to Promote Healing: Building empathy as a community engagement tool. [Power Point Presentation]. Rural Opportunity Institute. 2021 [cited 2022 Jun 22]. https://docs.google.com/presentation/d/1HoDMpFlCmzCHIChfPoOIGwMhnObvrOWeA6jfSElSntY/edit?usp=sharing
  • 34.Engaging Inquiry. Engaging Inquiry | Bringing Light to Complexity [Internet]. 2017 [cited 2022 Jun 22]. https://engaginginquiry.com/
  • 35.Rural Opportunity Institute. Rural Opportunity Institute: Our Initiatives [Internet]. 2021 [cited 2022 Jun 22]. https://www.ruralopportunity.org/initiatives
  • 36.Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. International journal for quality in health care. 2007. Dec 1;19(6):349–57. doi: 10.1093/intqhc/mzm042 [DOI] [PubMed] [Google Scholar]
  • 37.Centers for Disease Control and Prevention. The Social Ecological Model: A Framework for Prevention [Internet]. 2022 [cited 2022 Jun 16]. https://www.cdc.gov/violenceprevention/about/social-ecologicalmodel.html
  • 38.Yuan Eric. Zoom Video Communications, ver. 5.4.8 [web application]. San Jose (CA): Zoom Video Communications; 2011. [cited 2022 Jun 22]. http://www.zoom.us [Google Scholar]
  • 39.Lieber Eli, Weisner Thomas. Dedoose, ver. 8.3.45 [web application]. Los Angeles (CA): Dedoose: a web application for managing, analyzing, and presenting qualitative and mixed method research data; 2020. [cited 2022 Jun 22]. www.dedoose.com [Google Scholar]
  • 40.Hsieh H-F, Shannon SE. Three Approaches to Qualitative Content Analysis. Qual Health Res. 2005. Nov;15(9):1277–88. doi: 10.1177/1049732305276687 [DOI] [PubMed] [Google Scholar]
  • 41.Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006. Jan;3(2):77–101. [Google Scholar]
  • 42.Guest G, Bunce A, Johnson L. How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability. Field Methods. 2006. Feb;18(1):59–82. [Google Scholar]
  • 43.Morse JM. Determining Sample Size. Qual Health Res. 2000. Jan;10(1):3–5. [Google Scholar]
  • 44.Young DS, Casey EA. An examination of the sufficiency of small qualitative samples. Social Work Research. 2019. Mar 1;43(1):53–8. [Google Scholar]
  • 45.Agazzi H, Adams C, Ferron E, Ferron J, Shaffer-Hudkins E, Salloum A. Trauma-Informed Behavioral Parenting for Early Intervention. J Child Fam Stud. 2019. Aug;28(8):2172–86. [Google Scholar]
  • 46.Cohen JA, Berliner L, Mannarino A. Trauma focused CBT for children with co-occurring trauma and behavior problems. Child Abuse & Neglect. 2010. Apr;34(4):215–24. doi: 10.1016/j.chiabu.2009.12.003 [DOI] [PubMed] [Google Scholar]
  • 47.Hutchison M, Russell BS, Wink MN. Social‐emotional competence trajectories from a school‐based child trauma symptom intervention in a disadvantaged community. Psychol Schs. 2020. Aug;57(8):1257–72. [Google Scholar]
  • 48.Miller-Cribbs J, Bragg J, Wen F, Jelley M, Coon KA, Hanks H, et al. An evaluation of a simulation and video-based training program to address adverse childhood experiences. Int J Psychiatry Med. 2020. Sep;55(5):366–75. doi: 10.1177/0091217420951064 [DOI] [PubMed] [Google Scholar]
  • 49.Lowell DI, Carter AS, Godoy L, Paulicin B, Briggs-Gowan MJ. A Randomized Controlled Trial of Child FIRST: A Comprehensive Home-Based Intervention Translating Research Into Early Childhood Practice: Child FIRST: A Comprehensive Home-Based Intervention. Child Development. 2011. Jan;82(1):193–208. doi: 10.1111/j.1467-8624.2010.01550.x [DOI] [PubMed] [Google Scholar]
  • 50.Dubowitz H, Feigelman S, Lane W, Kim J. Pediatric primary care to help prevent child maltreatment: the Safe Environment for Every Kid (SEEK) Model. Pediatrics. 2009. Mar 1;123(3):858–64.39. doi: 10.1542/peds.2008-1376 [DOI] [PubMed] [Google Scholar]
  • 51.Lapum JL, Martin J, Kennedy K, Turcotte C, Gregory H. Sole Expression: A trauma-informed dance intervention. Journal of Aggression, Maltreatment & Trauma. 2019. May 28;28(5):566–80. [Google Scholar]
  • 52.Brooks CM, Daschuk MD, Poudrier J, Almond N. First Nations youth redefine resilience: listening to artistic productions of ‘Thug Life’ and hip-hop. Journal of Youth Studies. 2015. Jul 3;18(6):706–25. [Google Scholar]
  • 53.Shakoor S, Mankee-Williams A, Otis M, Bhui K. Creative arts and digital interventions: A discussion for prevention and recovery from mental health consequences of Adverse Childhood Experiences (ACEs) [Internet]. PsyArXiv; 2021. Feb [cited 2022 Jan 22]. Available from: https://osf.io/gz3q9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Allender S, Owen B, Kuhlberg J, Lowe J, Nagorcka-Smith P, Whelan J, et al. A Community Based Systems Diagram of Obesity Causes. Carpenter DO, editor. PLoS ONE. 2015. Jul 8;10(7):e0129683. doi: 10.1371/journal.pone.0129683 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Stansfield J, Cavill N, Marshall L, Robson C, Rutter H. Using complex systems mapping to build a strategic public health response to mental health in England. JPMH. 2021. Nov 26;20(4):286–97. [Google Scholar]
  • 56.Cavill N, Richardson D, Faghy M, Bussell C, Rutter H. Using system mapping to help plan and implement city-wide action to promote physical activity. J Public Health Res [Internet]. 2020. Aug 26 [cited 2022 Jan 22];9(3). Available from: https://jphres.org/index.php/jphres/article/view/1759 doi: 10.4081/jphr.2020.1759 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Friel S, Pescud M, Malbon E, Lee A, Carter R, Greenfield J, et al. Using systems science to understand the determinants of inequities in healthy eating. Bammann K, editor. PLoS ONE. 2017. Nov 30;12(11):e0188872. doi: 10.1371/journal.pone.0188872 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Rutter H, Savona N, Glonti K, Bibby J, Cummins S, Finegood DT, et al. The need for a complex systems model of evidence for public health. The Lancet. 2017. Dec;390(10112):2602–4. doi: 10.1016/S0140-6736(17)31267-9 [DOI] [PubMed] [Google Scholar]
  • 59.Parmar PK, Rawashdah F, Al-Ali N, Al Rub RA, Fawad M, Al Amire K, et al. Integrating community health volunteers into non-communicable disease management among Syrian refugees in Jordan: a causal loop analysis. BMJ open. 2021. Apr 1;11(4):e045455. doi: 10.1136/bmjopen-2020-045455 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Seedat S, Pienaar WP, Williams D, Stein DJ. Ethics of research on survivors of trauma. Curr Psychiatry Rep. 2004. Jul;6(4):262–7. doi: 10.1007/s11920-004-0075-z [DOI] [PubMed] [Google Scholar]
  • 61.van der Velden PG, Bosmans MWG, Scherpenzeel AC. The Burden of Research on Trauma for Respondents: A Prospective and Comparative Study on Respondents Evaluations and Predictors. van Os J, editor. PLoS ONE. 2013. Oct 21;8(10):e77266. doi: 10.1371/journal.pone.0077266 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Sara Rubinelli

6 Jun 2022

PONE-D-22-02363

Using Systems-Mapping to Address Adverse Childhood Experiences (ACEs) and Trauma: A Qualitative Study of Stakeholder Experiences

PLOS ONE

Dear Dr. Vu,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The reviewers have highlighted important strengths of this paper, but have also identified main points that require revisions at the conceptual, methodological and overall explanation level. 

Please submit your revised manuscript by Jul 21 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Monica Wendel

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. Please note that in order to use the direct billing option the corresponding author must be affiliated with the chosen institute. Please either amend your manuscript to change the affiliation or corresponding author, or email us at plosone@plos.org with a request to remove this option.

3. We note that Figure 1 includes an image of a [patient / participant / in the study].

As per the PLOS ONE policy (http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research) on papers that include identifying, or potentially identifying, information, the individual(s) or parent(s)/guardian(s) must be informed of the terms of the PLOS open-access (CC-BY) license and provide specific permission for publication of these details under the terms of this license. Please download the Consent Form for Publication in a PLOS Journal (http://journals.plos.org/plosone/s/file?id=8ce6/plos-consent-form-english.pdf). The signed consent form should not be submitted with the manuscript, but should be securely filed in the individual's case notes. Please amend the methods section and ethics statement of the manuscript to explicitly state that the patient/participant has provided consent for publication: “The individual in this manuscript has given written informed consent (as outlined in PLOS consent form) to publish these case details”.

If you are unable to obtain consent from the subject of the photograph, you will need to remove the figure and any other textual identifying information or case descriptions for this individual.

Additional Editor Comments:

The peer review is complete, and they recognize the valuable contribution of your manuscript to the current literature. The reviewers provided several critical suggestions to strengthen the manuscript for publication.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Using Systems Mapping to Address Adverse Childhood Experiences (ACEs) and Trauma

SM is useful in understanding and addressing ACES

Introduction:

-Describe what “1 ACES” vs “3 ACES” means. How are ACEs calculated?

-line 63 pg 3: change “attributable” to “associated with” & move the sentences about healthcare costs to the next paragraph after you talk about the kind of diseases/illnesses that ACEs contribute to

-Elaborate on current individual level interventions and the current gap

-Systems thinking is not a “critical component” of CBPR. CBPR can include systems thinking, but it can also be used to address individual level factors. I would argue that systems thinking, which is transdisciplinary in nature, requires community-based participation (in public health) but CBRP does not necessarily require systems thinking.

-The systems field typically refers to systems mapping in more specific techniques. In practice, it can be called system mapping. I suggest redefining systems mapping as community based systems dynamics or causal loop diagramming because this paper is for a technical audience, not community partners.

-Define systems thinking and cite it and systems mapping.

-I don’t know if I agree with the statement on lines 93-95. Do you have a citation?

-The sentence on line 99-100 needs to be reworded and less specific. Describe the overall type of NP and rename this section “Systems Mapping Process” not “project”

-Add more details to mapping process.

Methods:

-Move section about participants to methods & more detail about the participants. Where did they come from? Incentives, recruitment strategy, response rate etc. Was 16 the total # of people recruited?

-Describe study design (qualitative) first then talk about investigators. How many investigators?

-Were interview guides developed based on past literature? Why did you ask the questions you did? What was the overall research /evaluation question being addressed?

- I suggest using COREQ or SRSR guidelines for qualitative research to describe the methods. Look up the Equator Network to find the reporting guidelines.

-How many coders?

-What was inter-rater reliability? This is a statistic that is calculated.

Discussion:

-Based on your first finding, do you think that the SMP was an intervention within itself? It created a shared understanding and individual awareness based on your results, so it could have psychological benefits among others? I think this would be an interesting thing to add to the discussion.

-Discuss the actions resulting from SM in more detail. I think that this study is unique because it used SM to make changes. A lot of research uses SM to conceptualize issues, but doesn’t take the next steps.

Reviewer #2: Kia ora, thank you for the opportunity to read this interesting manuscript. It is a qualitative study consisting of interviews of participants from a larger study that used systems science to explore ways to address trauma related to ACES. The participants in this study were asked about their experience in the larger study, to help describe and understand the usefulness and application of systems science in the ACES subject matter. The interview analysis process was robust and thorough.

Overall this is a helpful piece of work for people to read, who may decide to use this methodology, in the fields of ACES/ Child protection/Child maltreatment.

There are a number of suggestions I have to improve this manuscript:

1. The description of the relationship of this study to the overarching ROI group and original systems science research.

a) The aim of this study needs to be much clearer at the end of the introduction. The lines 95-97 I think are the aims of this study but it would be helpful if they were framed more from the perspective of "the aim of this study was to...."

b) The aim, questions and description of the overarching systems science work are not clear and the powerpoint referenced - reference 26 cannot be accessed to understand this study better. This description needs to much more clearly state what the overall aim of the systems science research was, as well as any sub-objectives/research questions.

c) The interaction between these two studies (the overall systems science SMP project), and this sub project of analysing the process and understanding the impact, needs to be better described. At the moment it doesn't seem to work well to have the description of the ROI systems mapping project at the end of the introduction (lines 98-124). The introduction should end with the aim of the project being described in this manuscript. The detailed description of the SMP project may be better in the methods section under a section around context.

2. Purpose

Line 129 The wording around purpose should be much more including "The purpose of this study was to....."

3. Themes

It would be helpful to have a summary list of the themes before starting straight into each one. E.g. The analysis resulted in three major themes including.....

4. Background literature

At the moment there is not much in the introduction or discussion about the use of systems thinking in ACES/child protection/Child maltreatment research. It would be helpful in the background to have more about how this (or similar approaches) has been used elsewhere in this subject matter. Then in the discussion how the results, strengths and limitations within this study relate to previous studies using this methodology.

5. Minor comments

a) line 119 needs an 'of' in between 'development' and 'several'

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Aug 18;17(8):e0273361. doi: 10.1371/journal.pone.0273361.r002

Author response to Decision Letter 0


23 Jun 2022

Comments from Reviewer 1

1. Comment: Describe what “1 ACES” vs “3 ACES” means. How are ACEs calculated?

Response: We agree with this change. A clearer definition of how ACEs were calculated by the BRFSS has been included in lines 52-57.

2. Comment: line 63 pg 3: change “attributable” to “associated with” & move the sentences about healthcare costs to the next paragraph after you talk about the kind of diseases/illnesses that ACEs contribute to

Response: We agree with this change. “Attributable to” has been changed to “associated with” on line 70. The section about healthcare costs has been moved to lines 69-72 after the sentences about diseases.

3. Comment: Elaborate on current individual level interventions and the current gap

Response: We agree with this change. Lines 78-86 now highlight individual level interventions and the current gaps.

4. Comment: Systems thinking is not a “critical component” of CBPR. CBPR can include systems thinking, but it can also be used to address individual level factors. I would argue that systems thinking, which is transdisciplinary in nature, requires community-based participation (in public health) but CBRP does not necessarily require systems thinking.

Response: We agree with this suggestion. This phrase has been removed.

5. Comment: The systems field typically refers to systems mapping in more specific techniques. In practice, it can be called system mapping. I suggest redefining systems mapping as community-based systems dynamics or causal loop diagramming because this paper is for a technical audience, not community partners.

Response: We agree with this suggestion. Lines 94-97 now refer to a systems map as the more common term and causal loop diagramming as the specific technique.

6. Comment: Define systems thinking and cite it and systems mapping.

Response: We agree with this change. Lines 89-101 now provide definitions of systems thinking and systems-mapping with citations.

7. Comment: I don’t know if I agree with the statement on lines 93-95. Do you have a citation?

Response: A citation has been provided on line 115.

8. Comment: The sentence on line 99-100 needs to be reworded and less specific. Describe the overall type of NP and rename this section “Systems Mapping Process” not “project”

Response: We agree with this change. The sentence has been reworded on line 131 and “Project” has been changed to “Process” on line 130.

9. Comment: Add more details to mapping process.

Response: We agree with this change. Lines 142-176 includes detailed steps of the mapping process.

10. Comment: Move section about participants to methods & more detail about the participants. Where did they come from? Incentives, recruitment strategy, response rate etc. Was 16 the total # of people recruited?

Response: Thanks for this suggestion.

1) The authorship team considered the advantages and challenges of moving the participants section to methods and ultimately decided we prefer to leave it as is, following the examples of previously published qualitative papers in PLoS One where the participant information was included in the results section (Lasseter et al., 2018; Marcus-Varwijk et al., 2019; Nardi et al., 2020). If the editor feels strongly that we should reconsider our decision we are open to discussing it.

2) We have added more details about the participants in lines 243-245.

3) Incentives can be found on line 212. Sampling and recruitment information, and response rate (total reach of 200 individuals) are listed in lines 193-198.

11. Comment: Describe study design (qualitative) first then talk about investigators. How many investigators?

Response: We agree with this suggestion and have moved study design to the beginning of the Results section on lines 181-191. We have also clarified that the investigators include: graduate students TV, JB, LM, LV, and DE in line 203; ROI staff SS in line 202; and faculty SG in line 203.

12. Comment: Were interview guides developed based on past literature? Why did you ask the questions you did? What was the overall research /evaluation question being addressed?

Response: We agree with this suggestion. This information has been added to lines 182-185, and 203-208.

13. Comment: I suggest using COREQ or SRSR guidelines for qualitative research to describe the methods. Look up the Equator Network to find the reporting guidelines.

Response: We agree with this suggestion. We have reformatted the Methods section to address the COREQ guidelines and provided a citation on lines 190-191.

14. Comment: How many coders?

Response: There were 4 coders (line 220) working in two teams of 2 (line 226)

15. Comment: What was inter-rater reliability? This is a statistic that is calculated.

Response: We did not calculate an inter-rater reliability statistic because the coding team met to discuss each code application for each transcript. Thus, each transcript was verified for coding accuracy and agreement by at least 2 coders. Additionally, discrepancies were also brought to the entire research team (TV, JB, LM, LV, DE, SG, and SS) for group consensus. Our Methods reporting are in line with previously published PLoS One qualitative papers where the inter-rater reliability statistic was also not presented ((Lasseter et al., 2018; Marcus-Varwijk et al., 2019; Nardi et al., 2020).

16. Comment: Based on your first finding, do you think that the SMP was an intervention within itself? It created a shared understanding and individual awareness based on your results, so it could have psychological benefits among others? I think this would be an interesting thing to add to the discussion.

Response: We agree that this is an intriguing discussion point that should be added. An additional paragraph addressing this point has been added in lines 480-495.

17. Comment: Discuss the actions resulting from SM in more detail. I think that this study is unique because it used SM to make changes. A lot of research uses SM to conceptualize issues, but doesn’t take the next steps.

Response: We agree with this suggestion. Additional details about actions resulting from the SMP has been added in lines 462-270.

Comments from Reviewer 2

18. Comment: The aim of this study needs to be much clearer at the end of the introduction. The lines 95-97 I think are the aims of this study but it would be helpful if they were framed more from the perspective of "the aim of this study was to...."

Response: We agree with this suggestion. We have reframed the aims in lines 125-128 for clarity.

19. Comment: The aim, questions and description of the overarching systems science work are not clear and the powerpoint referenced - reference 26 cannot be accessed to understand this study better. This description needs to much more clearly state what the overall aim of the systems science research was, as well as any sub-objectives/research questions.

Response: We agree with this suggestion. We have added lines 111-176 to describe how the overarching systems-science work, the SMP, and the qualitative interviews relate to and build off of each other. The link to the PowerPoint reference has been fixed and is now accessible.

20. Comment: The interaction between these two studies (the overall systems science SMP project), and this sub project of analysing the process and understanding the impact, needs to be better described. At the moment it doesn't seem to work well to have the description of the ROI systems mapping project at the end of the introduction (lines 98-124). The introduction should end with the aim of the project being described in this manuscript. The detailed description of the SMP project may be better in the methods section under a section around context.

Response: We agree with this suggestion. In addition to the changes made in point #19, we have moved the description of the SMP into the Methods section labeled “Context: The ROI Systems-Mapping Process”

21. Comment: Line 129 The wording around purpose should be much more including "The purpose of this study was to....."

Response: After reorganizing and rewording the last paragraph of the introduction, we have removed this sentence.

22. Comment: It would be helpful to have a summary list of the themes before starting straight into each one. E.g. The analysis resulted in three major themes including.....

Response: We agree with this suggestion. An additional section has been added under Results describing a summary of the themes in lines 262-269.

23. Comment: At the moment there is not much in the introduction or discussion about the use of systems thinking in ACES/child protection/Child maltreatment research. It would be helpful in the background to have more about how this (or similar approaches) has been used elsewhere in this subject matter. Then in the discussion how the results, strengths and limitations within this study relate to previous studies using this methodology.

Response: We agree with this suggestion. We have added additional information in the introduction about the use of systems-thinking in ACEs research in lines 101-110, as well as relating our study to this previously published research in the discussion in lines 439-443.

24. Comment: line 119 needs an 'of' in between 'development' and 'several'

Response: This change has been made in line 171.

Attachment

Submitted filename: PONE-D-22-02363 Response to Reviewers .docx

Decision Letter 1

Sara Rubinelli

18 Jul 2022

PONE-D-22-02363R1Using Systems-Mapping to Address Adverse Childhood Experiences (ACEs) and Trauma: A Qualitative Study of Stakeholder ExperiencesPLOS ONE

Dear Dr. Vu,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Thanks for the very nice revision. Please note that one of the reviewers still has some minor comments that need to be addressed before I can make a final decision on publication. 

Please submit your revised manuscript by Sep 01 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Sara Rubinelli

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: Thank you for the changes made in response to review.

Just a couple of minor edits needed:

Line 157 “LLC” is this an acronym – if so expand.

Lines 182-183 “: 1) What were the 183 perceived individual, interpersonal, and societal level impacts the SMP?”

Should there be an ‘of’ between ‘impacts’ and ‘the’

And a couple of general comments:

Names were in manuscript - was this supposed to be a double blind review. If so in future please anonymise your manuscript.

Not sure why original manuscript was submitted in the resubmission. It was confusing initially.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Aug 18;17(8):e0273361. doi: 10.1371/journal.pone.0273361.r004

Author response to Decision Letter 1


23 Jul 2022

Comments from Reviewer 2:

1. Comment: Line 157 “LLC” is this an acronym – if so expand.

Response: We agree with this suggestion. We have removed the term “LLC” on line 157 because the sentence following “Engaging Inquiry” already describes what the organization is.

2. Comment: Lines 182-183 “: 1) What were the 183 perceived individual, interpersonal, and societal level impacts the SMP?”

Should there be an ‘of’ between ‘impacts’ and ‘the’

Response: We apologize for the typo. We added an “of” on line 183.

3. Comment: Names were in manuscript - was this supposed to be a double blind review. If so in future please anonymise your manuscript.

Response: We were informed by the journal that all authors’ names must be listed in the title page.

4. Comment: Not sure why original manuscript was submitted in the resubmission. It was confusing initially.

Response: We removed all former manuscript versions from the submission portal and are only submitting the most recent revised versions in this round. We apologize for the confusion.

Attachment

Submitted filename: PONED2202363 Response to Reviewers July23_2022.docx

Decision Letter 2

Sara Rubinelli

8 Aug 2022

Using Systems-Mapping to Address Adverse Childhood Experiences (ACEs) and Trauma: A Qualitative Study of Stakeholder Experiences

PONE-D-22-02363R2

Dear Dr. Vu,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Sara Rubinelli

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Sara Rubinelli

10 Aug 2022

PONE-D-22-02363R2

Using Systems-Mapping to Address Adverse Childhood Experiences (ACEs) and Trauma: A Qualitative Study of Stakeholder Experiences

Dear Dr. Vu:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Sara Rubinelli

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Demographics of all stakeholders who directly participated in the systems mapping project.

    (DOCX)

    S2 Table. Interview guides.

    (DOCX)

    S3 Table. List of themes and additional illustrative quotes.

    (DOCX)

    Attachment

    Submitted filename: PONE-D-22-02363 Response to Reviewers .docx

    Attachment

    Submitted filename: PONED2202363 Response to Reviewers July23_2022.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES