Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Mar 1.
Published in final edited form as: Am J Community Psychol. 2021 Sep 17;69(1-2):145–156. doi: 10.1002/ajcp.12552

Community Sharing: Contextualizing Western Research Notions of Contamination within an Indigenous Research Paradigm

Sarah Allen 1, Suzanne Held 2, Shauna Milne-Price 3, Alma McCormick 4, Du Feng 5, Jillian Inouye 6, Mark Schure 2, Dottie Castille 7, Rae B Howe 4, Mikayla Pitts 2, Shannen Keene 8, Lorenda Belone 9, Nina Wallerstein 9
PMCID: PMC8926935  NIHMSID: NIHMS1734157  PMID: 34534371

Abstract

Báa nnilah is a chronic illness self-management program designed by and for the Apsáalooke (Crow) community. Arising from a collaboration between an Indigenous non-profit organization and a university-based research team, Báa nnilah’s development, implementation and evaluation have been influenced by both Indigenous and Western research paradigms. Báa nnilah was evaluated using a randomized wait-list control group design. In a Western Research Paradigm (WRP), contamination, or intervention information shared by the intervention group with the control group, is actively discouraged as it makes ascertaining causality difficult, if not impossible. This approach is not consonant with Apsáalooke cultural values that include the encouragement of sharing helpful information with others, supporting an Indigenous Research Paradigm’s (IRP) goal of benefiting the community. The purpose of this paper is to address contamination and sharing as an area of tension between WRP and IRP. We describe how the concepts of contamination and sharing within Báa nnilah’s implementation and evaluation are interpreted differently when viewed from these contrasting paradigms, and set forth a call for greater exploration of Indigenous research approaches for developing, implementing and evaluating intervention programs in Indigenous communities. (Improving Chronic Illness Management with the Apsáalooke Nation: The Báa nnilah Project.:NCT03036189)ClinicalTrials.gov:NCT03036189)

Keywords: contamination, sharing, Indigenous research methods, randomized control trial


The purpose of this paper is to address contamination and sharing as an area where a Western Research Paradigm (WRP) and Indigenous Research Paradigm (IRP) come into tension. We seek to ask critical questions that deconstruct elements of a WRP and contextualize the term contamination within the context of a randomized control trial (RCT) in an Indigenous community. In a WRP, one of the primary goals of an RCT is to establish causality (Schrag, 1992). It does so under the assumption there is no contamination (components of one study arm of an RCT received by participants in other study arms) between the study groups. The threat of contamination within an RCT has important implications for study design, sample size estimation, study implementation, and analyses (Parfray & Barrett, 2015). High levels of contamination can mean that researchers are less likely to: (a) discern positive results; (b) reject the null hypothesis; or (c) find a strong impact of the program (Keogh-Brown et al., 2007; Parfray & Barrett, 2015). Consequently, much has been written about methods to avoid contamination in RCT research designs.

In an IRP, the primary goal of research is to benefit communities: “knowledge creation carries with it a moral purpose” (LeFrance & Nichols, 2010). Within an IRP, researchers have a responsibility to use methods that uphold relational accountability to each other and to communities (Hart, 2010; Wilson, 2008). An integral part of upholding relational accountability is through sharing; the more information is shared, the more the community benefits. In a broad context, “sharing” can refer to the relay of beneficial knowledge or skills among any community members at any time. We are using the term contamination, as used within a WRP, to refer to sharing that occurs within a waitlist RCT when intervention group participants relay intervention information to waitlist participants prior to their taking part in the intervention. To sum, the exact same actions of study participants deemed as contamination within a WRP are contextualized within an IRP as sharing. Western and Indigenous research paradigms flow from fundamentally different epistemologies. However, rather than constructing WRP and IRP as monolithic and opposing binaries, we wish to situate our inquiry within a more nuanced acknowledgement of the complexity of each paradigm. Researchers engage in science to build knowledge from different paradigm orientations (Varpio & Macleaod, 2020) with varied research ontologies, epistemologies, methodologies, and axiologies (Daly, 2007). Much has been written on the wide continuum of approaches to building knowledge within a WRP. We define WRP as including approaches ranging from positivism, post-positivism, constructivism, and critical approaches to postmodernism (Daly, 2007; Park et al., 2020; Varpio & Macleod, 2020; Young & Ryan, 2020). An IRP is conceptualized as being simultaneously distinct from these WRPs as well as, in some cases, complementary to some approaches on the WRP continuum. For example, Indigenous scholar Maggie Kovach (2010) created a Venn diagram that illustrated areas where qualitative methodologies grounded within WRP’s constructivist or interpretive approaches overlap with some approaches within an IRP. This represents how methodologies rooted in different paradigms can sometimes complement or co-constitute novel approaches to doing research.

Kovach (2010) described community-based participatory research (CBPR) as an approach to research that utilizes components of a WRP but also holds up an IRP’s expectation that research has a moral purpose of action. It is considered a best practice approach for research with Indigenous communities (Fisher & Ball 2003; Wallerstein & Duran, 2010; Whitesell et al., 2018, 2020), but does not include all aspects of an IRP. CBPR overlaps with the goals of an IRP with its focus on issues important to the community and its goal of creating research that benefits the community directly. Within this context, community members and university researchers are equal partners who collectively build capacity. This equitable relationship encourages everyone to acknowledge their personal and institutional histories, be present to fully listen and receive, understand and acknowledge the expertise that is all around, and help each other to understand what’s important in each other’s community (Christopher et al., 2008). The CBPR relationship also encourages research teams to honor and respect each other's backgrounds and histories. Walters et al. (2020) recently introduced the term “Indigenist Community-Based Participatory Research” to describe community-based research that incorporates a CBPR approach in an IRP and highlights additional overlaps between a CBPR approach situated within WRP and IRP. We recognize and honor the work of many Indigenous scholars throughout this paper whose focus of scholarship has been within and between WRP and IRP.

Because the purpose of this paper is to explore contamination and sharing as an area of tension between WRP and IRP, we examine elements of a WRP to contextualize the term contamination itself. We accomplish this through: (a) a description of the Apsáalooke (Crow) Nation, our CBPR partnership and the Báa nnilah program; (b) a discussion of sharing in the Apsáalooke cultural context; (c) a description of Báa nnilah’s participants and research design; (d) data analysis and findings of contamination and sharing in the Báa nnilah intervention; and (e) a reflection on lessons learned, their implications, and our recommendations for future work.

Our CBPR Partnership within an Apsáalooke Context

Messengers for Health (Messengers) is an Indigenous non-profit organization located on the Apsáalooke Reservation in southeastern Montana dedicated to improving the health of the Apsáalooke “through community based projects designed to strengthen the capacity of communities and empower them to assess and address their own unique health-related problems” (Messengers, 2021). The Apsáalooke Reservation is the largest of seven Indian reservations in Montana, encompassing approximately 2.3 million acres and includes multiple distinct communities. Although Indian Health Services provides a hospital and two health clinics/stations on the reservation, many community members travel to larger cities for their health care, which can be up to two hours away. There are approximately 11,000 enrolled tribal members with the majority (7,900) residing on the reservation (Messengers, 2021).

Messengers began in 1996 as a partnership with Montana State University that used a CBPR approach to address women’s cancer awareness and prevention. Our CBPR partnership works together to prioritize the health of the community. We focus on health topics determined by our Community Advisory Board (CAB) and use a strengths-based approach that is grounded in Apsáalooke values and culture to create impactful and sustaining programs. Messengers’ CAB came to a consensus in 2013 that providing support for community members who have a chronic illness (CI) would be the focus of our next CBPR project.

The Báa nnilah Program

Báa nnilah refers to an Apsáalooke cultural strength of providing personal stories of guidance for life or advice to others. When entering into a new area of research, Messengers reviews the literature for existing programs that may inform local efforts or could be adapted for local use. We identified a number of available programs and the evidence-based Stanford University-developed Chronic Illness Self-Management Program (CDSMP) emerged as a highly used gold standard in the field (Lorig et al., 2001).

Although testing evidence-based interventions in a new setting is considered best practice, Western-based CI management programs such as the CDSMP have been shown to be impractical and difficult to sustain within Indigenous communities due to their lack of cultural consonance (Narayan et al., 1998; Jernigan, 2010, Barnett & Kendall, 2011). Furthermore, forcing Western-developed interventions onto Indigenous communities is felt to be a colonizing, patronizing and aggressive action that is evocative of past practices of forced assimilation (Bartlett et al., 2007; Donatuto et al., 2011; Duran, 2011; Duran & Firehammer, 2015). The authors of this paper agree with this perspective. In light of this, we felt there was a need for an Indigenously rooted CI self-management program deeply grounded within Apsáalooke cultural values and strengths. We hoped that if we could provide evidence of its effectiveness, it could be shared with other tribal communities to adapt to their own needs and provide a culturally consonant resource to help improve community health

Culturally relevant interventions are often developed from the ground up (Gameon & Skewes, 2019). Our program’s approach and content were co-developed by our partners after listening to, and co-analyzing 20 qualitative interviews with Apsáalooke men and women who shared their personal health stories of living with a CI (Hallett et al., 2016; Hallet et al., 2020; Held et al., 2019). This iterative, collaborative approach is similar to Kading et al.’s methodology for defining strengths from a within-culture lens (2019) and highlights how interventions can be guided by local knowledge (O’Keefe & Hartmann, 2019). Community member’s experiences regarding what was helpful and not helpful in managing a CI fit with some elements of Western models of CI self-management (for example, physical activity, nutrition, understanding health conditions) as well as highlighted important influencers not included in these models (for example, spirituality, historical and current loss, resiliency, and improving relationships with health care providers) (Held, et al., 2019; Schure, et al., 2020). Aakbaabaaniilea (community members who give advice) led the seven program gatherings. For more detailed information on program development and content, please see: Hallett et al., 2016; Hallett et al., 2020; Held et al., 2019; Schure et al., 2020. Additional papers addressing our methodology, data analysis, and results are forthcoming.

Sharing within Báa nnilah’s Cultural Context

A strength of Apsáalooke culture is the value placed on taking care of people in one’s close-knit kinship network. To provide an understanding for those from the Western culture, those who are considered immediate family in Apsáalooke culture are considered in the Western culture as extended family such as aunts, uncles, cousins and second/third cousins. The clan system is an active and important part of the culture, with individuals being called upon to provide spiritual support, encouragement, and strength to others.

Apsáalooke culture sees power in words and in good conversation, and one way of taking care of each other is by sharing good words and good advice with each other. Thus, when someone receives something of value, sharing is encouraged with those in your kinship network. Sharing within the Apsáalooke culture is an act of love and care for others. The Báa nnilah program centered this cultural value and strength of sharing. Báa nnilah was facilitated by Apsáalooke community members (Aakbaabaaniilea) who were managing a CI. The Aakbaabaaniilea were fundamental to the program’s integrity as they developed a safe space and shared their struggles and successes of managing a CI with program participants. A highlight of each gathering was a sharing circle, where the Aakbaabaaniilea and participants learned and grew together by sharing personal stories related to the topic of the gathering (such as navigating the healthcare system, healthy communication, eating healthy, and exercising). Sharing was integral to the gatherings and included sharing meals, sharing stories, sharing circles, and supportive partnerships. In these partnerships, participants provided support and encouragement to each other both within and outside of the gatherings. A culturally consonant goal setting tool, Counting Coup, was developed where participants gathered feathers (achieved goals) for their metaphorical coup stick. Participants created and shared health goals informed by what would help them fulfill their Apsáalooke role within their family and community grounded within their connections and relationships with culture, identity, story, history, survivance, language, ancestors, and family clans. These goals included, but also naturally extended beyond the specific CI self-management content. See Iitáa Dáakuash et al. (2020) for a description of the development and details of this tool.

Although there are some broad cultural norms regarding who speaks in public or shares in a group based on age or gender, those did not pertain to our gathering contexts specifically. Aakbaabaaniilea opened each gathering by saying “We are here as equals. We are here to support and encourage one another. No one knows more than any other person.” This created a safe space and allowed everyone to share based on who felt comfortable doing so rather than other norms. Because this was the first time Messengers invited men and women to be together in a health program, it also overcame a barrier to talking about one’s health more openly as part of one’s healing within the community for both men and women. This built on Messengers’ past work in talking about women’s health issues and indicates the strength of Messengers’ relationship with the community.

During the final gathering of the Báa nnilah program, Aakbaabaaniilea encouraged graduating participants to share the information they learned from the program with others with this statement, “Understand that you can all be mentors within the community with the support and tools you have gained through Báa nnilah. Serving as a role model will improve the health of the community now and in the future.” In summary, the cultural value and strength of sharing was infused throughout many elements of the intervention. These elements of the program centered culture in ways that distinguish it from traditional Western self-management programs. For example, CDSMP facilitators are required to follow the program manual and “not add, change or delete material or activities” (Self-Management Resource Center, 2016). This leaves little room for local knowledge, expertise, or community knowledge sharing strategies to flourish.

Báa nnilah Participants and Research Design

Participants in the intervention ranged in age from 24 to 82 years old (mean = 52.09 years), with females comprising 72%. Nearly half (48%) were married or living in a marriage-like relationship and 67% reported an annual household income of less than $25,000. All participants had at least one ongoing CI with 70% indicating comorbidities. Common CIs reported include diabetes (57%), high blood pressure (56%), chronic pain (35%), and arthritis (34%) and 6% of participants indicated they had cancer (breast, lung, etc.).

This pragmatic clinical trial used a cluster randomized trial (CRT) design (Cook, et. al., 2016), where each cluster consisted of participants who belonged to the same family/clan. A total of 211 participants were randomly assigned to either an intervention group (n = 104) or a wait-list control (WLC) group (n = 107). The intervention included seven gathering which occurred over approximately four months. Health survey and physical test data were collected at baseline, post-intervention, 6-month follow-up, and 12-month follow-up from participants in the intervention group, and at pre-baseline, baseline, post-intervention, 6-month follow-up, and 12-month follow-up from participants in the WLC group. Longitudinal response rate at each of the subsequent waves was 80%, 69%, and 66%, respectively, among intervention participants, and 84%, 70%, 68%, and 69%, respectively, among WLC participants. Additional qualitative interviews assessing the impact of the program with both the Aakbaabaaniilea (10) and participants (13) were completed at the end of the quantitative data collection. There was no active Institutional Review Board (IRB) on the Apsáalooke Reservation at the time of this study. The Montana State University IRB approved this study prior to any data collection.

There were multiple factors that influenced the choice to use a cluster-randomized trial design (Eldridge & Kerry, 2012), also known as a group-randomized trial, with a wait-list control group. The first factor was our hope that the intervention could be designated as “evidence-based,” which we believed required that it be evaluated from the perspective of a WRP. Within a WRP, health intervention research frequently uses the RCT design, which remains the gold standard study design for evaluating causality and for establishing an intervention as evidence-based (Ginsburg & Smith, 2016). Establishing our program as evidence-based would help other tribal communities obtain access to, and funding for, an Indigenous-rooted CI program they could adapt and implement within their own communities (Gameon & Skewes, 2019). Health programs that achieve the designation ‘evidence-based’ are usually those that have access to the most funding. For example, under the American Recovery and Reinvestment Act of 2009, $27 million was made available to deliver evidence-based self-management programs (Tilly, 2010). Communities were not allowed to use programs that did not have the evidence-based label. This limits Indigenous communities’ program choices because there are no self-management programs developed in, with and for Indigenous communities that are deemed evidence-based.

The second factor for selecting an RCT was that we were influenced by the accepted concepts of rigor embedded within WRP to be eligible for funding of grant applications submitted to the National Institutes of Health (NIH). At the time we were looking for opportunities to fund this project, NIH had a funding opportunity for projects using community-based approaches, which fit with our CBPR approach. From our experiences with this agency, we perceived that there was a positive bias toward RCTs in the NIH grant review process.

The third factor influencing design decisions related to the use of a wait-list control group so that all community members involved in the research could receive the intervention. It would not have been appropriate to have some community members benefit from the intervention while others were left out. Doing this would have broken the community’s trust, harmed the integrity of the partnership that took years to build and led to failed future projects because community members would stay away. Having a control group that received usual care or an alternative intervention that did not directly address CI self-management would not only be culturally inappropriate, but also unethical because the CAB selected CI as a vital area to address.

Data Analysis

Within the context of an RCT, contamination is most likely to occur: (a) in trials conducted in settings where participants work, live together or interact closely; (b) where interventions are desirable, simple or easily transferable or have the purpose of increasing knowledge; and (c) with interventions that are based on broadcast media, audiovisuals or written information (Howe et al., 2007; Keogh-Brown et al., 2007). The context of our RCT included all three of these components due to the close-knit nature of the Apsáalooke community, the natural way community members relate with one another and share valuable information with each other, the use of local mentors to recruit and lead participants, and the nature of program content and delivery. Consequently, we took steps to measure the extent to which sharing occurred. We did this in three ways: (a) analyzed 2 questions relating to sharing from a quantitative questionnaire assessing the amount and extent of sharing, (b) thematic content analysis of an open-ended question from that same questionnaire, and (c) thematic qualitative analysis of audio-taped and transcribed interviews with 10 Aakbaabaaniilea relating to the nature of sharing within their gatherings.

Analysis of the open-ended question was done by two team members who performed a content analysis to discover the most prevalent and common themes found within the responses (Braun & Clarke, 2008). After identifying and selecting the core themes and illustrative quotes in the data, findings were then taken back to the research team for their feedback. This iterative process resulted in a refinement of final core categories and representative quotes. An in-depth thematic qualitative team analysis was done with the Aakbaabaaniilea interviews. For more detail on this, please see Allen et al. in press.

Findings Related to Sharing/Contamination in the Báa nnilah Intervention

After the intervention group completed the intervention and prior to the wait-list control group taking part in the intervention we asked wait-list control group participants (n = 93) about sharing. We first asked, “Have you taken action for your health because of something you have heard or learned from a friend or family member who has attended the gatherings?” About 80% (n = 74) responded “yes.” Those who answered “yes” were then asked to assign a number on a scale of 0 (not at all) to 10 (a lot) that best described the extent to which they took action based on what they learned from a friend or family member who attended the gatherings. The mean was 7.46 (SD =1.97), with 71% (n = 53) choosing a score of 7 or higher and nearly a quarter of the participants (24%) choosing the highest possible level of taking action (10). These numbers indicated high levels of sharing between the intervention and control groups, and action taken based on that sharing within the control group.

Participants were then invited to "Please share what actions you have taken or changes you have made in your life because of what you heard or learned from a friend or family member who has attended the gatherings.” Of the 51 open-ended responses, 7 themes emerged, including: (a) improved diet; (b) increased physical activity; (c) better emotional, behavioral, and spiritual health; (d) better collaborative/relational/social health choices; (e) increased education seeking; (f) increased active medical care; and (g) better self-care awareness and action. Improved diet and increased physical activity were mentioned most often (see Table 1).

Table 1.

Themes and Sample Open-Ended Responses

Theme Examples of open-ended responses
1 Improved diet “eating healthier”
“drinking more water”
“trying to manage a balanced meal”
“changed the way I eat by reading labels more”
2 Increased physical activity “be active”
“walking a bit more”
“exercising more often”
“always make time to take a walk”
“do things manually when I can”
3 Better emotional, mental, and spiritual health “Helping one another is a good positive outlook on life and helping our daily life and self-worth amen”
“good positive outlook on life”
“change my health to be happier”
“I try and stay away from negative people that put my self-esteem down”
“my health is important and I'm worth it”
“I choose to be more through prayer and love for myself and family”
4 Better collaborative/relational/social health choices “find a partner to walk with”
“helping one another”
“contribute my experience”
“more…love for myself and family”
“I help my sister a lot and give her my support”
5 Increased education seeking “Read and study the binder”
“read labels more”
“looking forward to learning more”
“helped me understand the value of health”
6 Increased active medical care “take care of myself; get physical exam”
“take medications daily”
“Living better. I'm diabetic and now taking care of myself”
7 Better self-care awareness and action “Living a better healthy lifestyle”
“Taking better care of my health and body”

Note: Responses were typed into a tablet computer by participants. Some minor spelling corrections were made.

These findings indicate sharing is central to the success of the Báa nnilah intervention and to its impact in the broader community. When Aakbaabaaniilea were asked to describe what successful mentorship looked like to them in the in-depth qualitative interviews, the idea of taking care of others through sharing information and words of advice was frequently expressed. One Aakbaabaaniilea said they knew they were successful “when your participants…want to utilize the information they received to help their family, their friends, and even their community at large.” Another one said, “[it’s] not just the person you’re treating. You’re also treating the family.”

A majority of Aakbaabaaniilea talked about the importance of participants sharing the health information learned in the gatherings with their friends, family, and the larger Apsáalooke community. This was referred to as a “ripple effect.” One Aakbaabaaniilea said of the Executive Director of Messengers, “she was the drop of water that we yearned for and this drop of water came down and actually hit the big puddle of water and I’m the first ripple…and so, my participants are the next ripple. And so, you know, how the water has the rippling effect. I encourage my participants, ‘When you go home, if you encounter a family member going through something, you know, feel free to share some information with them.’” To the Aakbaabaaniilea, sharing indicated that participants understood the material and were applying information and skills learned from the program into their lives.

The value placed on sharing is present in a story from one of our participants who is a kaale (grandma). She shared the importance of limiting sugar intake with her family members, including her grandson. She said that in addition to saving money, the grandson lost 15 pounds and his skin cleared up. This example highlights both how program information was shared through story by participants with their relatives and how it was implemented in actionable ways to become a healthier Apsáalooke Nation. The Aakbaabaaniilea demonstrated that sharing is a central component of the IRP methodology. They said of sharing: “it is in our blood,” “it is just natural,” “it is a natural Indigenous methodology.”

Reflections

Although we used a CBPR and IRP approach to develop the intervention, we used a WRP approach to evaluate it. This integration of multiple research paradigms and methodologies presented challenges and conflicts familiar to other researchers. For example, two of our co-authors described the conflicting tensions between rigorously testing the effectiveness of a different NIH-funded intervention with Indigenous families and promoting the sharing and integration of that intervention within the community (Belone et al., 2017). The first aim of rigorous testing was informed by WRP methods and the second aim of promoting the sharing and integration of the program in the community was informed by an IRP. This highlights how sharing/contamination can be an area of conflict between the WRP and IRP paradigms. From a WRP perspective, contamination (sharing across study groups) is seen as participants going against a research protocol that results in a negative impact on the outcomes and evaluation. From an IRP perspective, sharing is a positive action of participants which is done for the good of the community. A strength of the Apsáalooke culture is the positive value of sharing and mutual support. Thus, the WRP-based RCT design’s attempt to minimize contamination is directly challenged by the IRP-based and, more specifically, Apsáalooke value of sharing useful or important information.

While we anticipated sharing across the intervention and wait-list control groups, we did not anticipate the level of sharing that occurred prior to the wait-list control group receiving the intervention. Not only was information shared, community members in the wait-list control group proactively took action to improve their health and the health of their families. From a WRP perspective, this constitutes a high degree of contamination and makes it less likely to obtain statistically significant findings that would provide evidence for effectiveness of the intervention. From a community perspective, it is a positive showing of cultural strengths within a cohesive community that facilitated our ultimate goal of community benefit. Using a wait list control group did not work as intended because the requirement of the design (no sharing between intervention and wait-list control) was incongruent with Apsáalooke cultural values. In essence, Apsáalooke cultural values and the IRP purpose of research benefiting community took priority over the WRP-based study design.

Implications and Recommendations for Future Work

We learned many lessons in the process of doing this research including: a) what happens when trying to bridge paradigms and b) the importance of contextualizing contamination. A summary of each lesson learned and implications and recommendations for future work are discussed below.

Trying to Bridge Paradigms

In our attempt to use a WRP-based wait-list RCT design to evaluate the Baá nnilah program, we learned there was a distinct challenge to bridging the WRP and IRP because of the inconsonance of the WRP value of minimizing contamination and the IRP value of sharing. By trying to integrate a WRP and an IRP, we were attempting to walk with our feet in two worlds. One foot was firmly planted in the Apsáalooke community and committed to our primary mission of benefiting the health of community members using approaches that respect and revitalize the community. Our other foot was in the world of a WRP due to these factors: (a) culture and training of non-Indigenous partners; (b) training of Indigenous partners in predominantly Western institutions; (c) wanting to receive the benefits of our intervention being established as an evidence-based intervention by the Western research community; and (d) the perception of bias towards the WRP when applying for research funding from agencies who are grounded in the WRP. The CBPR approach added weight to the foot that was in the Apsáalooke community and led us to the following implications and recommendations.

Attempting to bridge these two paradigms forced us to explore questions such as: Is it possible to integrate these research paradigms or is trying to do so making the research less beneficial or even causing harm to communities? Can we find a way to obtain funding and receive an evidence-based designation while also valuing and honoring the Apsáalooke culture? To what extent can WRP-trained researchers truly remove themselves from a WRP to better serve Indigenous communities? With these questions in mind, we offer four recommendations for researchers and funding agencies when proposing work in Indigenous communities: (a) bringing forward Indigenous voices and methods, (b) prioritizing IRP in Indigenous communities; (c) non-Indigenous partners committing to active allyship; and (d) providing funding opportunities.

Bringing Forward Indigenous Voices and Methods

Indigenous voices and methods are amplified when Indigenous people are program officers/officials of granting agencies who develop and shape grant program announcements and requests for grant applications or serve on grant review panels. By having a seat at the table and a voice in the determination of what are fundable methodologies, the methods within an IRP will flourish. Wilson (2008) stated the importance of moving past having to justify what is valid or worthy research and moving into “develop[ing] our own criteria for judging the usefulness, validity or worth of Indigenous research methods” (p. 14). Affirming Indigenous authority, expertise, and self-determination can expand the dialogue of voices in producing knowledge, honor diverse epistemologies, create methodological pluralism, and strengthen relational ethics (Quayle & Sonn, 2019).

Prioritizing IRP in Indigenous Communities

Over 20 years ago, Smith (1990) called for a prioritization of research methodologies that focused on social justice and emphasized positive outcomes and relevance to Indigenous communities. Since then, many research methods with a CBPR approach have been utilized with Indigenous communities that are grounded in Indigenous values (Belone, et al., 2020; Braun et al., 2014; Cram, 2018; Gittelsohn et al., 2018; LeFrance & Nichols, 2010; LeFrance et al., 2012). These methods call for research that is conducted and controlled by Indigenous peoples and communities, which is in line with the United Nations Declaration on Human Rights for Indigenous Peoples (United Nations, 2007). Because there is great variation among Indigenous nations, utilizing a CBPR approach can ensure local IRPs are developed and implemented that are consonant with the values and strengths of specific Indigenous nations (Belone et al., 2020; Dickerson et al., 2018; Gittelsohn et al., 2018; Whitesell et al., 2018) with support from agencies including the National Institutes of Health (Crump et al., 2017).

Non-Indigenous Partners Committing to Active Allyship.

If non-Indigenous health researchers are interested in partnering with Indigenous communities to improve community health, we recommend committing to a lifelong process of: (a) acknowledging how training and working in a predominantly white institution (PWI) that promotes a WRP creates blind spots in research approaches and committing to learning new approaches; (b) engaging with communities with love, humility, respect and a willingness to listen and learn; and (c) being an active ally for an IRP. These recommendations, in addition to others, have been voiced through documents such as the “Guiding Principles for Engaging in Research with Native American Communities” (Straits et al., 2012). When Indigenous community partners indicate that an approach isn’t appropriate or provide critiques of a WRP, non-Indigenous partners must respond appropriately by having the humility to honor the critique, listen, and revise the approach. Cochran et al. (2008) suggested that academic researchers working with Indigenous communities transform to a “service role, accepting community direction regarding priorities for research, considering Indigenous ways of knowing in research methods, and sharing or giving up entirely—depending on community needs and desires—the dissemination of research findings” (p. 26). Non-Indigenous partners must also use their voice and power as an ally to change the status quo of acceptance and dependence on WRP, including teaching IRP within PWIs. Allyship work done by non-Indigenous scholars includes an acknowledgement of some of the challenges Indigenous scholars experience when acting as a bridge between their community’s culture and the painful assimilative power of PWIs. Their work is hard, and sacrifices are made by trying to write about it. Non-Indigenous allies can offer support by acknowledging the daily experiences of racism Indigenous partners experience and the systemic racism that influences their daily life. We suggest non-Indigenous partners approach Indigenous communities in a culturally appropriate and respectful manner that is not pushy and to continuously find opportunities to support the community, step back and receive corrective feedback with humility, and reduce the space they take up.

Provide Funding Opportunities

Our final recommendation is to provide funding opportunities for Indigenous communities to develop health intervention programs from the ground up through the use of an IRP versus communities having to adapt or adopt existing evidence-based Western-developed interventions. There are very few Indigenous centered interventions available, which may be one reason why health disparities in Indigenous communities seem to be intractable. Modifications such as “tagging on a feather,” adapting content without fundamental paradigmatic change to the intervention relating to Indigenous epistemology and cosmology, or modifications made without community input and control cannot provide a truly Indigenized, effective, helpful intervention (Walters et al., 2020). Therefore, some researchers have utilized a culture-centeredness approach (Belone et al., 2017, 2020; Dutta 2007; Wallerstein et al., 2019) in the development of Indigenous interventions which are grounded in the local culture and knowledge systems (i.e. histories, language, healing practices, etc.).

Importance of Contextualizing Contamination within a Relational World View

One of the key lessons we learned is the need to contextualize contamination as defined by a WRP lens. This is illustrated by an Aakbaabaaniilea, who expressed the necessity and power of providing information, resources and support to everyone in the community, versus limiting information sharing to alleviate a WRP’s concerns with contamination. The Aakbaabaaniilea shared, “I lost my mother to diabetes and congestive heart failure. My father was an alcoholic, you know, and he died in a car accident, and my sister died because of alcohol, so it’s like gosh, we need to break the cycle. We need to help everyone.”

Our findings highlight the strength, value, and desirability of sharing. High levels of sharing led to many positive effects on individual, family, and community health, which were congruent with our desired outcome of the intervention having an impact on the larger community. From an IRP perspective, contamination between groups had positive effects which necessitated a new terminology of sharing. By contextualizing contamination, the same behaviors take on a positive connotation, suggesting it is something to encourage, rather than avoid.

Sharing increased the likelihood the intervention was successful within this close-knit community. It also indicated the intervention was functioning exactly how it was intended to work by disseminating valuable health information and knowledge widely through word of mouth. Overall, contextualizing contamination as a positive, value-added benefit of a research design makes it more congruent within an IRP and aligns with the primary purpose of research to benefit communities and a central component of IRP, relationality. As Walters and colleagues (2020) stated, “relationships can be central to healing and provide the framework for health interventions” (p. 558).

The implications of contextualizing contamination center primarily on the fallibility of a WRP in an Indigenous domain due to its cultural inconsonance. For us, this required that we shifted to a frame of reference that did not pathologize sharing. We recommend two evaluation principles that reinforce the strengths of IRP including: (a) privileging community-defined evidences and (b) measuring the diffusion of effect.

Privileging Community-Defined Evidences

There remains a false assumption in academic literature that Indigenous communities are somehow lacking from an absence of “credible evidence,” defined as data obtained from WRP. When Indigenous communities own their own research and evidence from this research is respected in the same ways that Western researchers’ evidence is respected, health inequities will change. This includes owning the evaluation and interpretation of research and the data gathered during the research. Others have voiced the need to resist “the restraints existing within Western science” (Dickerson et al., 2018, p. S34) when developing health interventions for Indigenous communities.

We recommend using a CBPR approach within an IRP that prioritizes and honors community voices regarding what is considered evidence and acceptable research methods. Evaluation methods, measures, and definitions of program success must all come from the community (Grover, 2010; Straits et al., 2019) and can be developed with a focus on measures that are culturally important (Belone et al., 2017). This means community members take the lead in designing and selecting locally specified outcome criteria and measures (Gone & Trimble, 2012) and determine as a community the criteria for evidence that the program worked. Privileging Community Defined Evidence (CDE) can shift the focus away from evidence-based practices valued within a WRP to practice-based evidences valued within an IRP. Gone and Trimble (2012) define practice-based evidences as traditional cultural ceremonial and ritual practices used since time immemorial that are “accepted as locally compelling testimony regarding their efficacy” (p. 151). They argue that “in contrast…to the recent proliferation of evidence-based practice in mental health services, many AI/ANs instead assert the therapeutic efficacy of traditional cultural practices on the grounds of practice-based evidence” (p. 151).

Measuring the Diffusion of Effect

Measuring the spread of program effects within tribal communities can better capture the sharing and integration of intervention components that resonate with Indigenous communities’ values. It can also promote the desired outcome of the sustainability of those programs after the research funding has ended. Definitions of sustainability acknowledge the need for programs that have shown to help community members be integrated into existing community institutions (Moore et al., 2017; Walugembe et al., 2019). Furthermore, it suggests a continuation of culturally consonant programming beyond external funding (Lennox et al., 2018). Thus, measuring diffusion of effect requires longitudinal process assessments as well as short- and long-term outcome assessments from program development, implementation, evaluation, spread and integration into community agencies, and ultimately community-level impacts (Walugembe et al., 2019).

Conclusion

Academic researchers generally feel pressured to adhere to the requirements imposed by academia and/or funding sources, many of which are not consonant with Indigenous communities. The WRP has a long and troubled history of failing to see Indigenous method as valid and as such, some institutions and granting agencies may insist Indigenous methodologies be validated by a Western framework (Duran & Firehammer, 2015).

Apsáalooke Voice

We close this paper with the voice of the Apsáalooke partners in this research project. The dialogue that has occurred through writing this paper has allowed for more room to explore the importance and need for IRP and to honor the voice of Indigenous partners. Co-writing has meshed ideas together in a way that has been respectful and statements in this paper have been written strongly, with appropriate and direct language. We wrote each sentence with intention to collectively advocate for IRP and voice our insights. Also, Indigenous students’ voices within our team have emerged and been emphasized.

We hope to approach research in a way that cultivates connections, pride and strength among Apsáalooke people. For an Indigenous community to open their door to research is significant due to the long history of harmful research and outside interference. One of our participants said of our program, “I know this is research, but it doesn’t feel like research.” This is a significant statement. The program not feeling like research helped people to become engaged, receive information, gain knowledge, and apply the program into their lives for the better. As in an IRP, we believe that the purpose of research is to improve people’s lives and the community at large, be built on trust, be service oriented, and create long-term sustainable programs. Relationships are the backbone to this program. If we don’t have a relationship, people won’t feel comfortable telling their story. Through relationships, we are rebuilding Apsáalooke ties, and creating pride in being Apsáalooke. When participants find encouragement and support at the gatherings, they feel like they can reach out and help someone else. As a result, they go out into the community and share this encouragement. This is our Indigenous research methodology.

The Báa nnilah intervention is particularly impactful because it uses our values and who we are as Apsáalooke people and because local IRP was honored and applied in its development. The Stanford CDSMP program would not have been relational with our people, which required us to develop a new program that relied on the voices of community members who experience CIs. As this is research, we needed a protocol to evaluate the program; however, the rigidity of not allowing sharing between the intervention and waitlist control group within the WRP protocol was not consonant with our culture, where sharing is a value and an impactful practice. Our nation has faced colonization, historical trauma, the impacts of non-Indigenous people who came into our territory and imposed their ways upon us and other adversities such as warring with other Indigenous nations. However, this is not what defines us because our strengths are rooted in the soil, which allows us to stand strong in our collective identity and continue to flourish as a nation.

Acknowledgment of Funding

The authors express appreciation for the following financial support for the research, authorship, and/or publication of this article: Improving Chronic Illness Management with the Apsáalooke Nation: The Báa nnilah Project, NIH, U01MD010619; Montana Healthcare Foundation; The Mountain West Clinical Translational Research Program, NIH U54GM104944. The content is solely the responsibility of the authors and does not represent the official views of the National Institutes of Health. The authors also thank all of the members of our Community Advisory Board and all of the Aaakbaabaaniilea (program facilitators).

References

  1. Allen S, Birdhat Howe R, McCormick A, Schure M, Bull Shows B, Keene S, Parrish C, Other Medicine L, Held S, Trottier C, & Hallett J (in press). Trauma-Informed Indigenous Pedagogy. In Kramer B and McKenzie J (Eds.). Handbook of Trauma-Informed Practices. Meyers Educational Press. [Google Scholar]
  2. Bartlett JG, Iwasaki Y, Gottlieb B, Hall D, & Mannell R (2007). Framework for Aboriginal-guided decolonizing research involving Metis and First Nations persons with diabetes. Social Science & Medicine, 65(11), 2371–2382. [DOI] [PubMed] [Google Scholar]
  3. Barnett L, & Kendall E (2011). Culturally appropriate methods for enhancing the participation of Aboriginal Australians in health-promoting programs. Health Promotion Journal of Australia, 22, 27–32. [DOI] [PubMed] [Google Scholar]
  4. Braun V & Clarke V (2008). Using thematic analysis in psychology. Qualitative Research in Psychology, 3, 77–101. 10.1191/1478088706qp063oa [DOI] [Google Scholar]
  5. Belone L, Orosco A, Damon E, Smith-McNeal W, Rae R., Sherpa ML, Omeh AO, Myers OB, & Wallerstein N (2017). The piloting of a culturally centered American Indian family prevention program: A CBPR partnership between Mescalero Apache and the University of New Mexico. Public Health Reviews, 38(30), 1–3. 10.1186/s40985-017-0076-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Belone L, Rae R, Hirchak KA, Cohoe-Belone B, Orosco A, Shendo K, & Wallerstein N (2020). Dissemination of an American Indian culturally centered community-based participatory research family listening program: Implications for global Indigenous well-being. Genealogy, 4(99). 10.3390/genealogy4040099 [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Braun KL, Browne CV, Ka’Opua LS, Kim BJ, & Mokuau N (2014). Research on Indigenous elders: From positivistic to decolonizing methodologies. Gerontologist, 54,117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Christopher S, Watts V, McCormick A, & Young S (2008). Building and maintaining trust in a community-based participatory research partnership. American Journal of Public Health, 98(8), 1398–1406. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Cochran PAL, Marshall CA, Garcia-Downing C, Kendall E, Cook D, McCubbin L, & Gover RMS (2008). Indigenous ways of knowing: Implications for participatory research and community. American Journal of Public Health, 98, 22–27, 10.2105/AJPH.2006.093641 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Cram F (2018). Conclusion: Lessons about Indigenous evaluation. Indigenous Evaluation, 159, 121–133. 10.1002/ev.20326 [DOI] [Google Scholar]
  11. Crump AD, Etz K, Arroyo JA, Hemberger N, & Srinivasan S (2017). Accelerating and strengthening Native American health research through a collaborative NIH initiative. Prevention Science, 21(1), 1–4. 10.1007/s11121-017-0854-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Daly K (2007). Qualitative methods for family studies and human development. Sage Publications. [Google Scholar]
  13. Dickerson D, Baldwin JA, Belcourt A, Belone L, Gittelsohn J, Kaholokula JK, Lowe J, Patten CA, & Wallerstein N (2018). Encompassing cultural contexts within scientific research methodologies in the development of health promotion interventions. Prevention Science, 12 (1), 33–42. 10.1007/s11121-018-0926-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Donatuto JL, Satterfield TA, & Gregory R (2011). Poisoning the body to nourish the soul: Prioritising health risks and impacts in a Native American community. Health, Risk & Society, 13(2), 103–127. [Google Scholar]
  15. Duran BM (2011). The promise of health equity: Advancing the discussion to eliminate disparities in the 21st century [paper presentation]. Annual Minority Health 32nd Annual Conference, Chapel Hill, NC, United States. [Google Scholar]
  16. Duran E, & Firehammer J (2015). Story sciencing and analyzing the silent narrative between words: Counseling research from an Indigenous perspective. In Goodman RD & Gorski PC (Eds.). Decolonizing “multicultural” counseling and psychology: Visions for social justice theory and practice, pp. 85–97. Springer-Verlag. [Google Scholar]
  17. Dutta MJ (2007). Communicating about culture and health: Theorizing culture-centered and cultural sensitivity approaches. Communication Theory, 17(3), 304–328. 10.1111/j.1468-2885.2007.00297.x [DOI] [Google Scholar]
  18. Eldrige S, & Kerry S (2012). A practical guide to cluster randomised trials in health services research. John Wiley & Sons. [Google Scholar]
  19. Fisher PA, & Ball TJ (2003). Tribal participatory research: Mechanisms of a collaborative model. American Journal of Community Psychology, 32 (3-4), 207–216. 10.1023/B:AJCP.0000004742.39858.c5 [DOI] [PubMed] [Google Scholar]
  20. Gameon JA, & Skewes MC (2019). A systematic review of trauma interventions in Native communities. American Journal of Community Psychology, 65(1-2). 10.1002/ajcp.12396 [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Ginsburg A, & Smith MS. (2016). Do randomized controlled trials meet the “gold standard”? A study of the usefulness of RCTs in the what works clearinghouse. American Enterprise Institute. Retrieved from https://www.carnegiefoundation.org/wp-content/uploads/2016/03/Do-randomized-controlled-trials-meet-the-gold-standard.pdf [Google Scholar]
  22. Gittelsohn J, Belcourt A, Magarati M, Booth-LaForce C, Duran B, Mishra SI, Belone L, & Jernigan VBB (2018). Building capacity for productive Indigenous community-university partnerships. Prevention Science, 21, 22–32. 10.1007/s11121-018-0949-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Grover JG (2010). Challenges in applying Indigenous evaluation practices in mainstream grant programs to Indigenous communities. The Canadian Journal of Program Evaluation, 23(2), 33–50. [Google Scholar]
  24. Gone JP, & Trimble JE (2012). American Indian and Alaska Native mental health: Diverse perspectives on enduring disparities. Annual Review of Clinical Psychology, 8, 131–160. [DOI] [PubMed] [Google Scholar]
  25. Hallett J, Held S, McCormick A, Simonds V, Real Bird S, Martin C, Simpson C, Schure M, Turnsplenty N, & Trottier C (2016). What touched your heart? Collaborative story analysis emerging from an Apsáalooke cultural context. Qualitative Health Research, 1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Hallett J, Held S, McCormick A, Simonds V, Real Bird S, Schure M, & Martin C, (2020). Method development in a community based participatory research partnership. SAGE Research Methods Cases: Medicine and Health. 10.4135/9781529709940 [DOI] [Google Scholar]
  27. Hart MA (2010). Indigenous worldviews, knowledge and research: The development of an Indigenous research paradigm. Journal of Indigenous Voices in Social Work, 1(1). [Google Scholar]
  28. Howe A, Keogh-Brown M, Miles S, & Bachmann M (2007). Expert consensus on contamination in educational trials elicited by a Delphi trial. Medical Education, 41, 196–204. [DOI] [PubMed] [Google Scholar]
  29. Dáakuash Iitáa (Birdhat-Howe R), McCormick A, Keene S, Hallett J, & Held S, (2020). The development of an Indigenous goal-setting tool: Counting coup. Turtle Island Journal of Indigenous Health, 1(1), 49–57. [PMC free article] [PubMed] [Google Scholar]
  30. Jernigan VBB (2010). Community-based participatory research with Native American communities: The chronic disease self-management program. Health Promotion Practice, 11(6), 888–899. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Kading ML, Gonzalez MB, Herman KA, & Walls ML (2019). Living a good way of life: Perspective from American Indian and First Nation young adults. American Journal of Community Psychology, 64, 21–34. 10.1002/ajcp.12372 [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Keogh-Brown M, Bachmann M, Shepstone L, Hewitt C, & Howe A (2007). Contamination in trials of educational interventions. Health Technology Assessment, 11(43), ix–107. 10.3310/hta11430 [DOI] [PubMed] [Google Scholar]
  33. Kovach M (2010). Indigenous methodologies: Characteristics, conversations, and contexts. University of Toronto Press. [Google Scholar]
  34. LeFrance J & Nichols R (2010). Reframing evaluation: Defining an Indigenous evaluation framework. The Canadian Journal of Program Evaluation, 23(2), 13–31. [Google Scholar]
  35. LeFrance J, Nichols R, & Kirkhart KE (2012). Culture writes the script: On the centrality of context in Indigenous evaluation. In Rog DJ, Fitzpatrick JL & Conner RF (Eds.), Context: A framework for its influence on evaluation practice. New directions for evaluation, (pp. 59–74). Wiley Periodicals, Inc. [Google Scholar]
  36. Lennox L, Maher L, & Reed J (2018). Navigating the sustainability landscape: A systematic review of sustainability approaches in healthcare. Implementation Science, 13, 27. 10.1186/s13012-017-0707-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Lorig KR, Sobel DS, Ritter PL, Laurent D, & Hobbs M (2001). Effect of a self-management program on patients with chronic disease. Effective Clinical Practice, 4(6), 256–262. [PubMed] [Google Scholar]
  38. Messengers for Health (2021). https://www.messengersforhealth.org/
  39. Moore JE, Mascarenhas A, Bain J, & Straus SE (2017). Developing a comprehensive definition of sustainability. Implementation Science, 12, 110. 10.1186/s13012-017-0637-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Narayan K H. M, Kozak D Kriska AM Hanson RL Pettitt DJ Nagi DK Bennett PH, & Knowler WC (1998). Randomized clinical trial of lifestyle interventions in Pima Indians: A pilot study. Diabetic Medicine, 15(1), 66–72. [DOI] [PubMed] [Google Scholar]
  41. O’Keefe VM, & Hartmann WE (2019). Working together to advance Indigenous interests with community psychology. American Journal of Community Psychology, 65(1-2),185–190. 10.1002/ajcp.12381 [DOI] [PubMed] [Google Scholar]
  42. Parfray PS, & Barrett BJ (2015). Clinical epidemiology, practice and methods: Methods in molecular biology. Humana Press. [Google Scholar]
  43. Park YS, Konge L, & Artino AR (2020). The positivism paradigm of research. Academic Medicine, 95(5), 690–694. [DOI] [PubMed] [Google Scholar]
  44. Quayle AF & Sonn CC (2019). Amplifying the voice of Indigenous Elders through community arts and narrative inquiry: Stories of oppression, psychosocial suffering, and survival. American Journal of Community Psychology, 65,46–58. 10.1002/ajcp.12367 [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Schrag F (1992). In Defense of Positivist Research Paradigms. Educational Researcher, 21(5). 10.3102/0013189X021005005 [DOI] [Google Scholar]
  46. Schure MB, Allen S, Trottier C, McCormick A, Other Medicine L, Castille D, & Held S (2020). Daasachchuchik: A trauma-informed approach to developing a chronic illness self-management program for the Apsáalooke people. Journal of Health Care for the Poor and Underserved, 242, 992–1006. 10.1016/j.socscimed.2019.112583 [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Self-Management Resource Center. (2016). Evidence-based self-management programs administration / implementation manual. Self-Management Resource Center. https://www.selfmanagementresource.com/docs/pdfs/Admin_Manual_2016.pdf [Google Scholar]
  48. Smith LT (1990). Decolonizing methodologies: Research and Indigenous peoples (1st ed.). Zed Books. [Google Scholar]
  49. Smith LT (2012). Decolonizing methodologies: Research and Indigenous peoples (2nd ed.). Zed Books. [Google Scholar]
  50. Straits KJE, Bird DM, Tsinajinnie E, Espinoza J, Goodkind J, Spencer O, Tafoya N, Willging C, & the Guiding Principles Workgroup. (2012). Guiding principles for engaging in research with Native American communities, Version 1. UNM Center for Rural and Community Behavioral Health & Albuquerque Area Southwest Tribal Epidemiology Center [Google Scholar]
  51. Straits KJE, DeMaria J, & Tafoya N (2019). Place of strength: Indigenous artists and Indigenous knowledge is prevention science. American Journal of Community Psychology, 64,96–106. 10.1002/ajcp.12376 [DOI] [PubMed] [Google Scholar]
  52. Tilly J (2010). The administration on aging's experiences with health, prevention, and wellness. Generations, 34(1), 20–25. [Google Scholar]
  53. United Nations General Assembly. (2007). United Nations Declaration on the Rights of Indigenous Peoples: Resolution adopted by the General Assembly, 2 October 2007, A/RES/61/295. Retrieved January 27, 2021, from: https://www.refworld.org/docid/471355a82.html
  54. Varpio L, & Macleaod A (2020). Philosophy of science series: Harnessing the multidisciplinary edge effect by exploring paradigms, ontologies, epistemologies, axiologies, and methodologies. Academic Medicine, 95(5), 686–689. [DOI] [PubMed] [Google Scholar]
  55. Wallerstein N, & Duran B (2010). Community-based participatory research contributions to intervention research: The intersection of science and practice to improve health equity. American Journal of Public Health,100(S1), S40–S46. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Wallerstein N, Oetzel JG, Duran B, Magarati M, Pearson C, Belone L, Davis J, DeWindt L, Kastelic S, Lucero J, Ruddock C, Sutter E, & Dutta MJ (2019). Culture-centeredness in community-based participatory research: contributions to health education intervention research. Health Education Research, 34(4), 372–388. 10.1093/her/cyz021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Walters KL, Johnson-Jennings M, Stroud S, Rasmus S, Charles B, John S, Allen J, Kaholokula JK, Look MA, de Silva M, Lowe J, Baldwin JA, Lawrence G, Brooks J, Noonan CW, Belcourt A, Quintana E, Semmens EO, & Boulafentis J (2020). Growing from our roots: Strategies for developing culturally grounded health promotion interventions in American Indian, Alaska Native, and Native Hawaiian communities. Prevention Science, 21(1), 54–64. 10.1007/s11121-018-0952-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Walugembe DR, Sibbald S, Janzen de Ber M, & Kothari A (2019). Sustainability of public health interventions: Where are the gaps? Health Research Policy and Systems, 17(8). 10.1186/S12961-018-0405-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Whitesell NR, Mousseau A, Parker M, Rasmus S, & Allen J (2020). Promising practices for promoting health equity through rigorous intervention science with Indigenous communities. Prevention Science, 21(1), 5–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Whitesell NR, Sarche M, Kean E, Mousseau AC, & Kaufman CE (2018). Advancing scientific methods in community and cultural context to promote health equity: Lessons from interventions outcome research with American Indian and Alaska Native communities. American Journal of Evaluation,39(1), 52–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Wilson S (2008). Research is ceremony: Indigenous research methods. Fernwood Pub. [Google Scholar]
  62. Young ME, & Ryan A (2020). Postpositivism in health professions education scholarship. Academic Medicine, 95(5), 695–699. [DOI] [PubMed] [Google Scholar]

RESOURCES