Skip to main content
PLOS One logoLink to PLOS One
. 2024 Dec 4;19(12):e0313490. doi: 10.1371/journal.pone.0313490

Conflict reducing practices in evolution education are associated with increases in evolution acceptance in a large naturalistic study

Rahmi Qurota Aini 1, K Supriya 2, Hayley Dunlop 3, Baylee Edwards 4, Samantha Maas 4, Julie Roberts 4, Alexa Summersill 5, Yi Zheng 6, Sara Brownell 4,#, M Elizabeth Barnes 1,*,#
Editor: Mc Rollyn Daquiado Vallespin7
PMCID: PMC11616821  PMID: 39630785

Abstract

Evolution is an important part of biology education, but many college biology students do not accept important components of evolution, like the evolution of humans. Practices that reduce perceived conflict between religion and evolution have been proposed to increase student evolution acceptance. This study investigates college student experiences of conflict reducing practices in evolution education and how these experiences are related to their gains in acceptance of human evolution during evolution instruction. We measured the natural variation in student experiences of conflict reducing practices among 6,719 college biology students in 55 courses and 14 states including (1) their experiences of an instructor demonstrating religion-evolution compatibility by presenting examples of religious leaders and scientists who accept evolution and (2) their experiences of an instructor emphasizing students’ autonomy in their own decision to accept evolution or not. We also measured student acceptance of human evolution before and after instruction so that we could test whether any changes in evolution acceptance were associated with student experiences of the conflict reducing practices. Linear mixed models showed that highly religious Christian students accepted evolution more when they perceived more compatibility practices. Further, students from all religious and non-religious affiliations accepted human evolution more after instruction when they perceived more autonomy practices. These results indicate that integrating examples of religion compatibility in evolution education will positively impact Christian students’ views on evolution and that emphasizing students’ autonomy over their decision to accept evolution may be important for students more broadly. If instructors incorporate practices that emphasize compatibility and one’s personal choice to accept or not accept evolution, then these results suggest that students will leave their college biology classes accepting evolution more. Perhaps by using more conflict reducing practices, instructors can help increase evolution acceptance levels that have remained low in the United States for decades.

Introduction

The perceived conflict between religion and evolution impacts college student evolution acceptance

Evolution is the foundation of biology [13], yet it has remained controversial in the public and in schools since Darwin first published The Origin of Species [4]. In the United States, about half of the public rejects human evolution [5, 6] and this rejection also extends to American college biology students. Surveys indicate that in 2020, up to 35% of introductory college biology students in the United States did not think life shares common ancestry [7]. If students are to apply evolution to their biological thinking outside of the classroom, they must not only understand but also accept evolution [8]. Why is a part of biology that is foundational to the discipline so controversial, even among college biology students?

Perceived conflict between evolution and a student’s religious beliefs and religious culture has been shown to be one of the biggest factors influencing evolution acceptance [9, 10]. There are substantial and consistent negative correlations between a student’s level of commitment to their religion, which is called religiosity, and the extent to which they accept evolution [11, 12]. Low acceptance of evolution is also related to students’ specific religious affiliations. In the United States, Christian, and Muslim biology students tend to have the lowest evolution acceptance while Hindu, Jewish, agnostic, and atheist students tend to have the highest evolution acceptance levels [9, 13]. However, there are many students who are highly religious Christians and Muslims who do accept evolution because they do not see conflict between evolution and their religion [10, 1416]. For instance, some Christian biology students have reconciled their religion and evolution by choosing to interpret the Bible as allegory rather than literal and by seeing examples of Christian biology professors who accept evolution [15]. Although religiosity or a specific religious affiliation is a predictor of evolution acceptance, this relationship is ultimately rooted in the extent to which one perceives conflict with evolution and their specific religious beliefs, cultures, and teachings [9]. Thus, reducing perceived conflict between religion and evolution has been recommended as a potentially effective way to mitigate low acceptance rates of evolution [1621].

A potential solution: Cultural competence and conflict reducing practices in evolution education

Despite the potential importance of reducing perceived conflict between religion and evolution, evolution instructors can struggle with helping students reduce their perceived conflict. While the majority of undergraduate students in biology courses are religiously affiliated [22], only about 25% of biologists are religiously affiliated [23, 24], creating a situation where predominantly non-religious instructors are teaching evolution to mostly religious students [25]. Instructors are in positions of power relative to their students and as such, can amplify or mitigate cultural divides between themselves and students [26]. However, research suggests that instructors often teach evolution in ways that are not culturally inclusive for religious students [27, 28], and this may lead to fewer students accepting evolution [27]. For instance, professors teaching evolution at secular institutions often reported being unwilling to implement instruction that could help reduce students’ perceived conflict [28]. Conversely, evolution instructors teaching at Christian institutions reported that they used a variety of strategies to help Christian students become more comfortable with evolution due to their own experiences reconciling their religion and evolution as biologists [14]. Thus, we have advocated that instructors should try to mitigate potential consequences of religious identity differences between themselves and students by practicing cultural competence and using conflict reducing teaching strategies when teaching evolution [25]. Cultural competence is the ability of individuals from one culture (in this case, secular instructors who are teaching evolution) to bridge cultural differences to effectively communicate to individuals from a different culture (in this case, religious undergraduate biology students) [26, 2931].

Cultural competence has become a useful framework for describing how instructors can aim to bridge divides based on demographic and cultural differences between themselves and their students. This framework was originally born from healthcare studies that emphasized the negative impact of racial/ethnic and socioeconomic difference between mostly white, high income doctors and their racial/ethnically and income diverse patients [32]. This original work emphasized the need of these physicians in positions of authority and power to cultivate an understanding of how to effectively communicate with those who are culturally different from them. Since then, cultural competence was adopted in K-12 education [33] and more recently in undergraduate STEM education to also emphasize bridging cultural divides, but this time between instructors and students [26]. Our research groups were the first to propose cultural competence as way to bridge religious cultural divides in college biology between mostly secular instructors and their majority religious students while teaching evolution [25]. Since then, we have more specifically referred to practices in evolution education that can be considered religiously culturally competent as conflict reducing practices, to more clearly emphasize that reduction of perceived conflict between religion and evolution is the most relevant religiously culturally competence practice in evolution education at the college level.

Despite broad recommendations for experts to teach evolution using culturally competent and conflict reducing practices [16, 19, 25, 34, 35], there are a lack of studies that collect data on student outcomes before and after instruction as well as studies that compare outcomes of students that experience conflict reducing practices to students that do not (see S1 Appendix for a list of studies and their methods). Further, although many researchers recommend conflict reducing practices, some have suggested that avoiding the potential controversy and only teaching to an understanding of evolution is most beneficial for student outcomes [36, 37]. We need studies comparing student outcomes with and without conflict reducing practices to determine which recommendations are most supported by the evidence.

The current study

In this current study, we compared student evolution acceptance when they perceive different levels of conflict reducing practices in their evolution instruction. We used the natural variation in student experiences of instructor practices to determine whether experiencing conflict reducing practices leads to improved acceptance of evolution among students. We were able to explore student experiences of two practices that could be considered conflict reducing during evolution instruction: 1) showing examples of potential compatibility between religion and evolution by highlighting religious scientists, leaders, and/or church members who accept evolution [15, 18, 20], and 2) helping students feel a sense of autonomy over their decision to accept or reject evolution [38, 39] so that they do not feel as if they are being forced into accepting evolution. These practices are hypothesized to be effective because they reduce students’ perceptions that their religious identity is a barrier to their acceptance of evolution. Showing religious individuals who accept evolution may give religious students examples of role models who have reconciled their religion and evolution [15] and may combat negative stereotypes of religious individuals in science that may make students feel like they do not belong in the classroom environment [40, 41]. Giving students a sense of autonomy may reduce perceptions that they are being forced to accept evolution [21] and increase their motivations to be accuracy oriented in their reasoning [38]. Our research questions were:

  1. Are students’ perceptions of conflict reducing practices during their evolution instruction related to their evolution acceptance after instruction?

  2. Is the effect of these conflict reducing practices different for Christian students, other religious students, and non-religious students?

Materials and methods

Between fall 2018 and spring 2021, we surveyed a population of undergraduate biology students from introductory biology courses in 14 states (CA, AZ, UT, TX, OK, MN, WI, MI, NY, NC, SC, AL, FL, and HI) before and after they learned evolution. Before learning evolution, we measured students’ human evolution acceptance, evolution understanding, religious affiliation, and religiosity, as well as other demographic control variables. After evolution instruction, we again measured student acceptance of human evolution. We also measured students’ level of agreement that they experienced compatibility through examples of religious individuals who accept evolution and that the instructor gave the students sense of autonomy in their decision to accept evolution. Fig 1 depicts our study design and details of each measure are described below.

Fig 1. Illustration of study design for exploring the impact of conflict reducing evolution education practices on student acceptance of evolution.

Fig 1

Ethical considerations

Arizona State University’s Institutional Review Board approved this study (protocol no. 8191). Students and instructors in this study filled in the consent form before participating in the study.

Measures and validity evidence

The outcome measure: Evolution acceptance

We used the Inventory of Student Evolution Acceptance (I-SEA) to measure students’ human evolution acceptance [42]. This measure includes statements with which students agree or disagree on a five-point scale. There are 8 items that measure acceptance of human evolution (e.g., “like other organisms, the human species is a result of evolution from an ancestral group”), 8 items that measure acceptance of macroevolution (e.g., “I think that new species arise from ancestral species”), and 8 items that measure acceptance of microevolution (e.g., “natural selection is a reasonable explanation that describes the ways in which groups of organisms have changed over time”). Among college biology students, confirmatory factor analyses and Rasch analyses of I-SEA data confirm items on the I-SEA fall onto these three separate psychological constructs [43, 44]. Students typically have lower levels of acceptance of human evolution and macroevolution compared to microevolution due to higher levels of perceived conflict with religion for human evolution and macroevolution [42, 4548]. We chose to focus on human evolution acceptance when reporting results of this study since human evolution tends to elicit the most perceived conflict with religion.

Predictor variables: Conflict reducing practices in evolution education

Survey item development. We developed survey items to measure the extent to which students experienced conflict reducing practices in their evolution instruction. We surveyed students about their experiences directly to use as predictors of their outcomes, rather than relying on instructor or researcher reports of classroom practices, because we wanted to gauge the efficacy of successful implementation of conflict reducing practices that students actually experienced. If instructors perceived that they did something that students did not notice, we predicted that this would not affect student experiences, so we relied on student perceptions. This approach is best suited to the naturalistic study design such as this in which students were learning evolution from many different instructors who were implementing widely different evolution education practices. The ways by which instructors decided to present examples of compatibility and give students autonomy may be differentially experienced by students, both between classes of different instructors but even within the same class with the same instructor. For instance, an instructor could report and/or a researcher could observe that the instructor gave examples of compatibility because in passing the instructor mentioned the religious background of an evolutionary biologist. However, students may not have heard the instructor due to absence, disengagement, or even momentary distraction. Thus, even though a researcher or instructor would report that they implemented the instruction, the student may never have been exposed to the instruction. Even students who pay attention to the instruction may experience the instruction in different ways. For example, an instructor may present religious scientist role models by showing a Hindu scientist who accepts evolution; this may be experienced as examples of compatibility by Hindu students but may not be perceived as compatibility for Christian students. Further, more religious students may need to hear more substantial amounts of explicit instructor talk to perceive they are being given autonomy over their decision to accept evolution. There are many different ways that instructors can implement conflict reducing practices and students can also perceive practices in many different ways. In this study, we were most interested in relating the extent to which students experience conflict reducing practices with their evolution education outcomes. Thus, we measured students’ experiences of conflict reducing practices by using students’ agreement and associating that agreement with their evolution acceptance after instruction.

We developed items based on prior literature illustrating conflict reducing practices [15, 17, 1921, 27, 35, 39, 49], which resulted in 14 items. Based on this prior literature, these items broadly covered instructional practices that illustrated compatibility between religion and evolution, such as describing the bounded nature of science and presenting examples of religious scientists and leaders who accept evolution. It also included items that we considered measured inclusive teaching practices for religious students such as encouraging student exploration of their views on religion and evolution and remaining respectful of religious beliefs. All of the original 14 items can be found in S1 Appendix. Students responded to each item with their agreement on a 6 pt. Likert scale (strongly disagree–strongly agree) (see S1 Text).

Expert and student review. The initial items were revised based on the feedback of a panel of five biology education researchers who reviewed the items for content validity and readability. To establish response process validity evidence [50], we conducted cognitive interviews using think-aloud methods [51] with 25 undergraduate biology students and items were revised for readability based on the interview responses.

Construct validation. To provide internal validity evidence for the measurement [50] of conflict reducing practices, we used a combination of exploratory and confirmatory factor analysis. We reviewed all 14 items and based on theoretical distinctions between items we hypothesized a two-factor model of items representing (1) compatibility instruction and (2) inclusive teaching of religious students. However, a confirmatory factor analysis of data from our first data collection indicated that this model was a poor fit (CFI < 0.95, RMSEA > 0.06) so we used an exploratory factor analysis to explore the structure of the data further and reviewed the items again to identify if we could build a more robust model. The scree plot and factor loadings indicated there were two factors, but some items had lower factor loadings than other items (<0.70) and upon inspection of these items we identified theoretical differences. For instance, the 4 items within “compatibility” that had the strongest loadings were all items regarding the extent to which the instructor showed examples of religious people and scientists who accepted evolution (for instance, the item “I felt like the instructor helped me realize that there are scientists who accept evolution and are also religious” had a factor loading of 0.97) while other items within this factor that had lower loadings were slightly different (for instance, the item “I felt like the instructor indicated that evolution and religion can be compatible” had a factor loading of 0.64). Similarly, only three items within the “inclusive teaching” had strong factor loadings and these items all referred to students’ decision autonomy (for instance, “I felt like the instructor let students make up their own mind about evolution.”). We identified 7 items that were a poor fit and decided to remove them and then re-operationalize our constructs based on the remaining items. We revised "compatibility” to more specifically refer to “compatibility through religious role models” and was defined as “the extent to which students agreed that the instructor helped them realize there are religious leaders, scientists, and church members who also accept evolution.” We revised “inclusive teaching” to more specifically refer to “inclusive teaching through decision autonomy” and was defined as “the extent to which students agree that the instructor gave them a sense of control over their decision making about evolution acceptance”. We ran a subsequent EFA and found that there were again two factors of items with each loading >0.70 on this round of analysis. We then used these remaining 7 items to collect data in subsequent semesters and ran another CFA on the aggregated data resulting in a model with an acceptable fit (CFI = 0.981, RMSEA = 0.040). All final items used in the analyses can be found in in S1 Text.

Class observations. Although we were primarily interested in student subjective experiences of the instruction, we still wanted to confirm that student agreement with survey items corresponded to instructional practices in the classroom to establish criterion validity evidence for the survey [50]. So, we compared student reports on survey items to observations from the classroom instruction. Six participating instructors agreed to share recordings of their evolution instruction and provide the research team with course artifacts such as syllabi, homework assignments, and PowerPoints from their evolution instruction. M.E.B. analyzed students’ data from each class and categorized classes in which more than half of students agreed that a practice was occurring as “practice present” and classes in which more than half of students disagreed that a practice was present as “practice absent”. Independently, H.D., J.R., and S.M. reviewed all course artifacts and coded each course as “practice present” or “practice absent”. The three research assistants wrote summaries of their observations, met and discussed any discrepancies between their coding, and came to agreement on final codes. We then compared codes based on student reports to codes based on researcher classroom observations. We found 92.3% agreement between student reports and researcher observations. This gave us confidence that despite the variation we will see in student experiences within each course that the majority of students (more than 50%) would agree with general researcher observations of the instruction.

Limitations of final measures. Our final measure of compatibility instruction only included items on student perceptions of instructor use of examples of religious scientists, leaders, and church members who accept evolution to illustrate the potential compatibility between religion and evolution. However, illustrating potential compatibility between religion and evolution has been described in other ways including discussing the bounded nature of science [5255] and discussing the spectrum of viewpoints on compatibility between evolution and religion [17, 49, 56, 57]. Further, our final measure of inclusive teaching of religious students only included three items referring to students’ perceptions that the instructor “let them make up their own mind about evolution” or “wasn’t trying to force students to accept evolution”. However, our original conception of this practice included encouraging exploration of personal views [49, 5860] and remaining respectful towards students who do not accept evolution. Thus, this study will not reveal the potential impacts of these other instructional practices that could illustrate compatibility and inclusive teaching. From this study, we learned that measuring these specific practices using a student survey is limited because student perceptions of these practices may be correlated with one another but fall on ambiguous dimensions when trying to establish the structural validity of the measures.

Rasch transformation. We used Rasch modeling to convert ordinal Likert scale scores into equivalent interval logit scale measures to account for varying psychological distances between Likert scale options. The procedure generated a person ability score for each participant for each measure (known as person measure, a higher value indicates a student agreed more compared to other students). In the analyses, we used the person measure scores instead of the average of Likert scores [61, 62]. Discussion of item fit statistics (MNSQ), item-person relationships using Wright Maps and Item Characteristic Curve plots can be found in the S1 and S2 Figs, and reliability values in S2 Table.

Predictor variables: Religiosity and religious affiliation of student

To measure religiosity, we used an instrument originating from the psychology of religion [63]. The instrument consisted of four items with which the students agree or disagree on a five-point scale. The items measure the intrinsic strength of one’s religious identity (e.g., “I consider myself a religious person”) and participation in religious activities (e.g., “I attend religious services regularly”). These items are similar to other common measures used both in studies of religion [64, 65] and studies of evolution acceptance [11, 66]. To determine students’ religious affiliation, we asked students to self-identify from the following list of religious affiliations: agnostic, atheist, Buddhist, Christian–Catholic, Christian–The Church of Jesus Christ of Latter-day Saints, Christian–Protestant, Christian–Other, Christian–nondenominational, Hindu, Jewish, Muslim, nothing in particular, other faith, and decline to state.

Control variables

We collected information to use as control variables in our models. Particularly for a naturalistic study design, it is important that we attempt to control potentially confounding variables in our statistical analyses. First, we included students’ course as a nested variable in our model to control for the possibility that non-independence of data points within each class could influence results of the study. Next, we controlled for students’ level of acceptance of evolution at the start of evolution instruction because students who come in with a high acceptance of evolution (1) may be more receptive to evolution instruction, including conflict reducing practices and (2) may have less acceptance to gain than students who start instruction with lower levels of evolution acceptance. We also collected students’ level of understanding of evolution [67] before instruction to control for the possibility that students who perceived more conflict reducing practices also had a higher understanding of evolution than students who did not perceive them. We also controlled for whether the student was a biology major, their gender, and race/ethnicity because these variables are often related to acceptance of evolution [66, 6870] and we wanted to reduce the possibility that uneven distribution of these variables across courses with different levels of conflict reducing practices may explain any statistically significant relationships between the instruction and student outcomes.

Sample

Sampling method

Our targeted sample was students in undergraduate introductory biology classes. We purposefully targeted a broad sample and used convenience and snowball sampling methods. We recruited instructors initially from the listserv for the Society for the Advancement of Biology Education Research (SABER), which is mostly comprised of faculty and graduate students who teach college level biology. The initial recruitment explained that we were interested in determining what college level evolution education practices were effective for improving student outcomes and that we would use the natural variation in instructor practices to determine effective practices. Since we wanted to recruit instructors who were both using and not using conflict reducing practices, we did not mention our specific interest in exploring conflict reducing practices or student evolution acceptance in the recruitment email. Instead, we only indicated we were interested in identifying evidence-based practices for teaching evolution effectively. Some instructors we recruited then recommended to us their colleagues who were teaching evolution in introductory biology. In subsequent semesters, to increase the number of courses that could be included in our analyses, we identified large enrollment introductory biology classes and emailed the instructors to ask for their participation. We recruited primarily from public doctoral granting universities. Students were offered a small amount of extra credit for completing the surveys.

Participants

A total of 6,719 students from 55 courses completed both the pre and post instructional surveys and were included in the final analyses (~ 44% response rate). A 44% response rate is within the typical average for online surveys [71] and is particularly acceptable for a longitudinal study with data collected at multiple time points. The nature of the response rate for the survey is also influenced by various factors such as students’ interest in the topic, survey structure, communication methods, or incentives for participation [72]. We also implemented an honesty check at the end of the survey to assess whether students were paying attention and providing accurate responses. This step helped ensure the reliability of the data collected. In the analyses, students are nested by course, so we removed any courses from the data set in which there were less than 20 complete student responses as recommended by [73]. Class size and response rates from each class can be found in S1 Table.

We categorized student religious affiliation into three groups based on sample size considerations: Christian, other religion (e.g., Hindu, Buddhist, Jewish, Muslim), and no-religion (e.g., Atheist and Agnostic). Then we categorized Christian students and students from other religions based on their religiosity levels. Students who scored 1 standard deviation above the average on the religiosity scale were categorized as “high religiosity” and students who scored between -1 to 1 standard deviations on the religiosity scale were categorized as “average religiosity”. Students who scored more than 1 standard deviation below the average on the religiosity scale were recategorized to belong to the “no-religion” group. All of these students were confirmed to have disagreed on the religiosity survey that they were religious or that religion was important to their lives. So, although these students may have checked the box for “Christian”, “Muslim”, “Jewish”, etc, we considered them non-religious because they did not believe this was a relevant or important part of their identities. A breakdown of the sample demographics can be found in Table 1.

Table 1. Sample of students used in analyses broken down by gender, race/ethnicity, major, and semester of data collection.
Total (n = 6,719)
Gender
Man 29.2%
Woman 70.8%
Non-binarya --
Race/ethnicity
PEER1 21.2%
Asian 18.3%
white 51.0%
multiracial 9.5%
Major
Biology Major 54.8%
Non-biology Major 45.2%
Semester
fall 2018 19.7%
  fall 2020 25.0%
  spring 2020 30.0%
  spring 2021 25.3%
Religion
No-Religion2 31.7%
Christian3
  high religiosity 16.3%
  average religiosity 38.8%
Other Religion4
  high religiosity 1.2%
  average religiosity 13.0%

1 We chose to collapse these groups due to the limitations of the sample sizes of each individual group. PEER (persons excluded based on ethnicity or race) students included: American Indian, Native American, or Alaskan Native, Black or African American, Hispanic or Latinx, and Native Hawaiian or Other Pacific Islander.

2atheist, agnostic, and students with low religiosity from Christian, Muslim, and other groups

3Christian–Catholic, Christian–The Church of Jesus Christ of Latter-day Saints, Christian–Protestant, Christian–Other, Christian–nondenominational

4We chose to collapse these groups due to the limitations of the small sample sizes of each individual group. Other religion students include Buddhist, Hindu, Jewish, and Muslim.

a We had 44 non-binary students in our data set, but we did not include them in the analysis due to low sample size and the lack of prior data on how gender including non-binary students may affect evolution acceptance.

Sampling limitations

Even though we were ambiguous in our email recruitment about the specific focus of our study, instructors still self-selected into this study and may not represent the broader population of evolution instructors. However, our research questions of interest were about the relationships between variables and not the generalizability of the descriptive statistics of the sample. Nonetheless, it is possible that instructors who were interested in participating in an evolution education study may be more likely to implement conflict reducing practices such as discussing examples of potential compatibility between religion and evolution. Further, it is possible that students in these classes we surveyed or those who chose to respond to the survey may not be representative of biology students more broadly. Although we cannot explore all ways the sample may be unique from the general population, we did compare key demographic characteristics of our sample with data from the National Science Foundation’s National Center for Science and Engineering Statistics [74] to assess how closely our sample aligns with the broader student population. Note that our sample consisted of students enrolled in introductory biology courses and only 54% of whom were biology majors, and therefore we compared with national data on degrees earned in science and engineering fields. The racial and ethnic composition of our sample is similar to national data. For instance, 51% of our sample identified as White (compared to 58% nationally), 18% identified as Asian (compared to 12% nationally), and 21% identified as PEER (Persons Excluded because of Ethnicity or Race), compared to 26% in the broader population. For gender composition, 70% of our sample identified as women, which is consistent with national trends. In 2020 [74], women earned 66% of bachelor’s degrees in science and engineering with a particularly high representation in fields like psychology (where women accounted for 79% of degrees earned). While we cannot claim full representativeness, these comparisons suggest that our sample broadly mirrors the diversity of the student population in relevant ways. It is also important to acknowledge the sample size limitations for students from non-Christian religious groups (e.g., Buddhist, Hindu, Jewish, Muslim), which led us to collapse these groups into a broader "Other-Religion Students" category. While this approach allowed us to maintain sufficient statistical power, it limits our ability to address the distinct experiences and perspectives of each individual religious group. Consequently, our discussion may not fully capture the unique nuances specific to students from smaller religious affiliations.

Analyses

To analyze the associations of instruction with student outcomes and whether the associations of instruction with outcomes depended on students’ religiosity and religion, we used multi-level models with course as a random effect [75].

Main effect of instruction on evolution acceptance

This primary analysis examines the direct effect of instruction (compatibility and autonomy) on student acceptance of evolution with course as a random effect. As mentioned in the control variables section, we controlled for students’ level of understanding and acceptance of evolution before learning evolution, whether the student was a biology major (nonmajor vs major (reference group)), whether the student was a woman (woman vs man (reference group)), and student race/ethnicity (Persons Excluded because of their Ethnicity or Race (PEER) [76], Asian, multiracial, white (reference group). The rationale for these control variables are (1) to account for baseline demographic factors that could influence outcomes and (2) to ensure that results were not due to students who have a higher understanding of evolution perceiving conflict reducing practices more. The following model was analyzed using R software:

Post-human evolution acceptance ~ Pre-human evolution acceptance + Pre-evolution understanding + Major + Race + Gender + Instruction + (1|course)

Interaction effect: Religion, religiosity, and instruction

To explore whether the instructional effects differed across students with different religious affiliations or religiosity levels, we also tested the same models with interactions between instruction and religiosity, and instruction and religion with course as a random effect:

Post- human evolution acceptance ~ Pre-evolution acceptance + Pre-evolution understanding + major + Race + Gender + Religiosity* Instruction + (1|course)

Post- human evolution acceptance ~ Pre- human evolution acceptance + Pre-evolution understanding + major + Race + Gender + Religion* Instruction + (1|course)

We also explored whether the instruction effects differed across different religious affiliations and religiosity levels using a 3-way interaction model with course as a random effect:

Post- human evolution acceptance ~ Pre- human evolution acceptance + Pre-evolution understanding + major + Race + Gender + Religion*Instruction* Religiosity + (1|course)

Probing the interaction effect. In the manuscript we report coefficients of the instruction variables and their interactions as well as their statistical significance. We also provide figures (Figs 3 and 5) that depict the direction and strength of the relationships between student outcomes and the instruction, broken down by student religion and religiosity levels (Average religiosity group, -1SD to +1 SD; High religiosity group ≥ +1 SD). We used the functions interact_plot to generate figures and sim_slopes to probe interaction effects using Johnson-Neyman intervals from the interactions package in R [77]. These analyses determine if the relationships between independent variables (religion and religiosity) and the focal predictor (instruction) is statistically significant [78]. Full regression tables with coefficients, standard errors, and exact p-values for all analyses reported in this manuscript are listed in S1 Appendix.

Fig 3. Illustration of interaction effects from linear mixed models of student religion and religiosity levels on the association between religion negativity during instruction and students’ human evolution acceptance after instruction.

Fig 3

The red lines are students who identify with no religious affiliation and students with religiosity measures more than 1 SD below the mean, which we have coded as having no religious affiliation. Values are based on model prediction of 3-way interaction between instruction, religion, and religiosity for human evolution acceptance. The shaded area represents the 95% confidence interval (CI) for the linear model. The simple slope analyses were significant only for highly religious Christian students (β = 0.04, SE = 0.01, p < 0.001).

Fig 5. Illustration of non-significant interaction effects from linear mixed models of student religion and religiosity levels on the association between decision autonomy during instruction and students’ human evolution acceptance after instruction.

Fig 5

The red lines are students who identify with no religious affiliation and students with religiosity measures more than 1 SD below the mean, which we have coded as having no religious affiliation. Values are based on model prediction of 3-way interaction between instruction, religion, and religiosity for human evolution acceptance but this was not statistically singificant, indicating no statistical differences between groups. The shaded area represents the 95% confidence interval (CI) for the linear model.

Results

Finding 1: After highly religious Christian students experienced compatibility instruction, they accepted evolution more than highly religious Christian students that did not experience that instruction

Student perceptions of instruction

Overall, we found that students in this sample perceived moderate levels of compatibility instruction by including examples of religious individuals who accept evolution (M = 3.77, SD = 0.69, Range = 1–6) but there was variation in student experiences both within and between classes (Fig 2).

Fig 2. Student agreement that instructors showed compatibility between religion and evolution by providing examples of religious scientists, leaders, and others who accept evolution, disaggregated by course.

Fig 2

Each box in the plot represents the interquartile range (IQR) of the compatibility scores, with the vertical whiskers representing the spread of maximum and minimum scores, and line inside the box indicating the average score for each course. The dashed horizontal lines represent the overall average score within all samples. The plot is designed to provide a clear view of the distribution and central tendency of the compatibility scores within and between different courses.

Main effects

Linear mixed models predicting students’ evolution acceptance after instruction showed that students’ human evolution acceptance increased the more students agreed that the instructor showed examples of religious scientists, leaders, and others who accept evolution (b = 0.01, SE = .00, p < 0.001). Interactions and simple slopes. We found a significant two-way interaction between students’ religiosity and instruction (b = 0.01, SE = 0.00 p < 0.001) indicating that this compatibility instruction was more effective for students who were more religious. We also found a significant two-way interaction between religion and instruction for Christian students (b = 0.04, SE = 0.01, p < 0.001), indicating that this instruction was particularly effective for Christian students. Considering both religion and religiosity with instruction, we found a significant three-way interaction for Christian students only (b = 0.01, SE = 0.01, p < .05). Simple slope analyses are reported in Fig 3 and revealed that compatibility instruction was only significantly related to the outcomes of highly religious Christian students in which one logit increase in their agreement that religious role models were present in instruction was associated with a .04 point increase in Christian students’ evolution acceptance after instruction.

Finding 2: After students experienced instruction that was inclusive and gave them autonomy over their decision to accept evolution, they accepted evolution more than students who did not experience that instruction

Student perceptions of instruction

Students in this sample perceived relatively high levels of autonomy during their evolution instruction. Across all courses students tended to agree that instructors gave them autonomy over their decision to accept evolution (M = 4.79, SD = 0.26, Range = 1–6). Fig 4 illustrates the variation in student reported experiences within and between different classes.

Fig 4. Student agreement that instructors were implementing inclusive teaching about evolution by giving students autonomy over their decisions to accept evolution, disaggregated by the 55 courses.

Fig 4

Each box in the plot represents the interquartile range (IQR) of the autonomy scores, with the vertical whiskers representing the spread of maximum and minimum scores, and line inside the box indicating the average score for each course. The dashed horizontal lines represent the overall average score within all samples. The plot is designed to provide a clear view of the distribution and central tendency of the autonomy scores across different courses.

Main effects

Variation in students’ perception of autonomy in their instruction was significantly and positively related to their evolution acceptance after instruction (b = 0.08, SE = 0.01, p < 0.001) indicating that for each logit increase in student agreement that autonomy instruction was present, there was a .08 point increase in student evolution acceptance after instruction. Interactions and simple slopes. Two-way interactions between religion and instruction and religiosity and instruction were not significant for students’ human evolution acceptance (p > 0.24), and the three-way interactions between religion, religiosity, and instruction for students’ evolution acceptance were also not statistically significant (p > 0.06) indicating that inclusive teaching with decision autonomy was equally effective for students from all religiosity and religion groups (Fig 5).

Discussion

In this large study using students sampled across the nation, we found that when students perceive conflict reducing practices during their evolution instruction, they have better evolution acceptance outcomes at the end of instruction. Below, we discuss these results in more detail and connect our current findings to the broader literature on the effectiveness of conflict reducing practices.

Student perceptions of conflict reducing practices in undergraduate biology education

Because this was a self-selected sample of instructors and students in which we measured student perceptions of instruction and not actual instruction, we have a limited ability to make claims about the relative abundance of conflict reducing practices in biology education broadly. However, based on this data set of 6,719 students in 55 courses and 14 states, there are some important trends in our data worth considering. First, some researchers may have expected that instructors who cared enough to participate in a survey study on how to identify evidence-based practices in evolution education might be more likely to use conflict reducing practices, and students did tend to agree that instructors were giving them autonomy over their decision to accept evolution (Fig 4). But among this sample, students tended to disagree that instructors were giving examples of potential compatibility between religion and evolution (Fig 2). So, this could mean that this conflict reducing practice is not common among instructors. Further, there seemed to be differences between the extent to which students within each class perceived the instruction. In some courses, most students agreed that instructors showed examples of religious leaders and biologists who accept evolution while in other courses most students disagreed that instructors were providing these examples of compatibility, and this indicates that students were perceiving the instruction similarly in these classes. However, there were some courses in which students seemed to have quite different experiences of the instruction from one another. In some courses, a large proportion of students agreed that an instructor helped them realize that religious leaders and religious biologists can accept evolution and a large proportion disagreed (Fig 2). It could be that in these instances, the way that the instructor showed examples of compatibility were more subtle and thus were only perceived by some students while others did not notice. It also could be that attendance in these classes was low and these students who disagreed were not exposed to the instruction. Student perceptions of autonomy practices on the other hand, seemed to be more consistent both within and across courses and were consistently high (Fig 4). This could mean that perceptions of autonomy are high in undergraduate evolution education courses or that this sample of instructors were particularly likely to be implementing practices that lead to this perception.

Are students’ perceptions of conflict reducing practices during their evolution instruction related to their evolution acceptance after instruction?

In this study, when highly religious Christian students reported that instructors showed them examples of religious individuals who accept evolution, this was associated with increases in student evolution acceptance. This is in line with prior research that has documented the positive effect of religious role models who accept evolution on religious student evolution acceptance [15, 18, 20, 49]. However, in this study, we did not see a positive effect of these examples for religious students who were not Christian or Christian students who scored low to average on religiosity. This could be due to the religious affiliations of examples presented by instructors and the salience of the identity to students. Social identity theory would predict that students will respond more to examples of religious individuals that have affiliations closer to their own identities and when they themselves strongly associate with the identity [79]. Thus, if instructors were presenting examples of religious leaders and biologists that were apparently Christian, this may have been more impactful for highly religious Christians compared to Christian students who did not report being as religious or compared to non-Christian students. Since we did not have observations of all instruction these students received, we cannot report the affiliations of examples instructors used, but of the courses we did observe that presented examples of compatibility, they were from Christian affiliations. Related, highly religious Christian students may be more likely than other religious students to even notice the representation of Christian role models who accept evolution. Future research could explore the extent to which role models need to reflect closely students’ own religious identity and background to be effective for increasing evolution acceptance.

In this study we also have now characterized the practice of decision autonomy and its impact on evolution acceptance, which we show seems to be independent of religious identity. According to self-determination theory, humans have three basic psychological needs to be motivated towards an outcome including competence, belonging and autonomy [80]. While belonging and competence are likely to be affected by students’ identities [8183], our data support that any student regardless of their religious identity would benefit from perceiving that they have control over their own decisions to accept evolution. Since this is the first time that this construct has been shown to be relevant for improving evolution acceptance outcomes, there is much that remains to be explored about decision autonomy. For example, is the absence of forceful assertion that students need to accept evolution sufficient? Or do students need to be explicitly told that they have the decision to accept evolution? Further, does the extent to which the student trust the person telling them about evolution matter for their perception of autonomy?

These results on the beneficial impact of compatibility and autonomy instruction are one additional piece of evidence building on a long line of studies from multiple methodologies indicating that conflict reducing practices in evolution education can improve student evolution acceptance outcomes. Students report in interviews [15, 21] and when journaling [60] that when instructors implement practices considered to be conflict reducing that their evolution acceptance and engagement in learning evolution increases. These studies are corroborated by studies showing that student evolution acceptance increased when instructors implemented conflict reducing practices in a single course [17, 84] and when they implemented these practices in multiple courses [16, 18, 59, 85]. Now, our study shows that when we compare students that perceive different levels of conflict reducing practices, specifically compatibility and decision autonomy, we also show evidence for improved student evolution acceptance when they perceive higher levels of these practices.

Future research

We argue that in light of the mounting evidence for conflict reducing practices that we as researchers need to move beyond studying whether conflict reducing practices work to what are the most effective ways to implement conflict reducing practices, which will warrant additional controlled study designs. Below we highlight how future research should move towards specifying (1) which conflict reducing practices are most effective, (2) what is the most effective implementation of these conflict reducing practices, and (3) whether practices are differentially effective based on student identity. Detailed qualitative, quantitative, and mixed methods research have successfully identified conflict reducing practices that students report improve their evolution acceptance including compatibility practices such as providing examples of religious individuals and biologist who accept evolution [15, 17, 18, 20], discussing the bounded nature of science [5255, 58, 8688] and discussing how evolutionary theory is agnostic about the existence or influence of a God/god(s) [7], as well as inclusive teaching practices such as remaining respectful of students’ religious identities [19, 35, 89], giving students opportunities to reflect on their positions on evolution [19, 35, 49, 59, 90, 91] and now, fostering a sense of autonomy over their decision whether to accept evolution. In this study, we were able to measure student experiences of two of these practices, providing examples of compatibility through role models and autonomy, and show that when we compare students with different perceived levels of experience with these practices, that students who do perceive more agreement with the presence of the practices have better outcomes. However, we were unable to create a survey measure that had sufficient validity evidence that measured these other practices. A controlled study design would allow future researchers to implement these practices in standardized and varied ways and determine which practices may be most impactful and what are the most effective ways to implement them for students with different religious and non-religious identities. With controlled studies in which students are randomly assigned to instruction that is identical except for one factor (e.g., the type of role model), we can more precisely start to characterize best and most effective ways to implement conflict reducing practices.

Conclusions

Despite wide recommendations for the use of evolution education practices that are conflict reducing for religious students, our study is the first to show efficacy of these practices by comparing student experiences and outcomes across a multitude of classes with variability in both students and instructional practices. Using this large and geographically variable dataset, we found that for highly religious Christian students, when instructors provide examples of compatibility between religion and evolution, this led to higher evolution acceptance after instruction. Secondly, we showed that when students reported that their instructors gave them autonomy over their decisions to accept evolution, it led to greater gains in students’ human evolution acceptance regardless of their religious affiliation or religiosity levels. We posit that the evidence for the efficacy of using conflict reducing practices to improve student outcomes has reached a critical threshold for which it will now be difficult for evolution instructors to justify excluding these practices from their evolution instruction if they wish to increase student evolution acceptance in introductory college biology classes. Future research should move beyond asking whether conflict reducing practices in evolution education can be effective to better understanding how they work and how to best implement these practices for students from a variety of religious and non-religious identities. Data indicates that if instructors were to implement conflict reducing practices more regularly in undergraduate biology education, evolution acceptance rates will rise faster.

Supporting information

S1 Appendix

(XLSX)

pone.0313490.s001.xlsx (45.9KB, xlsx)
S1 Text. Survey items used in analyses and final outcomes.

(DOCX)

pone.0313490.s002.docx (22.3KB, docx)
S2 Text. Item fit statistics for partial credit Rasch models.

(DOCX)

pone.0313490.s003.docx (19.8KB, docx)
S1 Table. Response rate by course.

(DOCX)

pone.0313490.s004.docx (20.4KB, docx)
S2 Table. Details of Rasch transformation of Likert response options.

(DOCX)

pone.0313490.s005.docx (14.9KB, docx)
S3 Table. Estimated marginal means with standard error from a linear mixed model.

Estimated marginal means with standard error from a linear mixed model for human evolution acceptance among undergraduate biology students with different religious affiliations. Results are averaged over the levels of gender, race, and biology major.

(DOCX)

pone.0313490.s006.docx (14.8KB, docx)
S1 Fig. Wright Map and Item Characteristic Curve of religious role model measures.

The histogram on the left represents the distribution of individuals’ “ability”, or test taker’ attributes. The score of individual ability was standardized in logits with 0 as the average and a higher value indicates a student agreed more compared to other students. The data point on the right represents item “difficulties”, or items’ attribute. The higher point indicates more “difficult” items or more disagreement. The higher point indicates more “difficult” items or more disagreement. For example, Cat6 is “strongly disagree” and Cat1 is “strongly agree”.

(TIF)

pone.0313490.s007.tif (153.4KB, tif)
S2 Fig. Wright Map and Item Characteristic Curve of autonomy measures.

The histogram on the left represents the distribution of individuals’ “ability”, or test taker attributes. The score of individual ability was standardized in logits with 0 as the average and a higher value indicates a student agreed more compared to other students. The data point on the right represents item “difficulties”, or items’ attribute. The higher point indicates more “difficult” items or more disagreement. For example, Cat6 is “strongly disagree” and Cat1 is “strongly agree”.

(TIF)

pone.0313490.s008.tif (110.7KB, tif)

Acknowledgments

We would like to acknowledge the instructors of biology courses willing to implement our survey and the thousands of students who were willing to complete the survey.

Data Availability

The dataset and R codes supporting the conclusions of this article is available at GitHub (https://github.com/BioedSPSlab/conflict-reducing-practices-quasi-experiment).

Funding Statement

This study is funded by National Science Foundation #1818659. The funders had role in data collection.

References

  • 1.American Association for the Advancement of Science. Vision and Change in Undergraduate Biology Education [Internet]. 2011. [cited 2023 Feb 8]. Available from: https://visionandchange.org/finalreport/ [Google Scholar]
  • 2.Brownell SE, Freeman S, Wenderoth MP, Crowe AJ. BioCore Guide: A Tool for Interpreting the Core Concepts of Vision and Change for Biology Majors. CBE—Life Sci Educ. 2014. Jun 1;13(2):200–11. doi: 10.1187/cbe.13-12-0233 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Dobzhansky T. Nothing in Biology Makes Sense except in the Light of Evolution. Am Biol Teach [Internet]. 1973. Mar 1 [cited 2024 Mar 6];35(3):125–9. Available from: https://online.ucpress.edu/abt/article/35/3/125/9833/Nothing-in-Biology-Makes-Sense-except-in-the-Light [Google Scholar]
  • 4.Numbers RL. The Creationists: From Scientific Creationism to Intelligent Design. Harvard University Press; 2006. 636 p. [Google Scholar]
  • 5.Miller JD, Scott EC, Ackerman MS, Laspra B, Branch G, Polino C, et al. Public acceptance of evolution in the United States, 1985–2020. Public Underst Sci. 2022. Feb;31(2):223–38. doi: 10.1177/09636625211035919 [DOI] [PubMed] [Google Scholar]
  • 6.Brenan M. Gallup.com. 2019 [cited 2023 Mar 14]. 40% of Americans Believe in Creationism. Available from: https://news.gallup.com/poll/261680/americans-believe-creationism.aspx
  • 7.Barnes ME, Dunlop HM, Sinatra GM, Hendrix TM, Zheng Y, Brownell SE. “Accepting Evolution Means You Can’t Believe in God”: Atheistic Perceptions of Evolution among College Biology Students. CBE—Life Sci Educ. 2020. May 26;19(2):ar21. doi: 10.1187/cbe.19-05-0106 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Smith MU, Siegel H. On the Relationship Between Belief and Acceptance of Evolution as Goals of Evolution Education. Sci Educ. 2016. Aug 1;25(5):473–96. [Google Scholar]
  • 9.Barnes ME, Supriya K, Zheng Y, Roberts JA, Brownell SE. A New Measure of Students’ Perceived Conflict between Evolution and Religion (PCoRE) Is a Stronger Predictor of Evolution Acceptance than Understanding or Religiosity. Price R, editor. CBE—Life Sci Educ. 2021. Sep;20(3):ar42. doi: 10.1187/cbe.21-02-0024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Oliveira AW, Lathrop R. Toward a Curiosity Mindset: Reframing the Problem of Student Disengagement from Classroom Instruction. Eur Educ Res. 2022. Oct 15;5(3):313–7. [Google Scholar]
  • 11.Dunk RDP, Petto AJ, Wiles JR, Campbell BC. A multifactorial analysis of acceptance of evolution. Evol Educ Outreach. 2017. Jul 17;10(1):4. [Google Scholar]
  • 12.Glaze AL, Goldston MJ, Dantzler J. Evolution in the southeastern USA: Factors influencing acceptance and rejection in pre-service science teachers. Int J Sci Math Educ. 2015. Dec;13(6):1189–209. [Google Scholar]
  • 13.Jensen JL, Manwaring KF, Gill RA, Sudweeks RS, Davies RS, Olsen JA, et al. Religious Affiliation and Religiosity and Their Impact on Scientific Beliefs in the United States. BioScience. 2019. Apr 1;69(4):292–304. [Google Scholar]
  • 14.Barnes ME, Brownell SE. Experiences and practices of evolution instructors at Christian universities that can inform culturally competent evolution education. Sci Educ. 2018;102(1):36–59. doi: 10.1002/sce.21317 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Winslow MW, Staver JR, Scharmann LC. Evolution and personal religious belief: Christian university biology-related majors’ search for reconciliation. J Res Sci Teach. 2011;48(9):1026–49. [Google Scholar]
  • 16.Lindsay J, Arok A, Bybee SM, Cho W, Cordero AM, Ferguson DG, et al. Using a Reconciliation Module Leads to Large Gains in Evolution Acceptance. CBE—Life Sci Educ. 2019. Dec;18(4):ar58. doi: 10.1187/cbe.19-04-0080 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Barnes ME, Elser J, Brownell SE. Impact of a Short Evolution Module on Students’ Perceived Conflict between Religion and Evolution. Am Biol Teach. 2017. Feb 1;79(2):104–11. [Google Scholar]
  • 18.Ferguson DG, Jensen JL. Role models, compatibility, and knowledge lead to increased evolution acceptance. Evol Educ Outreach. 2021. Dec;14(1):16. doi: 10.1186/s12052-021-00155-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Bertka CM, Pobiner B, Beardsley P, Watson WA. Acknowledging students’ concerns about evolution: a proactive teaching strategy. Evol Educ Outreach. 2019. Jan 23;12(1):3. [Google Scholar]
  • 20.Holt EA, Ogden TH, Durham SL. The positive effect of role models in evolution instruction. Evol Educ Outreach. 2018. Aug 24;11(1):11. [Google Scholar]
  • 21.Truong JM, Barnes ME, Brownell SE. Can Six Minutes of Culturally Competent Evolution Education Reduce Students’ Level of Perceived Conflict Between Evolution and Religion? Am Biol Teach. 2018. Feb 1;80(2):106–15. [Google Scholar]
  • 22.Barnes ME, Roberts JA, Maas SA, Brownell SE. Muslim undergraduate biology students’ evolution acceptance in the United States. PLOS ONE. 2021. Aug 11;16(8):e0255588. doi: 10.1371/journal.pone.0255588 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Ecklund EH, Scheitle CP. Religion among Academic Scientists: Distinctions, Disciplines, and Demographics. Soc Probl. 2007. May 1;54(2):289–307. [Google Scholar]
  • 24.Scientists and Belief [Internet]. Pew Research Center’s Religion & Public Life Project. 2009 [cited 2024 Apr 17]. Available from: https://www.pewresearch.org/religion/2009/11/05/scientists-and-belief/
  • 25.Barnes ME, Brownell SE. A call to use cultural competence when teaching evolution to religious college students: Introducing religious cultural competence in evolution education (ReCCEE). CBE—Life Sci Educ. 2017. Dec 1;16(4):es4. doi: 10.1187/cbe.17-04-0062 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Tanner K, Allen D. Cultural Competence in the College Biology Classroom. CBE—Life Sci Educ. 2007. Dec;6(4):251–8. doi: 10.1187/cbe.07-09-0086 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Barnes ME, Truong JM, Brownell SE. Experiences of Judeo-Christian Students in Undergraduate Biology. CBE—Life Sci Educ. 2017. Mar;16(1):ar15. doi: 10.1187/cbe.16-04-0153 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Barnes ME, Brownell SE. Practices and Perspectives of College Instructors on Addressing Religious Beliefs When Teaching Evolution. CBE—Life Sci Educ. 2016. Jun;15(2):ar18. doi: 10.1187/cbe.15-11-0243 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Betancourt JR. Cross-cultural Medical Education: Conceptual Approaches and Frameworks for Evaluation. Acad Med. 2003. Jun;78(6):560. doi: 10.1097/00001888-200306000-00004 [DOI] [PubMed] [Google Scholar]
  • 30.Campinha-Bacote J. The Process of Cultural Competence in the Delivery of Healthcare Services: A Model of Care. J Transcult Nurs. 2002. Jul;13(3):181–4. doi: 10.1177/10459602013003003 [DOI] [PubMed] [Google Scholar]
  • 31.Campinha-Bacote J. Delivering Patient-Centered Care in the Midst of a Cultural Conflict: The Role of Cultural Competence. Online J Issues Nurs. 2011. May;16(2):1–1. [PubMed] [Google Scholar]
  • 32.Betancourt JR, Green AR, Carrillo JE, Ananeh-Firempong O. Defining Cultural Competence: A Practical Framework for Addressing Racial/Ethnic Disparities in Health and Health Care. Public Health Reports®. 2003. Jul 1;118(4):293–302. doi: 10.1093/phr/118.4.293 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Pang VO, Stein R, Gomez M, Matas A, Shimogori Y. Cultural Competencies: Essential Elements of Caring-Centered Multicultural Education. Action Teach Educ. 2011. Dec 31;33(5–6):560–74. [Google Scholar]
  • 34.Smith MU. Counterpoint: Belief, understanding, and the teaching of evolution. J Res Sci Teach. 1994. May 1;31(5):591–7. [Google Scholar]
  • 35.Southerland SA, Scharmann LC. Acknowledging the Religious Beliefs Students Bring Into the Science Classroom: Using the Bounded Nature of Science. Theory Pract. 2013. Jan 1;52(1):59–65. [Google Scholar]
  • 36.Weisberg DS, Landrum AR, Metz SE, Weisberg M. No missing link: Knowledge predicts acceptance of evolution in the United States. BioScience. 2018;68(3):212–22. [Google Scholar]
  • 37.Mead R, Hejmadi M, Hurst LD. Scientific aptitude better explains poor responses to teaching of evolution than psychological conflicts. Nat Ecol Evol. 2018. Feb;2(2):388–94. doi: 10.1038/s41559-017-0442-x [DOI] [PubMed] [Google Scholar]
  • 38.Darner R. How Can Educators Confront Science Denial? Educ Res. 2019. May 1;48(4):229–38. [Google Scholar]
  • 39.Meadows L, Doster E, Jackson DF. Managing the Conflict between Evolution & Religion. Am Biol Teach. 2000;62(2):102–7. [Google Scholar]
  • 40.Rios K, Cheng ZH, Totton RR, Shariff AF. Negative Stereotypes Cause Christians to Underperform in and Disidentify With Science. Soc Psychol Personal Sci. 2015. Jul 31;1948550615598378. [Google Scholar]
  • 41.Soneral PAG, Brownell SE, Barnes ME. Analysis of Religious Bias among Christian Students in Science. J Sci Study Relig [Internet]. 2023. [cited 2023 Feb 3];n/a(n/a). Available from: https://onlinelibrary.wiley.com/doi/abs/10.1111/jssr.12825 [Google Scholar]
  • 42.Nadelson LS, Southerland S. A More Fine-Grained Measure of Students’ Acceptance of Evolution: Development of the Inventory of Student Evolution Acceptance—I-SEA. Int J Sci Educ. 2012. Jul 1;34(11):1637–66. [Google Scholar]
  • 43.Beniermann A, Moormann A, Fiedler D. Validity aspects in measuring evolution acceptance: Evidence from surveys of preservice biology teachers and creationists. J Res Sci Teach. 2023;60(6):1223–65. [Google Scholar]
  • 44.Sbeglia GC, Nehm RH. Do you see what I‐SEA? A Rasch analysis of the psychometric properties of the Inventory of Student Evolution Acceptance. Sci Educ. 2019. Mar;103(2):287–316. [Google Scholar]
  • 45.Barnes ME, Dunlop HM, Holt EA, Zheng Y, Brownell SE. Different evolution acceptance instruments lead to different research findings. Evol Educ Outreach. 2019. Jan 31;12(1):4. [Google Scholar]
  • 46.Grunspan DZ, Dunk RDP, Barnes ME, Wiles JR, Brownell SE. A comparison study of human examples vs. non-human examples in an evolution lesson leads to differential impacts on student learning experiences in an introductory biology course. Evol Educ Outreach. 2021. Jun 26;14(1):9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Pobiner B. Accepting, understanding, teaching, and learning (human) evolution: Obstacles and opportunities. Am J Phys Anthropol. 2016;159(S61):232–74. doi: 10.1002/ajpa.22910 [DOI] [PubMed] [Google Scholar]
  • 48.Pobiner B, Beardsley PM, Bertka CM, Watson WA. Using human case studies to teach evolution in high school A.P. biology classrooms. Evol Educ Outreach. 2018. Apr 20;11(1):3. [Google Scholar]
  • 49.Wiles JR, Alters B. Effects of an Educational Experience Incorporating an Inventory of Factors Potentially Influencing Student Acceptance of Biological Evolution. Int J Sci Educ. 2011. Dec 1;33(18):2559–85. [Google Scholar]
  • 50.American Educational Research Association, editor. Standards for Educational and Psychological Testing. Washington, D.C: American Educational Research Association; 2011. 60 p. [Google Scholar]
  • 51.García AA. Cognitive Interviews to Test and Refine Questionnaires. Public Health Nurs. 2011. Sep;28(5):444–50. doi: 10.1111/j.1525-1446.2010.00938.x [DOI] [PubMed] [Google Scholar]
  • 52.Carter BE, Wiles JR. Scientific consensus and social controversy: exploring relationships between students’ conceptions of the nature of science, biological evolution, and global climate change. Evol Educ Outreach. 2014. Apr 5;7(1):6. [Google Scholar]
  • 53.Nehm RH, Schonfeld IS. Does Increasing Biology Teacher Knowledge of Evolution and the Nature of Science Lead to Greater Preference for the Teaching of Evolution in Schools? J Sci Teach Educ. 2007. Oct 1;18(5):699–723. [Google Scholar]
  • 54.Rutledge ML, Warden MA. Evolutionary Theory, the Nature of Science & High School Biology Teachers: Critical Relationships. Am Biol Teach. 2000;62(1):23–31. [Google Scholar]
  • 55.Scharmann LC, Smith MU, James MC, Jensen M. Explicit Reflective Nature of Science Instruction: Evolution, Intelligent Design, and Umbrellaology. J Sci Teach Educ. 2005. Mar 1;16(1):27–41. [Google Scholar]
  • 56.Donnelly LA, Kazempour M, Amirshokoohi A. High School Students’ Perceptions of Evolution Instruction: Acceptance and Evolution Learning Experiences. Res Sci Educ. 2009. Nov 1;39(5):643–60. [Google Scholar]
  • 57.Verhey SD. The Effect of Engaging Prior Learning on Student Attitudes toward Creationism and Evolution. BioScience. 2005;55(11):996. [Google Scholar]
  • 58.Ingram EL, Nelson CE. Relationship between achievement and students’ acceptance of evolution or creation in an upper-level evolution course. J Res Sci Teach. 2006;43(1):7–24. [Google Scholar]
  • 59.Manwaring KF, Jensen JL, Gill RA, Bybee SM. Influencing highly religious undergraduate perceptions of evolution: Mormons as a case study. Evol Educ Outreach. 2015. Dec 3;8(1):23. [Google Scholar]
  • 60.Scharmann LC, Butler W. Two-Year Community: The Use of Journaling to Assess Student Learning and Acceptance of Evolutionary Science. J Coll Sci Teach. 2015. Sep;45(1). [Google Scholar]
  • 61.Wright BD, Linacre JM. Reasonable mean-square fit values. Rasch Meas Trans. 1994;8(3):370. [Google Scholar]
  • 62.Boone WJ. Rasch Analysis for Instrument Development: Why, When, and How? CBE Life Sci Educ. 2016;15(4):rm4. doi: 10.1187/cbe.16-04-0148 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Cohen AB, Shariff AF, Hill PC. The accessibility of religious beliefs. J Res Personal. 2008. Dec;42(6):1408–17. [Google Scholar]
  • 64.Dingemans E, Van Ingen E. Does Religion Breed Trust? A Cross-National Study of the Effects of Religious Involvement, Religious Faith, and Religious Context on Social Trust. J Sci Study Relig. 2015;54(4):739–55. [Google Scholar]
  • 65.Ecklund EH, Scheitle CP, Peifer J. The Religiosity of Academic Scientists in the United Kingdom: Assessing the Role of Discipline and Department Status. J Sci Study Relig. 2018;57(4):743–57. [Google Scholar]
  • 66.Rissler LJ, Duncan SI, Caruso NM. The relative importance of religion and education on university students’ views of evolution in the Deep South and state science standards across the United States. Evol Educ Outreach. 2014. Oct 15;7(1):24. [Google Scholar]
  • 67.Hawley PH, Short SD, McCune LA, Osman MR, Little TD. What’s the Matter with Kansas?: The Development and Confirmation of the Evolutionary Attitudes and Literacy Survey (EALS). Evol Educ Outreach. 2011. Mar;4(1):117–32. [Google Scholar]
  • 68.Bailey G, Han J, Wright D, Graves J Jr. Religiously Expressed Fatalism and the Perceived Need for Science and Scientific Process to Empower Agency. Int J Sci Soc. 2011. Jan 1;2:55–88. [Google Scholar]
  • 69.Baker JO. Acceptance of Evolution and Support for Teaching Creationism in Public Schools: The Conditional Impact of Educational Attainment. J Sci Study Relig. 2013. Mar 1;52(1):216–28. [Google Scholar]
  • 70.Sbeglia GC, Nehm RH. Illuminating the complexities of conflict with evolution: validation of the scales of evolutionary conflict measure (SECM). Evol Educ Outreach. 2020. Nov 23;13(1):23. doi: 10.1186/s12052-020-00137-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Wu MJ, Zhao K, Fils-Aime F. Response rates of online surveys in published research: A meta-analysis. Comput Hum Behav Rep. 2022. Aug 1;7:100206. [Google Scholar]
  • 72.Saleh A, Bista K. Examining Factors Impacting Online Survey Response Rates in Educational Research: Perceptions of Graduate Students [Internet]. Vol. 13, Online Submission. 2017. [cited 2024 Sep 25] p. 63–74. Available from: https://eric.ed.gov/?id=ED596616 [Google Scholar]
  • 73.Simmons JP, Nelson LD, Simonsohn U. False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant. Psychol Sci. 2011. Nov 1;22(11):1359–66. doi: 10.1177/0956797611417632 [DOI] [PubMed] [Google Scholar]
  • 74.National Center for Science and Engineering Statistics (NCSES). Diversity and STEM: Women, Minorities, and Persons with Disabilities 2023 [Internet]. Alexandria, VA: National Science Foundation; 2023. [cited 2024 Sep 25]. Available from: https://ncses.nsf.gov/pubs/nsf23315/report/science-and-engineering-degrees-earned [Google Scholar]
  • 75.Bates D, Mächler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using lme4. J Stat Softw. 2015. Oct 7;67:1–48. [Google Scholar]
  • 76.Asai DJ. Race Matters. Cell. 2020. May 14;181(4):754–7. doi: 10.1016/j.cell.2020.03.044 [DOI] [PubMed] [Google Scholar]
  • 77.Long JA. interactions: Comprehensive, User-Friendly Toolkit for Probing Interactions [Internet]. 2022. Available from: https://cran.r-project.org/package=interactions [Google Scholar]
  • 78.Preacher KJ (1 4), Rucker DD (2), Hayes AF (3). Addressing moderated mediation hypotheses: Theory, methods, and prescriptions. Multivar Behav Res. 2007. Jan 1;42(1):185–227. [DOI] [PubMed] [Google Scholar]
  • 79.Hornsey MJ. Social Identity Theory and Self-categorization Theory: A Historical Review. Soc Personal Psychol Compass. 2008;2(1):204–22. [Google Scholar]
  • 80.Ryan RM, Deci EL. Self-Determination Theory: Basic Psychological Needs in Motivation, Development, and Wellness. Guilford Publications; 2017. 769 p. [Google Scholar]
  • 81.Cooper KM, Krieg A, Brownell SE. Who perceives they are smarter? Exploring the influence of student characteristics on student academic self-concept in physiology. Adv Physiol Educ. 2018. Apr 4;42(2):200–8. doi: 10.1152/advan.00085.2017 [DOI] [PubMed] [Google Scholar]
  • 82.Grunspan DZ, Eddy SL, Brownell SE, Wiggins BL, Crowe AJ, Goodreau SM. Males under-estimate academic performance of their female peers in undergraduate biology classrooms. PloS One. 2016;11(2):e0148405. doi: 10.1371/journal.pone.0148405 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Trujillo G, Tanner KD. Considering the Role of Affect in Learning: Monitoring Students’ Self-Efficacy, Sense of Belonging, and Science Identity. CBE Life Sci Educ. 2014;13(1):6–15. doi: 10.1187/cbe.13-12-0241 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Barnes ME, Werner R, Brownell SE. Differential Impacts of Religious Cultural Competence on Students’ Perceived Conflict with Evolution at an Evangelical University. Am Biol Teach. 2020. Feb 1;82(2):93–101. [Google Scholar]
  • 85.Green K, Delgado C. Crossing cultural borders: results of an intervention on community college biology students’ understanding and acceptance of evolution. Int J Sci Educ. 2021. Mar 4;43(4):469–96. [Google Scholar]
  • 86.Martin-Hansen LM. First-Year College Students’ Conflict with Religion and Science. Sci Educ. 2006. Dec 31;17(4):317–57. [Google Scholar]
  • 87.Ladine TA. Attitudes of Students at a Private Christian Liberal Arts University Toward the Teaching of Evolution. Evol Educ Outreach. 2009. Jul 30;2(3):386–92. [Google Scholar]
  • 88.Cavallo AML, White KJ, McCall David. The Mismatch Among Students’ Views About Nature of Science, Acceptance of Evolution, and Evolutionary Science Understandings. Sci Educ Rev. 2011;10(2):37–42. [Google Scholar]
  • 89.Reiss MJ. Religion in Science Education. In: Mansour N, Wegerif R, editors. Science Education for Diversity: Theory and Practice [Internet]. Dordrecht: Springer Netherlands; 2013. [cited 2024 Apr 25]. p. 317–28. Available from: 10.1007/978-94-007-4563-6_15 [DOI] [Google Scholar]
  • 90.Scharmann LC. Teaching Evolution: Designing Successful Instruction. Am Biol Teach. 1993;55(8):481–6. [Google Scholar]
  • 91.Scharmann DLC. Teaching evolution: Designing successful instruction. J Sci Teach Educ. 1994. Dec 1;5(4):122–9. [Google Scholar]

Decision Letter 0

Mc Rollyn Daquiado Vallespin

22 Aug 2024

PONE-D-24-17358Student perceptions of conflict reducing practices in evolution education are associated with increases in their evolution acceptance in a large naturalistic studyPLOS ONE

Dear Dr. Barnes,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

Below, I have outlined the revisions needed:

Table and Figures:

  1. Table 1: The heading "Acceptance of evolution" may be misleading, as the percentages might not reflect this concept accurately.

  2. Figures 3 and 5:
    • Clarify the categories as "more than 1 SD above/below the mean" and use labels like "≤ -1 SD" or "≥ +1 SD" for clarity.
    • Resolve the inconsistency regarding the description of "students affiliated with no religion" by rephrasing the caption.
    • Define what "mean" represents in the context of these figures to avoid confusion.
    • Explain what the shaded areas in the plots signify, possibly the 95% CI for the linear model.
  3. Figure 4: Correct the dashed horizontal line, which should represent the "overall mean within all samples," and fix a copy-paste error in the R code.

Abstract:

  1. Add the background of the study at the beginning.

  2. Include a statement about the potential transformative impact of the research on evolution education.

  3. Specify the implications of the findings for evolution education practices.

Introduction:

  1. Clearly state the research questions and objectives in a dedicated paragraph.

  2. Include a brief discussion of the theoretical framework, particularly cultural competence in science education.

Methods:

  1. Improve the clarity of the statistical analysis plan by using subheadings and explaining the rationale for each control variable.

  2. Address how the sampling methods ensure the representativeness of the sample and discuss the adequacy of the 44% response rate.

Results:

  1. Use subheadings to separate results for each research question or hypothesis.

  2. Include effect sizes along with p-values to provide a sense of the magnitude of observed effects.

  3. Briefly mention the statistical methods used beneath the figures and tables.

Discussion:

  1. Add more depth to the discussion section, particularly in interpreting the results.

  2. Address limitations more explicitly, especially the sample size for non-Christian religious groups.

  3. Expand the discussion on why religious role models were effective only for Christian students, considering cultural and contextual factors.

  4. Discuss the potential long-term effects of the conflict-reducing practices and their relevance to the field.

  5. Consider adding a section on ethical considerations, including informed consent.

Title and Tone:

  1. Shorten the title to make it more concise.

  2. Add an introductory sentence in the abstract to address the research problem.

  3. Minimize the use of first-person pronouns to enhance the academic tone.

  4. Clarify the findings presented in the abstract to reflect all data sets collected.

General Suggestions:

  1. Ensure that the discussion includes more in-depth analysis of the findings rather than being dominated by comparisons with previous studies.

  2. Consider reorganizing the methodology section for better flow, particularly regarding the construct validation paragraph.

==============================

Please submit your revised manuscript by Oct 06 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Mc Rollyn Daquiado Vallespin

Academic Editor

PLOS ONE

Journal Requirements: 

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following financial disclosure: 

"NSF Grant number 1818659"

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." 

If this statement is not correct you must amend it as needed. 

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

3. Please expand the acronym “NSF” (as indicated in your financial disclosure) so that it states the name of your funders in full.

This information should be included in your cover letter; we will change the online submission form on your behalf.

4. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

"We would like to acknowledge the instructors of biology courses willing to implement our survey and the thousands of students who were willing to complete the survey. This project was supported by the NSF Grant number 1818659."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

"NSF Grant number 1818659"

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: I Don't Know

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a well-written, timely, and thoughtful research paper. The methodology, subject selection, and survey development all seem to be excellent.

There are a few small errors/inconsistencies that I happened to notice which should be corrected-- and I would ask that the authors please double-check all of the statistical analyses to ensure there aren't any additional errors. My concern is that a few sloppy (but minor) errors might indicate that something else has been overlooked.

Specific things that I happened to notice:

** In Table 1, there is a heading that says "Acceptance of evolution" which doesn't seem correct - I don't think those percentages indicate "acceptance of evolution."

** Figures 3 and 5 are not described completely or correctly. For instance:

- I think the categories should be described as "more that 1 SD above the mean" or "more than 1 SD below" instead of "1 SD above" or "1 SD below"? In the figure legend perhaps it would be clearer with a label like "≤ -1 SD" or "≥ +1 SD" ?

- The caption says "The red lines are students affiliated with no religion and have religiosity measures 1 SD below the mean." but in the text it states "students affiliated with no religion" in fact "may have checked the box for “Christian”, “Muslim”, “Jewish”, etc, we considered them non-religious because they did not believe this was a relevant or important part of their identities" So there seems to be some inconsistency there. Perhaps it would be better to state "The red lines are students with religiosity measures more than 1 SD below the mean, which we have coded as having no religious affiliation."

- Do the dashed lines that say "mean" represent the mean of the entire population of individuals coded in the specific subgroups (i.e. the mean of all students who identified as "Christian" or as "Other-Religion")? There are several uses of the term "mean" in the figure and caption and I can't always tell what is meant in each case.

- I couldn't find any description of what the shaded areas on these plots signifies— is it 95% CI for the linear model?

** In Figure 4 the dashed horizontal line should represent the "overall mean within all samples" but that obviously can't be correct. I found a simple copy-paste error in the R code (thank you SO MUCH for sharing your code! excellent.) - in line 379 in the file on GitHub it plots "course_stats_rsrm$mean" but should be plotting "course_stats_aut$mean"

I haven't tried to re-run the R code myself or repeat any of the analyses, but I would ask that the authors, in preparing a re-submission to correct these small points, please also ensure that there aren't other errors that I might not have noticed in my review of the manuscript. I think that the statistical analyses are appropriate and correct, but the small concerns identified above make me hesitant to give it my full confidence.

The discussion and survey of prior work in this area are thorough, and well-written. Excellent work!

Reviewer #2: Dear Editor,

Rahmi et al. have conducted a significant study on Student perceptions of conflict-reducing practices in evolution education. Their research, which is associated with increases in evolution acceptance, is a unique and valuable contribution to the field. With some major revisions, this study has the potential to become an even stronger piece of research.

Abstract:

The abstract provides a clear overview of the study's purpose, methods, and key findings. However, there are a few areas that could be improved.

1. Add the background of the study at the beginning of the abstract.

2. Consider adding a brief statement about the potential transformative impact of this research in the broader context of evolution education. This could inspire further research and innovation in the field.

3. The conclusion could be more specific about the implications of these findings for evolution education practices.

Introduction

1. The research questions are the backbone of the study and could be more clearly stated. Consider adding a paragraph that explicitly outlines the study's objectives and hypotheses, emphasizing their importance to the research process.

2. The introduction could benefit from a brief discussion of the theoretical framework guiding this research, particularly regarding the concept of cultural competence in science education.

Material methods

The statistical analysis plan is appropriate, but it could be more clearly presented. Consider using subheadings to separate the different analyses performed and provide a brief rationale for the inclusion of each control variable.

Results

The results are presented clearly and correspond well to the research questions. However, there are a few suggestions for improvement:

1. Consider using subheadings to separate the results for each research question or hypothesis.

2. It would be helpful to include effect sizes along with p-values to give readers a better sense of the magnitude of the observed effects.

3. Briefly mention the statistical methods used to derive key figures and results beneath the figures and tables.

Discussion

1. The discussion section provides a general interpretation of the results. While it lacks depth in explanation, it is evident that a significant amount of effort has been put into this section.

2. The analysis of differential effects across religious affiliations is somewhat limited by sample size for non-Christian religious groups. This limitation, along with others, could be addressed more explicitly in the limitations section, providing a more comprehensive understanding of the research's scope and potential areas for future investigation.

3. The discussion of why religious role models were only effective for Christian students could be expanded, perhaps considering cultural and contextual factors more deeply.

4. The potential long-term effects of these conflict-reducing practices are not addressed. A more detailed discussion of whether these changes in evolution acceptance persist over time would be valuable, as it would highlight the potential implications of the research and its relevance to the field.

5. Consider adding a brief section on ethical considerations, including how informed consent was obtained from participants.

Regards,

Reviewer #3: Title:

Your title is too long. It would be better if it could be shortened.

Abstract:

Please add an introductory sentence at the beginning of the abstract that addresses the research problem you are investigating.

You have used first-person pronouns excessively. To enhance the academic tone of the manuscript, minimize the use of first-person pronouns.

Based on the second and third sentences, it appears that you collected at least three sets of data. However, the fourth sentence only presents one finding.

Introduction:

The introduction is well-structured with a clear flow, allowing readers to follow the developed framework and the issues being reported effectively.

Although brief, the state-of-the-art and research gap related to the study’s topic are addressed in the fourth paragraph.

Methods:

The research methods are presented comprehensively, with sufficient detail and clarity, allowing readers to fully understand the design and steps of the study, from instrument development to the analysis of findings.

One minor suggestion for making the methodology section more systematic is to place the paragraph on construct validation for the survey instrument measuring Conflict Reducing Practices in Evolution Education (predictor variable) after the paragraph on expert and student reviews and before the paragraph on class observation.

You used convenience and snowball sampling methods. How did you ensure that the sample is representative of the population?

Is a 44% response rate considered adequate?

Results:

The research findings are presented in a complete and systematic manner.

Discussion:

While the discussion addresses the findings, it lacks depth and breadth. The discussion is currently dominated by comparisons between your findings and those of previous studies, as well as suggestions for future research based on unanswered questions. These two components should not be reduced in the revised manuscript, but you should add more in-depth discussion of the findings you have obtained.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Ahmad Fauzi

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Dec 4;19(12):e0313490. doi: 10.1371/journal.pone.0313490.r002

Author response to Decision Letter 0


4 Oct 2024

Dear monitoring editor and reviewers,

Thank you for your detailed and thoughtful review of our manuscript, "Conflict-reducing practices in evolution education are associated with increases in evolution acceptance: A large naturalistic study," for further consideration in PLOS ONE. We have carefully considered the feedback and believe we have significantly improved the manuscript.

First, we expanded the discussion to enhance the manuscript's potential for impact. We also expanded the description of the theoretical framework, particularly adding clarity to cultural competence as a frame. Additionally, we have made the limitations of our research more explicit, particularly regarding our inability to address the distinct experiences and perspectives of individual religious groups that are not Christian. We have also addressed the potential limitation of the generalizability of our sample. Another key revision involved improving the accuracy and clarity of our results, which reflected in the figures, figure captions, tables, and subheadings.

We have responded to each reviewer’s comments, as outlined by the editor, in more detail in "Response to reviewers.doc". We hope these revisions bring the work closer to being suitable for publication.

Attachment

Submitted filename: Response to reviewers.docx

pone.0313490.s009.docx (38.8KB, docx)

Decision Letter 1

Mc Rollyn Daquiado Vallespin

25 Oct 2024

Conflict reducing practices in evolution education are associated with increases in evolution acceptance in a large naturalistic study

PONE-D-24-17358R1

Dear Dr. BARNES,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Mc Rollyn Daquiado Vallespin

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Mc Rollyn Daquiado Vallespin

4 Nov 2024

PONE-D-24-17358R1

PLOS ONE

Dear Dr. Barnes,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Mc Rollyn Daquiado Vallespin

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix

    (XLSX)

    pone.0313490.s001.xlsx (45.9KB, xlsx)
    S1 Text. Survey items used in analyses and final outcomes.

    (DOCX)

    pone.0313490.s002.docx (22.3KB, docx)
    S2 Text. Item fit statistics for partial credit Rasch models.

    (DOCX)

    pone.0313490.s003.docx (19.8KB, docx)
    S1 Table. Response rate by course.

    (DOCX)

    pone.0313490.s004.docx (20.4KB, docx)
    S2 Table. Details of Rasch transformation of Likert response options.

    (DOCX)

    pone.0313490.s005.docx (14.9KB, docx)
    S3 Table. Estimated marginal means with standard error from a linear mixed model.

    Estimated marginal means with standard error from a linear mixed model for human evolution acceptance among undergraduate biology students with different religious affiliations. Results are averaged over the levels of gender, race, and biology major.

    (DOCX)

    pone.0313490.s006.docx (14.8KB, docx)
    S1 Fig. Wright Map and Item Characteristic Curve of religious role model measures.

    The histogram on the left represents the distribution of individuals’ “ability”, or test taker’ attributes. The score of individual ability was standardized in logits with 0 as the average and a higher value indicates a student agreed more compared to other students. The data point on the right represents item “difficulties”, or items’ attribute. The higher point indicates more “difficult” items or more disagreement. The higher point indicates more “difficult” items or more disagreement. For example, Cat6 is “strongly disagree” and Cat1 is “strongly agree”.

    (TIF)

    pone.0313490.s007.tif (153.4KB, tif)
    S2 Fig. Wright Map and Item Characteristic Curve of autonomy measures.

    The histogram on the left represents the distribution of individuals’ “ability”, or test taker attributes. The score of individual ability was standardized in logits with 0 as the average and a higher value indicates a student agreed more compared to other students. The data point on the right represents item “difficulties”, or items’ attribute. The higher point indicates more “difficult” items or more disagreement. For example, Cat6 is “strongly disagree” and Cat1 is “strongly agree”.

    (TIF)

    pone.0313490.s008.tif (110.7KB, tif)
    Attachment

    Submitted filename: Response to reviewers.docx

    pone.0313490.s009.docx (38.8KB, docx)

    Data Availability Statement

    The dataset and R codes supporting the conclusions of this article is available at GitHub (https://github.com/BioedSPSlab/conflict-reducing-practices-quasi-experiment).


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES