Abstract
Despite broad consensus that highlighting counter-stereotypical scientist role models in educational materials promotes equity and success, the specific elements that make these materials effective remain untested. Are pictures of counter-stereotypical scientists enough to communicate to students that scientists come from a variety of backgrounds, or is additional information required? To parse the effects of including visual depictions and humanizing information about scientists featured in biology course materials, we distributed three randomized versions of assignments over several academic terms across 36 undergraduate institutions (n > 3700 students). We found that including humanizing information about scientists was key to increasing student engagement with the biology course materials. The positive effect of humanizing information was especially important for students who related to the scientists. Structural equation modelling revealed the extent to which students related to scientists mediated the positive effect of humanizing descriptions on student engagement. Furthermore, our results were strongest among students who shared one or more excluded identity(s) with the featured scientists. Our findings underscore the importance of providing students with examples of humanized and relatable scientists in classrooms, rather than simply adding a photo to increase representation.
Keywords: biology undergraduate education, counter-stereotypical scientist, equity, relatability, scientist role model
1. Introduction
Undergraduate students in science, technology, engineering, and mathematics (STEM) are unlikely to see a diversity of scientists represented in their educational materials [1–5]. The absence of scientists who possess diverse identities is due to persistent systems of oppression that exclude and marginalize people and that acknowledge a narrow definition of success in science as belonging to elite, primarily white institutions [6–8]. The mismatch between the identities of scientists featured in courses and an increasingly diversified student body [9] upholds the stereotype of scientists as white, cis-men, perpetuating the false narrative that only certain types of people contribute to the scientific enterprise [10–13].
Educators and curriculum developers have worked to combat this false narrative by creating educational materials that highlight scientists from a diversity of backgrounds, intentionally featuring scientists whose identities do not match the dominant stereotype of a scientist (hereafter, counter-stereotypical scientists) [14–18]. Featuring counter-stereotypical scientists in course materials is billed as a scalable, accessible and easy-to-implement tool that increases the recruitment and retention of students with identities historically and currently excluded from STEM [14]. Recent efforts to evaluate these course materials in undergraduate biology courses have documented numerous benefits to students, including positive impacts on students’ science identity, perception of who can participate in science, engagement with biology materials, and course grades [15–20]. While evidence has demonstrated the efficacy of biology classroom interventions that feature counter-stereotypical scientists [15–20], the specific elements of these interventions that are most impactful remain unclear [21,22]. The lack of research in this area leaves educators and curriculum developers without data-supported guidelines for how to effectively develop and employ classroom materials that feature counter-stereotypical scientists.
Theory predicts that counter-stereotypical scientists must be relatable for students to engage with STEM content and pursue STEM careers [23]. Students are hypothesized to relate to scientists along two different axes: shared visual elements (i.e. that scientist looks like me) and shared humanizing elements (i.e. that scientist shares similar values, hobbies, and experiences with me) [23]. Humanizing information consists of biographical elements that provide students with a broader, more nuanced and holistic perspective on successful scientists, who may otherwise be considered unrelatable and their success unattainable [24,25]. Here, we test this theory by asking whether a photo is enough to make featured scientists relatable or whether humanizing elements are necessary. Specifically, we employed a large-scale experimental approach in undergraduate biology courses across the United States to parse the effects of visual and humanizing elements of classroom materials featuring counter-stereotypical scientists on how students relate to scientists and engage with biology content.
Prior experimental work on biology course materials featuring counter-stereotypical scientists has been limited to single institutions [15–17,19,20]. To account for differences in social and environmental contexts across universities [26], we conducted a nationwide, multi-institutional study across 36 undergraduate institutions, reaching over 3700 students. We experimentally manipulated the way biology activities highlight counter-stereotypical scientists. Students were given one of three versions of short quantitative exercises (Data Nuggets [27,28]) that feature data from contemporary scientists who self-report as having identities excluded from biology (Project Biodiversify [29]). As treatments, students were exposed to: (i) quantitative exercises that do not include any information about the scientist aside from their name and pronouns (control); (ii) quantitative exercises with photos of the scientist (visual treatment); or (iii) quantitative exercises with scientist photos and interview questions answered by the scientist about their experiences as counter-stereotypical scientists (humanizing treatment) (figure 1A).
Figure 1.
Effects of visual and humanizing elements on how students relate to scientists and engage with quantitative biology activities. (A) Three treatments used in this study varied the extent to which visual and humanizing elements were provided during quantitative biology activities. (B) Our path model found that the perceived relatability of the scientist mediated the relationship between the three treatments and all three dimensions of student engagement on the quantitative biology activities. In particular, the humanizing treatment led to higher scientist relatability which increased student engagement. Black paths are significant (p < 0.05). Marginal means are reported for the path connecting treatment to scientist relatability, and mean-variance standardized beta coefficients are reported for paths connecting scientist relatability to the three components of engagement. (C) Marginal means with 95% confidence error bars of the extent to which students related to the featured scientist by treatment and the extent to which the student gender and race/ethnicity identities matched the identities of the scientist featured. Jittered points (n = 6244 survey responses from 3103 students) depict the extent to which students related to the scientist on a 7-point sliding scale, ranging from 1 (not at all) to 7 (very), that has been mean and variance standardized.
We used this experimental design to investigate the effects of visual and humanizing elements of counter-stereotypical scientists featured in biology course materials. Specifically, we address three research questions.
What enhances student engagement? We tested which features of counter-stereotypical scientists are responsible for creating change in how students engage with biology materials. We further employed structural equation modelling (SEM) to explicitly test theoretical predictions that the extent to which students relate to scientists drives student engagement with course content [23].
Does it matter whether students share the same identities as the featured scientists? Exposure to curricular materials that feature counter-stereotypical scientists is expected to shift attitudes towards science and scientists, especially among students who share identities with the featured scientists [21,22]. To test this hypothesis, we demographically matched counter-stereotypical identities of featured scientists and students.
What exactly are students relating to? Finally, we analysed qualitative student responses to better understand which elements of the featured scientists were most relatable to students.
Answers to these research questions will inform the development of biology curricular materials that ultimately improve equity in undergraduate biology education.
2. Material and methods
(a). Experimental design
We used a multi-level experimental design in which instructors of undergraduate biology courses in the United States applied three randomized treatments across academic terms (figure 1A). The three treatments were designed to assess the impacts of quantitative biology activities that varied in the extent to which they included information about featured counter-stereotypical scientists. Each academic term involved the implementation of three activities from a single treatment. Activities emphasized data interpretation from research conducted by the featured scientists (e.g. identifying hypotheses, making predictions, and drawing graphs from data), and the assignments were embedded throughout the academic term. Our materials were written based on the science and lived experiences of 12 biologists who self-reported possessing excluded backgrounds and identities (electronic supplementary material, table S1).
(b). Material development
We developed classroom materials that pair profiles of counter-stereotypical scientists with quantitative biology exercises for use in this study. These activities were created by combining elements of two pre-developed programs: Data Nuggets activities (quantitative biology activities that use authentic data from real researchers in K−16 classrooms, https://datanuggets.org/) and Project Biodiversify Scientist Profiles (researcher profiles of counter-stereotypical scientists for easy use in classrooms, https://projectbiodiversify.org/). We invited scientists to participate in our study who had already created either a Data Nugget activity or a Project Biodiversify Scientist Profile. We created course materials in close colloabroation with the featured scienitsts, placing priority on the development of content that reflects the scientists' stories. All scientists were offered compensation for their work developing these course materials. All materials used in this study are freely available for download at https://datanuggets.org/dataversify/. See the electronic supplementary materials for an example classroom activity.
Each activity included three elements when presented in full: (i) a brief overview of a scientific study with associated quantitative biology questions, (ii) photos of the scientist who conducted the study, and (iii) humanizing information about the scientist. Data Nuggets feature scientists and provide real data and images from their research, alongside scientific background information, a graphing activity, and questions about the study for students to answer. Project Biodiversify scientist profiles include both visual and humanizing elements about the scientist. Visual elements consist of two photos of the scientist—one at work and one from life outside of science, both chosen by the scientist. Examples of photos included the scientist spending time with their family, enjoying nature, and participating in Comic-Con. Project Biodiversify profiles also allow scientists to share humanizing information revealed through open-ended response prompts answered via google forms by the scientist about their life and science experiences. In the Project Biodiversify profiles, scientists responded to the following questions:
Why did you become a biologist?
What is your favourite part about your job?
What obstacles have you overcome to get where you are?
What advice do you have for aspiring biologists?
Do you feel that any dimension of your identity is invisible or under-represented/marginalized in STEM?
Can you elaborate on your answer above?
Examples of scientists’ experiences shared in their profiles include discussions of challenges learning English, education quality gaps, discrimination faced during gender transitions, and difficulties associated with mental health. See the electronic supplementary material for an example of a full scientist profile.
(c). Treatments
Our treatments manipulated which elements of the activities were presented in classrooms across three academic terms. This approach allowed us to use the same core content and quantitative biology instruction, while varying the extent to which we shared scientific visual and humanizing content (figure 1A). The control treatment exposed students to Data Nuggets, but photos and additional information from the Project Biodiversify scientist profiles were not included. In the visual treatment, students were exposed to Data Nuggets as well as one image of the scientist. In the humanizing treatment, students were exposed to Data Nuggets and the scientist profiles from Project Biodiversify (i.e. multiple scientist photos and humanizing information). Of note, our control treatment incorporated scientists’ names and pronouns, which can communicate information about gender and race/ethnicity identities. As such, the comparison between the control and visual treatments evaluates the impact of visual depictions of scientists, beyond names and pronouns.
(d). Instructor recruitment
We recruited 43 instructors from 36 US academic institutions across 20 states (electronic supplementary material, table S2). To recruit instructors, we used Data Nuggets and Project Biodiversify mailing lists and social media accounts, suggestions from members of our network, academic and conference listservs, and the NSF Research Coordination Network project, Equity and Diversity in Undergraduate STEM (NSF-RCN-UBE-1919462, 1 September 2019 to 31 August 2023). We selected individuals from 289 applicants after reviewing their course schedules and considering the best fit for our study design. In total, 126 instructors met the parameters of our study, and 43 instructors accepted our invitation to participate in the study. During the study, instructors implemented materials in 37 introductory-level biology courses and four upper-level courses. Instructor participants represented a broad population who taught at R1 universities, liberal arts institutions, primarily undergraduate institutions, and community colleges. Of the 32 instructors who provided demographic identities, 27 were women and 5 were men. This subset also included 29 white/European American, 2 Asian/Asian American, 2 Black/African American and 1 Latino/a/x/Hispanic American instructors. Two of these instructors identified with multiple race/ethnicities. All instructors were compensated for their participation in the study.
(e). Content matching and featured counter-stereotypical scientist selection
We worked directly with each instructor to select three out of 12 quantitative biology activities that best matched their course content, while still highlighting a diversity of counter-stereotypical scientists. Our aim was to centre scientists with excluded identities, and, for this reason, we do not have a treatment that features white cis-man scientists, as they are not an excluded demographic group in biology. To ensure each student in our study saw similar levels of representation, we required that each instructor included (i) a scientist who identifies as a minoritized gender (e.g. a woman, or transgender or gender non-conforming person) and (ii) a scientist of colour. We chose these two categories because they are both considered to be excluded groups in biology and, in contrast to concealable stigmatized identities, can often be, but not always, visually identified (important for the visual treatment). However, we recognize that many gender and racial/ethnic identities are concealable and note that several featured scientists in our study revealed their identities in the humanizing, and not visual, treatment. For example, one of our featured scientists identified as transgender and nonbinary (electronic supplementary material, table S1), and they discussed in their scientist profile the serious challenges and discrimination that transgender individuals face when pursuing educational and professional goals. Another scientist identified as both white and Latino/a/x (electronic supplementary material, table S1) and discussed their experience as the child of an immigrant from South America in their scientist profile. We further recognize that women are currently awarded the majority of bachelor’s degrees in the biological and biomedical sciences [30]. However, we consider women a minoritized gender in this study, as they still make up a minority of scientists in biology textbooks [5].
(f). Student demographics and outcome measures
We surveyed students with short, online Qualtrics surveys at the beginning and end of the academic term to collect demographic information, including information about race/ethnicity and gender (electronic supplementary material, table S3). Categories for race/ethnicity were based on standards for the classification of federal data on race/ethnicity, commonly used for federal data collection purposes including the decennial census.
To measure how students related to the featured scientists and engaged with the quantitative biology activities, we also surveyed students immediately after they completed the activities. To quantify scientist relatability and student engagement (including subscales for affective, cognitive, and behavioural engagement), we developed and adapted survey items that used the Experience Sampling Method, a survey approach that asks students to report their thoughts and feelings immediately following exposure to the activity [31,32]. All survey items asked students to respond to the survey questions on a 7-point sliding scale, ranging from 1 (not at all) to 7 (very). We measured the validity of our engagement construct using confirmatory factor analysis (CFA; see next section for further detail) [33]. To understand how students related to scientists, we asked students to respond to the open-ended prompt: ‘Describe how you related to the featured scientist in the activity, if at all’. De-identified survey responses are available on Dryad [34].
(g). Confirmatory factor analysis
Immediately after completing each quantitative biology activity, we surveyed students to measure how students related to the featured scientists and engaged with the activities. Our measure of scientist relatability included one item (if a scientist was mentioned, to what extent did you relate to the featured scientist in the activity?), and our measure of student engagement included seven items, incorporating items for affective (was the activity interesting?, did you enjoy the activity?, how engaging did you find the activity?), cognitive (how important was the activity to you?, how important was this activity to your future?), and behavioural (how hard were you working on the activity?, how well were you concentrating on the activity?) engagement [32]. For our measure of engagement, we specified a three-factor confirmatory factor analysis using the R package lavaan [35]. Confirmatory factor analyses evaluate whether survey items are more closely related to items within their intended set (or factor) rather than to items outside of their factor [33]. Each of our three factors included items that corresponded to either the affective (i.e. interest in the activity), cognitive (i.e. perceived importance of the activity), or behavioural (i.e. effort put into the activity) dimension of student engagement, as we expected based on the original instrument. The model fit of our three-factor CFA was good according to Chi-square statistics and common fit indices ( = 708.468, df = 11, p < 0.0001; CFI = 0.982; TLI = 0.965; RMSEA = 0.092; SRMR = 0.024). Given the validity of the three engagement factors in our student sample, we used the values of these three latent variables in our CFA model as our measures of affective, cognitive, and behavioural engagement.
(h). Statistical analyses
We used path models and mixed models to explore the effects of visual and humanizing elements of featured scientists on how students related to scientists and engaged with biology activities.
(i). Mean-variance standardization
In all of our models, we mean-variance standardized our measures of scientist relatability and student engagement. To mean-variance standardize, we calculated Z-scores using the formula Z-score = (X − μ) / s, where X is either the scientist relatability score or the engagement value measured from the CFA model, μ is the mean relatability or engagement value across the entire student sample, and s is the standard deviation around the mean. Z-scores reflect how many standard deviations a student’s score is from the average of all students across all undergraduate institutions in the sample.
(ii). Random effects
Furthermore, as classroom contexts have the potential to modulate the impacts of curricular interventions, all of our models included both the course and the specific activity implemented as random effects [36]. We also included student ID nested within the course to account for repeated measures and avoid pseudoreplication.
(iii). What enhances student engagement?
We employed piecewise SEM of path models to examine whether student engagement with the activities was mediated by how relatable students found the featured scientists across different levels of exposure to the featured scientist (i.e. control, visual, or humanizing treatments) [37]. SEM is a statistical approach that explores the relationships between several variables simultaneously using a set of linked regression equations and tests the mediating pathways through which one variable influences another variable [38]. Traditional path analysis using SEM assumes normality and independence of observations. To account for repeated measures from each student over an academic term, we employed piecewise SEM of path models using the R package piecewiseSEM [37,39].
We evaluated two separate models to explain each of the components of student engagement (affective, cognitive, and behavioural engagement): the full mediation model and the partial mediation model (electronic supplementary material, figure S1). The full mediation model tested whether scientist relatability fully mediated the relationship between treatment and student engagement, whereas the partial mediation model additionally incorporated a direct effect between treatment and engagement. Piecewise SEM uses Fisher’s C statistic to evaluate the effect of missing paths (in this case, the direct path between treatment and engagement in the full mediation model) on the goodness-of-fit of the model [37]. Models fit the data when the paths missing from the model do not differ from zero, indicated by a Fisher’s C statistic PC > 0.05. As all of our full mediation models fit the data (affective engagement: PC = 0.189; cognitive engagement: PC = 0.207; behavioural engagement: PC = 0.812), we then performed chi-square difference tests to evaluate whether the partial mediation models provided better fits than the full mediation models.
(iv). Does it matter whether students share the same identities as the featured scientists?
We used linear mixed models to test how sharing counter-stereotypical identities of featured scientists impacted the extent to which students relate to scientists across the three treatments. We created four categories of student–scientist demographic matching with a focus on excluded identities, which we define as non-cis-man genders and non-white races (see electronic supplementary material text for detailed information). If the student did not possess an excluded identity (i.e. was a white cis-gender man), that student was included in the non-excluded category. If the student held excluded gender and/or race/ethnicity identity(s), that student either shared both identities (excluded, double match), shared only one identity (excluded, single match), or did not share those identities with the featured counter-stereotypical scientist (excluded, no match).
These categories allowed us to test how sharing counter-stereotypical identities with featured scientists impacts the extent to which students relate to scientists. Our linear mixed model included treatment, demographic matching categories, and the interaction between the two as fixed effects. We fit our models with the R package lme4 and specified a binomial distribution [40]. To directly compare students with different degrees of shared identities, we performed post-hoc Tukey pairwise comparisons and calculated Cohen’s d effect sizes with the R package emmeans [41]. Because 4 of the 12 featured scientists were white women (electronic supplementary material, table S1) and 38% of the students in our sample were white women (electronic supplementary material, figure S2), we also ran a sensitivity analysis that excluded data from activities that featured white women scientists (electronic supplementary material text).
(v). What exactly are students relating to?
We employed mixed effects logistic regression models to explore the effect of student–scientist demographic matching on how students responded to the open-ended prompt, ‘Describe how you related to the featured scientist in the activity, if at all’. For this analysis, we only included students in the humanizing treatment, as our goal was to understand how students relate to the featured scientists when the activity included humanizing information about the scientists.
For this qualitative data analysis, we first described the types of student responses to the open-ended prompt through inductive coding. We generated codes inductively from a close reading of student responses rather than searching the text of the responses for a predetermined list of categories [42]. To create codes, two researchers independently reviewed the first term of student responses, independently developed categories that characterized student responses (i.e. codes), met to compare and revise the codes, and developed a unified codebook. Our final codebook included 24 different codes (electronic supplementary material, table S4). After the creation of the codebook, the same two researchers used axial coding [42] to group and abstract codes into four categories (electronic supplementary material, table S4).
Researchers used this final codebook to first independently code student responses and then collaboratively reach consensus. Over the course of our research project, five different researchers used the final codebook to code student responses. One co-author led this qualitative coding process, coding every student response and collaboratively reaching consensus with another researcher for every student response; this ensured consistency in how responses were coded. Researchers assigned responses to all appropriate codes, meaning a single response could fit in multiple codes. Each student response was coded by at least two different researchers, and each coder independently coded responses in ‘blocks’ ranging from 20 to 1073 responses. After coding a block of responses, the two researchers met to reach 100% consensus. The average initial percentage agreement for the blocks was 59%.
We integrated these codes into mixed effects logistic regression models to determine whether student–scientist demographic matching affected how the student related to the featured scientists. Specifically, we employed four different models, one for each category of student response, to measure the effect of demographic matching on the likelihood that the student (i) related to the excluded identity(s) held by the feature scientists, (ii) related to the humanizing information provided in the scientist profiles, (iii) related to the research interests of the featured scientists, and (iv) did not relate to the featured scientists. We fit our models with the R package lme4 and specified a binomial distribution [40]. We included course, student ID nested within course, and quantitative biology activity as random effects in our logistic regression models.
All analyses were performed using R version 4.3.1.
(i). Positionality statement
We acknowledge that the identities and backgrounds of the authorship team impact the research process (i.e. the questions asked, the data interpretation). Our authorship team shares some identities with the featured counter-stereotypical scientists and student body. Of note, however, all authors on the team are white, which limits our ability to identify with the lived experiences of many students and scientists who have faced barriers on the basis of their race/ethnicity and introduces bias into our study. We counteracted potential biases in the study design, survey development, and data analysis by critically engaging with the materials and questioning each other’s assumptions when analysing and drawing conclusions from the data.
3. Results and discussion
(a). Student population
Our study included 3788 students from undergraduate biology courses for majors and non-majors in the United States. A subset of students provided their complete demographic information (n = 3102 students). In this subset, our student sample comprised 1829 white, 334 Asian, 325 Black, 299 multi-racial, 286 Latino/a/x, 20 American Indian or Alaska Native, and 9 Native Hawaiian or other Pacific Islander students. Additionally, when parsing our student sample by gender, 2002 students identified as women, 978 identified as men, and 122 identified as intersex and trans-spectrum (i.e. transgender, nonbinary, and/or genderqueer). Student demographics did not differ across the three treatments (electronic supplementary material, figure S2). The number of students who responded to our survey across all 43 instructors ranged from 11 to 246, with an average of 88 students per instructor.
(b). What enhances student engagement?
When quantitative biology activities included humanizing information about counter-stereotypical scientists (humanizing treatment), students related more to the scientists (p < 0.0001; n = 7361 survey responses from 3788 students; partial mediation models; figure 1b; Table 1). Students in the humanizing treatment rate the extent to which they relate to the featured scientists by at least 0.16 standard deviations more than students in the visual and control treatments (marginal means: control = −0.074, visual = −0.040, humanizing = 0.124; Table 1). Furthermore, relating more to humanized scientists was associated with higher student engagement with the quantitative biology activities. This was true across three proxy measures for student engagement: (i) interest in the activities (affective engagement; β = 0.37; p < 0.0001), (ii) perceived importance of the activities (cognitive engagement; β = 0.38; p < 0.0001), and (iii) effort spent on the activities (behavioural engagement; β = 0.29; p < 0.0001; figure 1b; Table 1).
Table 1.
Estimates, standard errors (s.e.), and significance values for paths included in the partial path models. Each partial path model included a different component of student engagement: affective, cognitive, and behavioural engagement. Mean-variance standardized estimates are reported for continuous variables and marginal means are reported for categorical variables. Significant p-values at the α = 0.05 level are bolded.
|
model |
path |
estimate |
s.e. |
p‐value |
|---|---|---|---|---|
|
all |
treatment to relatability |
control = −0.074 |
0.037 |
< 0.0001 |
|
visual = −0.040 |
0.035 |
|||
|
humanizing = 0.124 |
0.037 |
|||
|
affective engagement |
relatability to affective engagement |
0.370 |
0.010 |
< 0.0001 |
|
treatment to affective engagement |
control = 0.016 |
0.051 |
0.370 |
|
|
visual = −0.019 |
0.050 |
|||
|
humanizing = −0.046 |
0.051 |
|||
|
cognitive engagement |
relatability to cognitive engagement |
0.378 |
0.010 |
< 0.0001 |
|
treatment to cognitive engagement |
control = 0.029 |
0.039 |
0.565 |
|
|
visual = −0.020 |
0.038 |
|||
|
humanizing = −0.023 |
0.039 |
|||
|
behavioural engagement |
relatability to behavioural engagement |
0.289 |
0.011 |
< 0.0001 |
|
treatment to behavioural engagement |
control = −0.008 |
0.042 |
0.480 |
|
|
visual = −0.013 |
0.041 |
|||
|
humanizing = −0.030 |
0.043 |
Partial mediation models provided better fits of the data compared to full mediation models across all three components of engagement (affective engagement: = 19.875, Pdiff < 0.0001; cognitive engagement: = 21.092, Pdiff < 0.0001; behavioural engagement: = 16.432, Pdiff < 0.0001; Table 1). We found support for partial mediation models despite non-significant direct links between treatment and engagement (electronic supplementary material, figure S1; Table 1).
These results illustrate that humanizing information about counter-stereotypical scientists increases the extent to which students relate to those scientists, which in turn translates to higher student engagement. The observed increases in scientist relatability and student engagement align with prior work documenting the impact of incorporating counter-stereotypical scientists into biology curricular materials [15–20]. Our mediation analyses build on this literature base and provide explicit support for theoretical predictions that scientists featured in biology courses must be relatable to increase student engagement with STEM materials [23]. Furthermore, our findings emphasize that simply describing research, mentioning scientists’ names, or including photos of scientists is not enough to increase scientist relatability and student engagement. By presenting counter-stereotypical scientists as ‘normal’ people who face obstacles and hold excluded identities, biology instructors and curriculum developers can create shifts in how students engage with course materials. As student engagement has been repeatedly shown to positively predict academic performance [43–46], incorporating humanizing information about scientists into biology courses can ultimately support student success in STEM.
(c). Does it matter whether students share the same identities as the featured scientists?
The extent to which students related to the featured scientists depended not only on the information provided about the scientists (treatment: = 29.387, p < 0.0001; n = 6244 survey responses from 3103 students) but also on the extent to which students and featured scientists shared identities systemically excluded from biology (demographic matching: = 15.445, p = 0.0015). We found that the effect of student–scientist demographic matching varied across our three treatments (treatment × demographic matching: = 15.024, p = 0.020). Students who shared one or more excluded identity(s) with the featured scientists rated those scientists as most relatable when activities included humanizing information (double match vs non-excluded: Cohen’s d = 0.331, p = 0.0005; single match vs non-excluded: Cohen’s d = 0.245, p = 0.007; figure 1c; Table 2). Conversely, activities that included only visual elements of the featured scientists were not sufficient to create change in how students with shared excluded identity(s) related to the scientists (double match vs non-excluded: Cohen’s d = 0.060, p = 0.999; single match vs non-excluded: Cohen’s d = 0.006, p = 1.00; figure 1c; Table 2). The control treatment likewise found no relationship between shared excluded identity(s) and scientist relatability (double match vs non-excluded: Cohen’s d = 0.057, p = 1.00; single match vs non-excluded: Cohen’s d = 0.079, p = 0.969; figure 1c; Table 2). Unlike for students with excluded identities, treatment did not impact how students with non-excluded identities (white men) related to the featured scientists (visual vs control: Cohen’s d = 0.095, p = 0.963; humanizing vs control: Cohen’s d = 0.048, p = 1.00; humanizing vs visual: Cohen’s d = −0.047, p = 1.00; figure 1c).
Table 2.
Summary of pairwise comparisons between all student–scientist demographic matching categories for each treatment group from the linear mixed model estimating the effect of student–scientist demographic matching on scientist relatability. Differences in estimated marginal means (contrast estimate), standard errors of the estimates (s.e.), Cohen’s d effect sizes, and significance values from post-hoc Tukey pairwise comparisons are reported. p-values were adjusted using the Tukey method for comparing a family of 12 estimates. Significant p-values at the α = 0.05 level are bolded.
|
treatment |
contrast |
contrast estimate |
s.e. |
effect size (Cohen’s d) |
p‐value |
|---|---|---|---|---|---|
|
humanizing |
double match— single match |
0.109 |
0.066 |
0.087 |
0.900 |
|
double match—no match |
0.185 |
0.069 |
0.147 |
0.245 |
|
|
double match— non-excluded |
0.416 |
0.093 |
0.331 |
0.0005 |
|
|
single match—no match |
0.076 |
0.051 |
0.061 |
0.942 |
|
|
single match— non-excluded |
0.307 |
0.080 |
0.245 |
0.007 |
|
|
no match—non-excluded |
0.231 |
0.083 |
0.184 |
0.189 |
|
|
visual |
double match - single match |
0.067 |
0.059 |
0.053 |
0.993 |
|
double match—no match |
0.104 |
0.061 |
0.083 |
0.867 |
|
|
double match— non-excluded |
0.075 |
0.078 |
0.060 |
0.999 |
|
|
single match—no match |
0.037 |
0.045 |
0.030 |
1.000 |
|
|
single match—non-excluded |
0.008 |
0.068 |
0.006 |
1.000 |
|
|
no match—non-excluded |
−0.029 |
0.070 |
−0.023 |
1.000 |
|
|
control |
double match—single match |
−0.028 |
0.060 |
−0.022 |
1.000 |
|
double match—no match |
−0.041 |
0.066 |
−0.033 |
1.000 |
|
|
double match—non-excluded |
0.071 |
0.083 |
0.057 |
1.000 |
|
|
single match—no match |
−0.013 |
0.049 |
−0.010 |
1.000 |
|
|
single match—non-excluded |
0.099 |
0.072 |
0.079 |
0.969 |
|
|
no match—non-excluded |
0.112 |
0.077 |
0.089 |
0.950 |
Our results emphasize that including humanizing information about counter-stereotypical scientists in course materials is necessary for students to relate to scientists with whom they share excluded identities. Humanizing counter-stereotypical scientists in biology course materials may have produced differential outcomes between students with excluded and non-excluded identities in part because the experiences of these students in STEM contexts widely differ. Students with excluded identities currently face many barriers in STEM classrooms, including exclusionary classroom environments [47], limited representation in textbooks [1–5], and experiences of microaggressions [48,49]. These barriers ultimately produce demographic disparities in STEM graduation rates [50,51]. Embracing the humanity of a wide range of counter-stereotypical scientists holding many different excluded identities is one simple act that can help drive change and broaden participation in undergraduate STEM education [14].
(d). What exactly are students relating to?
Qualitative data analysis found that 20.5% of students in the humanizing treatment related to the excluded identity(s) held by the featured scientists, including the scientists’ race/ethnicity, gender, age and sexuality (electronic supplementary material, table S4). Logistic regressions revealed that the extent to which students share excluded identities with the featured scientists impacted the likelihood that students related to the excluded identity(s) of the featured scientist ( = 59.731, p < 0.0001; n = 1324 responses from 742 students). Students with shared excluded identity(s) had over 28 times higher odds of reporting relating to the excluded identities of the featured scientists compared to white men students (double match: odds ratio = 38.980; p < 0.0001; single match: odds ratio = 28.807; p < 0.0001; figure 2; Table 3). Students with excluded identity(s) but not identity(s) that specifically matched those of the featured scientist still had five times higher odds than white men students of mentioning relating to the excluded identities of the featured scientist (no match: odds ratio = 5.354; p = 0.0013; figure 2; Table 3).
Figure 2.
What about scientists did students with systemically excluded identities relate to? (A) Students with excluded identities had higher odds of relating to the excluded identities held by the featured scientists and lower odds of not relating at all to the featured scientists compared to students with non-excluded identities. Odds ratios and 95% confidence intervals of students with excluded identities across each of the four categories characterizing student responses to the open-ended prompt ‘Describe how you related to the featured scientist in the activity, if at all’. The reference group included non-excluded students (i.e. white men). Confidence intervals that do not cross the dashed line at x = 1 are statistically significant, indicated by asterisks. (B) The percentage of students for each demographic matching category that related to aspects of the featured scientist for each of the four categories.
Table 3.
Summary of four mixed effect logistic regression models, each exploring the effect of student–scientist demographic matching on how students responded to the open-ended prompt: ‘Describe how you related to the featured scientist in the activity, if at all’. Each model included a different category of student response to the prompt: students either did not relate to the featured scientist, related to the scientist’s research interests, related to humanizing information about the scientist, and/or related to the excluded identity of the scientist. Regression coefficient estimates (estimate), standard errors of the estimates (s.e.), odds ratios, percentages of student responses within each demographic matching category, and significance values are reported. The reference group is non-excluded students (i.e. white men). Significant p-values at the α = 0.05 level are bolded.
|
model |
fixed effect |
estimate |
s.e. |
odds ratio |
percentage |
p‐value |
|---|---|---|---|---|---|---|
|
did not relate |
double match |
−1.530 |
0.326 |
0.216 |
31.9% |
<0.0001 |
|
single match |
−1.129 |
0.263 |
0.323 |
39.6% |
<0.0001 |
|
|
no match |
−0.645 |
0.273 |
0.524 |
47.6% |
0.018 |
|
|
relate to research interests |
double match |
−0.101 |
0.284 |
0.903 |
26.7% |
0.721 |
|
single match |
0.032 |
0.232 |
1.033 |
29.5% |
0.889 |
|
|
no match |
0.372 |
0.244 |
1.450 |
34.1% |
0.128 |
|
|
relate to humanizing information |
double match |
0.349 |
0.283 |
1.418 |
24.6% |
0.217 |
|
single match |
−0.217 |
0.240 |
0.805 |
16.5% |
0.366 |
|
|
no match |
0.134 |
0.249 |
1.143 |
21.9% |
0.591 |
|
|
relate to excluded identities |
double match |
3.663 |
0.557 |
38.980 |
37.7% |
<0.0001 |
|
single match |
3.361 |
0.523 |
28.807 |
29.1% |
<0.0001 |
|
|
no match |
1.678 |
0.522 |
5.354 |
10.2% |
0.0013 |
Logistic regressions further revealed that student–scientist demographic matching impacted the likelihood that students did not relate at all to the featured scientist ( = 27.633, p < 0.0001; figure 2). Over half (58.2%) of responses from students with non-excluded identities mentioned not relating to the featured scientists, whereas less than half of responses from double match (31.9%), single match (39.6%) and no match (47.6%) students mentioned not relating at all to the featured scientists (figure 2; Table 3). Finally, student–scientist demographic matching did not impact the likelihood that students related to the research interests ( = 5.208, p = 0.157) or humanizing elements, including hobbies, personality characteristics, and life experiences, ( = 6.155, p = 0.104) of the featured scientists (figure 2). Across all demographic groups, 30.0% and 19.9% of students related to the research interests and hobbies, respectively, of the scientists (figure 2).
Students, regardless of the degree to which they share demographic identities with the featured scientists, related to aspects of the scientist profiles, including the research interests and life experiences of the scientists. This finding emphasizes the impact of brief scientist profiles for students of all backgrounds. However, the scientist profiles used in the humanizing treatment of this study specifically asked scientists to describe dimensions of their identity that are invisible in STEM, and our findings demonstrate that students with excluded identities, especially students who shared those same excluded identities, found the responses to that prompt highly relatable. This analysis reiterates the importance of ‘seeing yourself in science’, as students related most to the identities of the scientists when they shared the same excluded identities as the scientists. However, our results also reveal that students with excluded identities still related to the counter-stereotypical identities held by scientists, even when those students did not share the same excluded identities as the featured scientists. Taken together, this qualitative analysis underscores the importance of providing information about the excluded identities held by counter-stereotypical scientists in biology courses. While previous work has hypothesized the importance of scientists holding meaningfully similar identities, experiences, and interests as students [21,22], this is the first study, to our knowledge, to pinpoint the exact similarities that students most value. Of note, although profiles focused on systemic barriers faced by scientists holding excluded identities, many students related to other aspects of the scientist profiles, like scientists’ research interests, life experiences, personality characteristics, and demographic identities (electronic supplementary material, table S4). Perhaps students were more comfortable naming shared identities rather than discussing obstacles to succeeding in science, a topic that warrants future research.
(e). Limitations and future directions
The present study has several limitations that will inform future research. First, we applied a quantitative analysis to qualitative student response data, which required reducing student open-ended responses to categorical variables and thereby limited the scope of our interpretation of how students related to the featured counter-stereotypical scientists [52]. Future work will employ qualitative analytical approaches, such as open thematic analysis, to provide a more comprehensive understanding of student perspectives on which elements improve scientist relatability. Second, while our study demonstrates the power of adding humanizing information into classroom materials that feature scientists, it does not address whether other types of information would have larger positive impacts, either alone or in tandem with humanizing information. Finally, we did not evaluate the impact of specific types of humanizing information on student outcomes. While our scientist profiles included the same question prompts, scientist responses varied in both tone and length. Future work will focus on understanding the impact of this variation in the amount and type of humanizing information included in scientist profiles and will help guide content development.
4. Concluding remarks
Three key findings emerge from our research. (i) Including humanizing information about the hobbies and experiences of counter-stereotypical scientists featured in curricular materials is necessary for students to relate to scientists. (ii) Students who share one or more excluded identity(s) with humanized scientists relate more than students whose identities do not match featured scientists. (iii) When students relate to scientists featured in curricular materials, they engage more with the materials.
Our results demonstrate that including photos of scientists in course materials is not sufficient to change student attitudes about science. Rather, to engage students, it is critical we also humanize scientists. Exposure to counter-stereotypical scientists is also critically important for students who do not possess excluded identities, to challenge internalized, implicit biases of what types of people can succeed in science [11,53] and reduce the risk they perpetuate a culture of STEM as a white, cisheteropatriarchal space. We recommend several existing resources for use in biology courses, such as DataVersify [27,28] studied here, Project Biodiversify [29], Scientist Spotlights [15–20], BioGraphI, Story Collider Podcast and the SACNAS Biography Project. These materials all vary widely in how they incorporate humanizing information, differing in the amount of information included and the way that information is conveyed (i.e. through text, audio, video). The next step in enhancing curricular resources is to identify the types of humanizing information commonly provided to students and assess their impacts.
Our findings show that it is vital to intentionally centre and humanize counter-stereotypical scientists in curricular materials. By embracing the humanity of scientists, curricular materials can signal to students that they too can contribute to biology. Our work provides a simple approach that curriculum developers and instructional/departmental policies can employ to improve equity in biology.
Acknowledgements
The authors would like to thank Paula Adams, Anurag Agrawal, Maria De Jesus, Ryan Dunk, Carolyn Graham, Michael Smith, Jay Rosenheim, Carl Wieman, two anonymous reviewers, an associate editor, and Maurine Neiman, our editor, for valuable feedback.
Contributor Information
Robin A. Costello, Email: robincos@buffalo.edu.
Emily P. Driessen, Email: Dries046@umn.edu.
Melissa K. Kjelvik, Email: kjelvikm@msu.edu.
Elizabeth H. Schultheis, Email: eschultheis@gmail.com.
Rachel M. Youngblood, Email: rmy0005@auburn.edu.
Ash T. Zemenick, Email: Ash.zemenick@gmail.com.
Marjorie G. Weber, Email: webermg@umich.edu.
Cissy J. Ballen, Email: mjb0100@auburn.edu.
Ethics
This work was approved by Auburn's Institutional Review Board (IRB) no. 20-603 EX 2012. We obtained informed consent from students after the nature and possible consequences of the study were explained.
Data accessibility
De-identified data and code used for data analysis are available at [34]. Curricular materials used in this study are available at [54].
Supplementary material is available online [55].
Declaration of AI use
We have not used AI-assisted technologies in creating this article.
Authors’ contributions
R.A.C.: data curation, formal analysis, methodology, visualization, writing—original draft, writing—review and editing; E.P.D.: methodology, writing—original draft, writing—review and editing; M.K.K.: conceptualization, funding acquisition, methodology, project administration, writing—original draft, writing—review and editing; E.H.S.: conceptualization, funding acquisition, methodology, project administration, writing—original draft, writing—review and editing; R.M.Y.: methodology, writing—original draft, writing—review and editing; A.T.Z.: conceptualization, funding acquisition, methodology, writing—original draft, writing—review and editing; M.G.W.: conceptualization, funding acquisition, methodology, project administration, supervision, writing—original draft, writing—review and editing; C.J.B.: conceptualization, funding acquisition, methodology, project administration, supervision, writing—original draft, writing—review and editing.
All authors gave final approval for publication and agreed to be held accountable for the work performed therein.
Conflict of interest declaration
Data Nuggets is founded by co-authors M.K.K. and E.H.S., and Project Biodiversify is founded by co-authors A.T.Z. and M.G.W.
Funding
This work was funded by National Science Foundation Improving Undergraduate STEM Education grants DUE-2012014 (MGW, EHS, MKK) and DUE-2011995 (CJB, ATZ).
References
- 1. Becker ML, Nilsson MR. 2022. College chemistry textbooks aid and abet racial disparity. J. Chem. Educ. 99, 1847–1854. ( 10.1021/acs.jchemed.1c00968) [DOI] [Google Scholar]
- 2. Damschen EI, Rosenfeld KM, Wyer M, Murphy-Medley D, Wentworth TR, Haddad NM. 2005. Visibility matters: increasing knowledge of women’s contributions to ecology. Front. Ecol. Environ. 3, 212–219. ( 10.1890/1540-9295(2005)003[0212:vmikow]2.0.co;2) [DOI] [Google Scholar]
- 3. Phillips J, Hausbeck K. 2020. Just beneath the surface. In Feminist science studies (eds Mayberry M, Subramaniam B, Weasel L), pp. 125–136. New York, NY: Routledge. ( 10.4324/9780203614266-19) [DOI] [Google Scholar]
- 4. Simpson DY, Beatty AE, Ballen CJ. 2021. Teaching between the lines: representation in science textbooks. Trends Ecol. Evol. 36, 4–8. ( 10.1016/j.tree.2020.10.010) [DOI] [PubMed] [Google Scholar]
- 5. Wood S, Henning JA, Chen L, McKibben T, Smith ML, Weber M, Zemenick A, Ballen CJ. 2020. A scientist like me: demographic analysis of biology textbooks reveals both progress and long-term lags. Proc. R. Soc. B 287, 20200877. ( 10.1098/rspb.2020.0877) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Cedillo S. 2018. Beyond inquiry: towards the specificity of anti-Blackness studies in STEM education. Can. J. Sci. Math. Technol. Educ. 18, 242–256. ( 10.1007/s42330-018-0025-0) [DOI] [Google Scholar]
- 7. Dumas MJ, Nelson JD. 2016. (Re)imagining Black boyhood: toward a critical framework for educational research. Harv. Educ. Rev. 86, 27–47. ( 10.17763/0017-8055.86.1.27) [DOI] [Google Scholar]
- 8. Leyva LA, McNeill RT, Balmer BR, Marshall BL, King VE, Alley ZD. 2022. Black queer students’ counter-stories of invisibility in undergraduate STEM as a white, cisheteropatriarchal space. Am. Educ. Res. J. 59, 863–904. ( 10.3102/00028312221096455) [DOI] [Google Scholar]
- 9. National Center for Science and Engineering Statistics (NCSES) . 2023. Diversity and STEM: women, minorities, and persons with disabilities. See https://ncses.nsf.gov/pubs/nsf23315.
- 10. Chambers DW. 1983. Stereotypic images of the scientist: the draw‐a‐scientist test. Sci. Educ. 67, 255–265. ( 10.1002/sce.3730670213) [DOI] [Google Scholar]
- 11. Ferguson SL, Lezotte SM. 2020. Exploring the state of science stereotypes: systematic review and meta‐analysis of the draw‐a‐scientist checklist. Sch. Sci. Math. 120, 55–65. ( 10.1111/ssm.12382) [DOI] [Google Scholar]
- 12. Finson KD. 2002. Drawing a scientist: what we do and do not know after fifty years of drawings. Sch. Sci. Math. 102, 335–345. ( 10.1111/j.1949-8594.2002.tb18217.x) [DOI] [Google Scholar]
- 13. Miller DI, Nolla KM, Eagly AH, Uttal DH. 2018. The development of children’s gender‐science stereotypes: a meta‐analysis of 5 decades of US draw‐a‐scientist studies. Child Dev. 89, 1943–1955. ( 10.1111/cdev.13039) [DOI] [PubMed] [Google Scholar]
- 14. Handelsman J, Elgin S, Estrada M, Hays S, Johnson T, Miller S, Mingo V, Shaffer C, Williams J. 2022. Achieving STEM diversity: fix the classrooms. Science 376, 1057–1059. ( 10.1126/science.abn9515) [DOI] [PubMed] [Google Scholar]
- 15. Aranda ML, et al. 2021. Student-authored scientist spotlights: investigating the impacts of engaging undergraduates as developers of inclusive curriculum through a service-learning course. CBE. Life Sci. Educ. 20. ( 10.1187/cbe.21-03-0060) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Brandt S, Cotner S, Koth Z, McGaugh S. 2020. Scientist Spotlights: online assignments to promote inclusion in ecology and evolution. Ecol. Evol. 10, 12450–12456. ( 10.1002/ece3.6849) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Metzger KJ, Dingel M, Brown E. 2023. 'No matter what your story is, there is a place for you in science': students’ ability to relate to scientists positively shifts after scientist spotlight assignments, especially for first-generation students and women. CBE Life Sci. Educ. 22, ar12. ( 10.1187/cbe.22-06-0103) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Ovid D, et al. 2023. Scientist spotlights in secondary schools: student shifts in multiple measures related to science identity after receiving written assignments. CBE Life Sci. Educ. 22, ar22. ( 10.1187/cbe.22-07-0149) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Schinske JN, Perkins H, Snyder A, Wyer M. 2016. Scientist spotlight homework assignments shift students’ stereotypes of scientists and enhance science identity in a diverse introductory science class. CBE Life Sci. Educ. 15. ( 10.1187/cbe.16-01-0002) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Yonas A, Sleeth M, Cotner S. 2020. In a 'Scientist Spotlight' intervention, diverse student identities matter. J. Microbiol. Biol. Educ. 21, 10.1128. ( 10.1128/jmbe.v21i1.2013) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Gladstone JR, Cimpian A. 2021. Which role models are effective for which students? A systematic review and four recommendations for maximizing the effectiveness of role models in STEM. Int. J. STEM Educ. 8, 59. ( 10.1186/s40594-021-00315-x) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Lee H, Hernandez PR, Tise JC, Du W. 2023. How role models can diversify college students in STEM: a social-cognitive perspective. Theory Into Pract. 62, 232–244. ( 10.1080/00405841.2023.2226554) [DOI] [Google Scholar]
- 23. Morgenroth T, Ryan MK, Peters K. 2015. The motivational theory of role modeling: how role models influence role aspirants’ goals. Rev. Gen. Psychol. 19, 465–483. ( 10.1037/gpr0000059) [DOI] [Google Scholar]
- 24. Hu D, Ahn JN, Vega M, Lin-Siegler X. 2020. Not all scientists are equal: role aspirants influence role modeling outcomes in STEM. Basic Appl. Soc. Psychol. 42, 192–208. ( 10.1080/01973533.2020.1734006) [DOI] [Google Scholar]
- 25. Ovid D, Rose Acosta-Parra A, Alemayehu A, Francisco Gomez J, Tran D, Tripp B. 2024. 'All of us are capable, and all of us can be scientists': the impact of Scientist Spotlight assignments with undergraduates in physiology courses. Adv. Physiol. Educ. 48. ( 10.1152/advan.00116.2024) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Thompson SK, et al. 2020. A call for data-driven networks to address equity in the context of undergraduate biology. CBE Life Sci. Educ. 19, mr2. ( 10.1187/cbe.20-05-0085) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Schultheis EH, Kjelvik MK, Snowden J, Mead L, Stuhlsatz MAM. 2023. Effects of Data Nuggets on student interest in STEM careers, self-efficacy in data tasks, and ability to construct scientific explanations. Int. J. Sci. Math. Educ. 21, 1339–1362. ( 10.1007/s10763-022-10295-1) [DOI] [Google Scholar]
- 28. Schultheis EH, Kjelvik MK. 2015. Data Nuggets: Bringing real data into the classroom to unearth students’ quantitative and inquiry skills. Am. Biol. Teach. 77, 19–29. ( 10.1525/abt.2015.77.1.4) [DOI] [Google Scholar]
- 29. Zemenick AT, Jones SC, Webster AJ, Raymond E, Sandelin K, Hessami N, Kowalczyk T, Weber MG, Lund Dahlberg CL. 2022. Diversifying and humanizing scientist role models through interviews and constructing slide decks on researchers’ research and life experiences. CourseSource 9. ( 10.24918/cs.2022.1) [DOI] [Google Scholar]
- 30. Zhang A, Duffy S. 2023. Digest of education statistics 2022. Washington, DC: National Center for Education Statistics, Institute of Education Sciences, US Department of Education. [Google Scholar]
- 31. Csikszentmihalyi M. 2014. Flow and the foundations of positive psychology, pp. 35–54. Dordrecht, The Netherlands: Springer Netherlands. ( 10.1007/978-94-017-9088-8_3) [DOI] [Google Scholar]
- 32. Schmidt JA, Rosenberg JM, Beymer PN. 2018. A person‐in‐context approach to student engagement in science: examining learning activities and choice. J. Res. Sci. Teach. 55, 19–43. ( 10.1002/tea.21409) [DOI] [Google Scholar]
- 33. Knekta E, Runyon C, Eddy S. 2019. One size doesn’t fit all: using factor analysis to gather validity evidence when using surveys in your research. CBE—Life Sci. Educ. 18, rm1. ( 10.1187/cbe.18-04-0064) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Costello RA, Driessen EP, Kjelvik MK, Schultheis EH, Youngblood RM, Zemenick AT, Weber MG, Ballen CJ. 2024. More than a token photo: humanising scientists enhances student engagement. Dryad Digital Repository. ( 10.5061/dryad.mgqnk996c) [DOI] [PMC free article] [PubMed]
- 35. Rosseel Y. 2012. lavaan: an R package for structural equation modeling. J. Stat. Softw. 48, 1–36. ( 10.18637/jss.v048.i02) [DOI] [Google Scholar]
- 36. Theobald E. 2018. Students are rarely independent: when, why, and how to use random effects in discipline-based education research. CBE—Life Sci. Educ. 17, rm2. ( 10.1187/cbe.17-12-0280) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Shipley B. 2000. Cause and correlation in biology: a user’s guide to path analysis, structural equations, and causal inference. Cambridge, UK: Cambridge University Press. [Google Scholar]
- 38. Ballen CJ, Salehi S. 2021. Mediation analysis in discipline-based education research using structural equation modeling: beyond ‘what works’ to understand how it works, and for whom. J. Microbiol. Biol. Educ. 22. ( 10.1128/jmbe.00108-21) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Lefcheck JS. 2016. piecewiseSEM : Piecewise structural equation modelling in R for ecology, evolution, and systematics. Methods Ecol. Evol. 7, 573–579. ( 10.1111/2041-210x.12512) [DOI] [Google Scholar]
- 40. Bates D, Mächler M, Bolker B, Walker S. 2015. Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67, 01. ( 10.18637/jss.v067.i01) [DOI] [Google Scholar]
- 41. Lenth RV. 2023. emmeans: estimated marginal means, aka least-squares means. R package version 1.8.9 ( 10.32614/cran.package.emmeans) [DOI]
- 42. Saldaña J. 2013. The coding manual for qualitative researchers. London, UK: Sage. [Google Scholar]
- 43. Chi MTH, Wylie R. 2014. The ICAP framework: linking cognitive engagement to active learning outcomes. Educ. Psychol. 49, 219–243. ( 10.1080/00461520.2014.965823) [DOI] [Google Scholar]
- 44. Dweck CS. 1986. Motivational processes affecting learning. Am. Psychol. 41, 1040–1048. ( 10.1037//0003-066x.41.10.1040) [DOI] [Google Scholar]
- 45. Wigfield E. 2000. Expectancy-value theory of achievement motivation. Contemp. Educ. Psychol. 25, 68–81. ( 10.1006/ceps.1999.1015) [DOI] [PubMed] [Google Scholar]
- 46. Wiggins BL, Eddy SL, Wener-Fligner L, Freisem K, Grunspan DZ, Theobald EJ, Timbrook J, Crowe AJ. 2017. ASPECT: a survey to assess student perspective of engagement in an active-learning classroom. CBE—Life Sci. Educ. 16, ar32. ( 10.1187/cbe.16-08-0244) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Rainey K, Dancy M, Mickelson R, Stearns E, Moller S. 2019. A descriptive study of race and gender differences in how instructional style and perceived professor care influence decisions to major in STEM. Int. J. STEM Educ. 6, 13. ( 10.1186/s40594-019-0159-2) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Harrison C, Tanner KD. 2018. Language matters: considering microaggressions in science. CBE—Life Sci. Educ. 17, fe4. ( 10.1187/cbe.18-01-0011) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Lee MJ, Collins JD, Harwood SA, Mendenhall R, Huntt MB. 2020. 'If you aren’t White, Asian or Indian, you aren’t an engineer': racial microaggressions in STEM education. Int. J. STEM Educ. 7, 16. ( 10.1186/s40594-020-00241-4) [DOI] [Google Scholar]
- 50. Costello RA, Salehi S, Ballen CJ, Burkholder E. 2023. Pathways of opportunity in STEM: comparative investigation of degree attainment across different demographic groups at a large research institution. Int. J. STEM Educ. 10, 46. ( 10.1186/s40594-023-00436-5) [DOI] [Google Scholar]
- 51. Seymour E, Hunter AB. 2019. Talking about leaving revisited: persistence, relocation, and loss in undergraduate stem education. New York, NY: Springer Nature. [Google Scholar]
- 52. Pfeifer MA, Dolan EL. 2023. Venturing into qualitative research: a practical guide to getting started. Scholarsh. Pract. Undergrad. Res. 7, 10–20. ( 10.18833/spur/7/1/2) [DOI] [Google Scholar]
- 53. Sherman JW. 1996. Development and mental representation of stereotypes. J. Personal. Soc. Psychol. 70, 1126–1141. ( 10.1037/0022-3514.70.6.1126) [DOI] [PubMed] [Google Scholar]
- 54. Data Nuggets . Data Nuggets + Project Biodiversity = DataVersify. See https://datanuggets.org/dataversify/.
- 55. Costello RA, Driessen EP, Kjelvik M, Schultheis EH, Youngblood RM, Zemenick Aet al. 2025. Supplementary material from: More than a token photo: humanising scientists enhances student engagement. Figshare. ( 10.6084/m9.figshare.c.7631214) [DOI] [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
De-identified data and code used for data analysis are available at [34]. Curricular materials used in this study are available at [54].
Supplementary material is available online [55].


