Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Sep 16;15(9):e0238250. doi: 10.1371/journal.pone.0238250

Testing models of reciprocal relations between social influence and integration in STEM across the college years

Paul R Hernandez 1,*, V Bede Agocha 2, Lauren M Carney 2, Mica Estrada 3, Sharon Y Lee 2, David Loomis 4, Michelle Williams 2, Crystal L Park 2
Editor: Frantisek Sudzina5
PMCID: PMC7494109  PMID: 32936827

Abstract

The present study tests predictions from the Tripartite Integration Model of Social Influences (TIMSI) concerning processes linking social interactions to social integration into science, technology, engineering, and mathematics (STEM) communities and careers. Students from historically overrepresented groups in STEM were followed from their senior year of high school through their senior year in college. Based on TIMSI, we hypothesized that interactions with social influence agents (operationalized as mentor network diversity, faculty mentor support, and research experiences) would promote both short- and long-term integration into STEM via social influence processes (operationalized as science self-efficacy, identity, and internalized community values). Moreover, we examined the previously untested hypothesis of reciprocal influences from early levels of social integration in STEM to future engagement with social influence agents. Results of a series of longitudinal structural equation model-based mediation analyses indicate that, in the short term, higher levels of faculty mentorship support and research engagement, and to a lesser degree more diverse mentor networks in college promote deeper integration into the STEM community through the development of science identity and science community values. Moreover, results indicate that, in the long term, earlier high levels of integration in STEM indirectly influences research engagement through the development of higher science identity. These results extend our understanding of the TIMSI framework and advance our understanding of the reciprocal nature of social influences that draw students into STEM careers.

Introduction

National attention has focused on the need to attract, retain, and adequately prepare a larger and more diverse science, technology, engineering, and mathematics (STEM) workforce to accelerate innovation and discovery, maintain global competitiveness, and expand economic prosperity [18]. Research on and projections of national trends indicate STEM-related occupations will grow at nearly twice the rate of non-STEM occupations, and most of these occupations will require post-secondary education and training [4, 7, 9, 10]. However, reports and research on national post-secondary STEM education attainment also point to a continuing shortfall due to such factors as student flight from STEM majors and college dropout–particularly in the first two years of college [3, 11, 12].

The rise of mentorship as an antidote to attrition

There is growing interest and research on the roles that mentors (and other socializing experiences, such as undergraduate research) play in supporting learning and degree attainment in college [1315]. There is ample cross-sectional and qualitative research on mentorship in college contexts; however, robust longitudinal or experimental data showing the impact of mentorship on student success and persistence is scant [1621]. For example, a number of cross-sectional correlational studies with undergraduate students in a variety of disciplines have examined quantitative or qualitative associations between mentorship support and (a) psychosocial variables (e.g., academic and social integration, depression and stress, motivation), (b) academic success, and (c) persistence in college [2237]. Overall, systematic reviews of the mentoring literature in college contexts indicate only modest associations between having a mentor in college and learning or persistence, and small-to-moderate associations between the specific types of mentorship support received (e.g., psychosocial-emotional support) and psychosocial outcomes (e.g., motivation) [38, 39].

Social psychology theoretical models–with their emphasis on person-by-situation interactions–are useful for describing and explaining the kinds of interactions that promote internal motivational processes that, in turn, promote learning or persistence in STEM [13, 20, 40]. Social psychology theories, such as Social Cognitive Career Theory (SCCT) [41], are increasingly used to better understand why, for whom, and under what circumstances mentorship influences outcomes in higher education [1520]. For example, SCCT, an extension of Social Cognitive Theory [42, 43], posits that prior performance attainment (e.g., prior success in a domain such as science), vicarious learning (e.g., inspiration or learning drawn from observing role models), social persuasion (e.g., realistic encouragement from a mentor), and emotional arousal (e.g., tension) are key determinants of self-efficacy (i.e., confidence in one’s ability to successfully execute specific tasks) and outcome expectations (i.e., one’s appraisal of the likely outcome of executing those tasks). And efficacy and outcome expectations, in turn, play a central in the development and pursuit of career interests and future performance attainments, and performance attainment then becomes a source for future efficacy and outcome expectation development [41]. A few scholars have used SCCT (and other social psychology theories) to test hypotheses concerning mentoring and persistence in STEM disciplines, particularly for students from historically underrepresented (HU) minority groups in STEM (e.g., racial minorities, women). In general, theoretically driven research in STEM contexts has found more consistent and somewhat larger associations between mentoring and STEM-related psychosocial or persistence outcomes than has been reported in studies of mentoring in more heterogeneous college contexts. For example, researchers using SCCT [41, 44] have found moderate positive associations between mentorship support and psychosocial outcomes (e.g., science self-efficacy), as well as small-to-moderate associations with intentions to persistence in STEM among HU college students (i.e., racial/ethnic minorities) [4548]. Similarly, researchers studying women pursuing STEM degrees have shown significant small-to-moderate positive associations between mentorship and a sense of belong, science identity, and intentions to persist in a scientific career [49, 50]. However, even theoretically driven research has not typically examined longitudinal associations linking mentoring, motivational mediators, and integration into STEM, nor has this research tested reciprocal relations or feedback loops.

Social influence model of attracting and retaining aspiring STEM professionals

The approach taken in the current study is to frame mentoring in STEM within a social influence model whereby the mentor takes the role of influencer and the undergraduate student is the subject of influence. This approach grows out of a body of research showing that social influence occurs continuously and across contexts [51], including educational settings where higher education students integrate or disengage from their disciplinary communities [52]. Theory and empirical research indicate that scientific community members (e.g., mentors) and relevant scientific training environments (e.g., research experiences) could operate as socializing or social influence agents [31, 5356]. Scientific mentors, in particular, may be powerful influencers because of their ability to confer or withhold valued rewards (such as grades, degrees, etc.), which are desirable to members of the community. Mentors also hold high relational value because they can provide access to both desirable social and material outcomes such as affiliation, support, resources, and more opportunities in life [57]. These attributes undoubtedly make mentors powerful influencers of their mentees, as they support students’ integration into their disciplinary community. What, however, does it mean to integrate into a social group or community?

Social influence and student integration

Herbert Kelman proposed and experimentally tested a social influence model, which predicted the conditions of socializing an individual into a new role or resocialization that moves individuals from old to new roles [5861]. Kelman’s Tripartite Integration Model of Social Influence (TIMSI) framework posits that persons and social contexts can operate as social influence agents. Influence agents integrate the targets of social influence into a social system by rewarding compliance with social norms (rule orientation), cuing the role by which the target-to-influence is identified (role orientation), and/or reinforcing how the groups’ values are consistent with the target of influence’s internalized values (values orientation). The result of successful influence is greater efficacy to engage in normative behaviors, stronger identification with the influencing agent’s group, and internalization of that group’s values. And the social influence processes (i.e., efficacy, identity, and internalized values), in turn, promote deeper integration into the community. Furthermore, Kelman readily acknowledged that the direction of influence could be reciprocal–particularly in long-term relationships, as opposed to experimentally manipulated brief social interactions between strangers [61]. That is, reciprocal social influence describes the process whereby individuals who desire to integrate more deeply into a social system engage in activities that further integrates them into the social system. An example of this reciprocal process in the STEM academic context would be when faculty mentorship and research experiences (that increase student science identity) leads to students’ persistence, and then those students with higher intentions reciprocally are more likely to engage in additional research experiences. In this way, students are not passive recipients of influence, but also active agents in seeking out further opportunities to be influenced.

Agent influence is mediated by social influence

Kelman’s theory, the TIMSI framework, has been useful to better understand how students integrate into their disciplinary communities [62]. A small but growing body of evidence demonstrates how TIMSI predictions concerning the relationships between social influence agents, social influence processes, and social integration among college students in STEM disciplines occur (see Fig 1; Social Influence Agents → Social Influence Processes → Social Integration). Several recent studies have investigated the effects of social influence agents, such as mentors, on social influence processes and down-stream social integration in STEM contexts. For example, the most comprehensive test of TIMSI predictions tracked the effects of faculty mentorship quality and the number of semesters engaged in research experiences in college on changes in science self-efficacy, identity, and values, as well as distally measured engagement in or dropout from STEM disciplines over a six-year period (junior year of college through four years post-baccalaureate attainment) in a national sample of HU undergraduate STEM majors [63]. These researchers operationalized Kelman’s model by measuring the social influence processes in terms of science self-efficacy, science identity, the endorsement of science community values, and post-baccalaureate persistence in a scientific career (social integration). The study revealed that (a) higher levels of faculty mentorship quality and higher engagement in research experiences were associated with higher levels of scientific self-efficacy, scientific identity, and scientific community values, (b) higher levels of scientific identity were associated with a higher probability of persistence in a STEM career after completing an undergraduate degree, and (c) mentoring and research experiences had a positive indirect effect on post-baccalaureate STEM career choices through the development of science identity as an undergraduate.

Fig 1. Conceptual model of the Tripartite Integration Model of Social Influences (TIMSI).

Fig 1

Solid-line arrows represent theorized influence from influence agents on socialization or resocialization through influence orientations. Dashed-line arrows represent theoretically plausible reciprocal feedback loops.

Additional studies have examined TIMSI predictions in a more limited fashion, testing TIMSI predictions concerning the relationships between social influence agents, social influence processes, and social integration among college students over a shorter period of time (e.g., a 10-week summer research experience), or focusing more narrowly on TIMSI predictions concerning the relationships between social influence processes and social integration (Social Influence Processes → Social Integration) [62, 64, 65]. The results from these more limited studies provide convergent evidence indicating higher levels of mentorship support lead to higher levels of the efficacy, identity, and values (i.e., social influence processes) and higher levels of social influence processes, particularly science identity, lead to higher levels of persistence [62, 64, 65].

Limitations of the extant research

Although emerging evidence for the TIMSI framework is promising, key aspects of the model have yet to be rigorously tested. First, studies have not examined the degree to which TIMSI operates similarly (or differently) for identifiable demographic subgroups in STEM. To date, the most robust longitudinal evidence for TIMSI was derived from a national sample of HU racial/ethnic minority students in STEM. Less is known about the longitudinal TIMSI process for students from HO groups in STEM, or for men versus women in STEM. Second, the model has not been tested across a variety of critical time points in the academic career. For example, longitudinal mediation studies have primarily focused on students in the final two years of college and have only examined the indirect effects of social influence agents on integration through social influence processes [63, 65]. National trends indicate that most departures from STEM majors occur during the first two years of college. Thus, testing TIMSI predictions at earlier points in college may reveal theoretically meaningful shifts in the processes by which students integrate into STEM majors and career tracks.

Third, prior tests of the TIMSI prediction linking mentoring to social influence processes and integration operationalized mentoring as the level of support received from a single (typically faculty) mentor. However, advances in mentorship theory have postulated that developing a diversified network of mentors (i.e., diversity in roles [faculty, post baccalaureate, more advanced undergraduate, peer]) can provide mentees with more comprehensive support for their learning and career development [15, 6672]. Mentor network theory suggests individuals benefit from having a diversified network because they are able to rely on the specific strengths of individual mentors serving in a specific supportive role rather than relying on a single mentor providing support across multiple roles. Although there is scant longitudinal evidence for the theorized link between mentor network characteristics and social influence processes, cross-sectional research indicates that undergraduate STEM majors with larger and more diverse networks of scientific mentors report higher levels of scientific self-efficacy and identity [66, 67, 73]. Thus, testing TIMSI predictions where mentorship is operationalized in terms of both the quality of support from a faculty mentor and mentor network diversity may reveal theoretically important information about the kinds of support that lead to social influence.

Fourth, although the TIMSI framework posits the potential for reciprocal influence over longer periods of time (as opposed to short-term manipulated experiences), no research has yet examined the theoretically plausible reciprocal mediated effects of social integration on future engagement with social influence agents through the social influence process (see dashed lines in Fig 1; Social Integration → Social Influence Processes → Social Influence Agents). For example, students who feel more socially integrated may more actively seek out mentors, grow their mentor networks, and pursue professional development experiences that in turn deepen their social integration. In this way, there could be a self-perpetuating cycle that deepens students’ integration into the scientific community.

Current study

The current study tests predictions from the TIMSI framework in the context of college students pursuing a STEM degree and addresses several limitations in the extant literature. In a longitudinal study of college students in STEM disciplines, we hypothesized that the level of faculty mentor support, diversified college-related mentor networks, and research experiences in college would positively influence the development of science self-efficacy, science identity, and the internalization of science community values. Further, we expected that science self-efficacy, identity, and values would, in turn, promote scientific career persistence intentions (i.e., integration into the scientific community).

The present study also strategically extends the extant literature and theory. First, much of the longitudinal research on the TIMSI framework tested predictions among HU students in STEM [62, 63]. The present study focuses on the experiences of HO undergraduates in STEM majors to better understand and test TIMSI hypotheses. That is, prior longitudinal research excluded HO students and the present study is an opportunity to describe the socialization experiences of these students. In addition, the present study draws on data from a larger study that included a relatively small number of HU students in STEM. Given the relatively small numbers HU STEM students and our focus on longitudinal analyses in a structural equation modeling framework (more details provided below), we were unable to estimate models of HU-HO group differences (i.e., tests of measurement invariance and multiple groups SEM were not possible). Thus, the present study has the potential to identify subgroup similarities or differences in the patterns of results based on majority status in comparison to prior studies (but not as a direct comparison within the present study).

Second, longitudinal research on the TIMSI framework has primarily focused on students in the last two years of college (i.e., junior and senior years) or in graduate school [62, 63, 65]. The current study, by contrast, follows students from the spring semester prior to college (i.e., rising first year college students) through the spring semester of their fourth year of college (i.e., senior year). Thus, the present study has the potential to identify developmental changes or equilibrium as students matriculate from high school throughout their undergraduate tenure. Third, prior longitudinal research primarily focused on the influence faculty mentors have on their undergraduate mentee’s integration into STEM. The present study was designed to address the unique influence of faculty mentorship quality and mentor network diversity on student integration into STEM.

Fourth, to date longitudinal tests of the TIMSI framework have only focused on the process by which social influence agents impact future integration into STEM [62, 63, 65], ignoring the theoretically plausible reciprocal influence of social integration on future engagement with influence agents. Notably, it may be unreasonable to ignore reciprocal effects when investigating causal ordering or longitudinal mediation processes that involve humans interacting in a social environment [7476]. Given that research findings in social psychology documenting how reciprocity contributes significantly to the forming and maintaining of a variety of social relationships [77], it is reasonable to hypothesize that mentees and mentors exist in relationship to each other, with reciprocal influences occurring [20]. To test this notion, the present longitudinal mediation study simultaneously examined the process by which social influence agents affect present and future social integration into STEM, as well as the reciprocal process by which social integration in STEM affects future engagement with social influence agents. However, investigations of longitudinal mediation (or causal ordering) with contemporaneous and reciprocal effects involve relatively complex models with many potential paths of direct and indirect influence. A primary goal in these types of longitudinal studies is to first identify the simplest model that provides adequate fit to the data before examining mediated effects. Best practices in longitudinal causal ordering research suggest that investigations compare an a priori complex model that allows all possible forward pathways to a set of a priori successively simpler or more constrained models [7476, 78, 79]. Consistent with best practices, we adopted this model comparison approach and conducted a series of eight nested SEMs to systematically test for longitudinal, contemporaneous, and reciprocal relations among the outcomes, mediators, and predictors in our model (see supplemental materials for a complete discussion of Models 1–8; S1 and S2 Figs).

In summary, the present study addresses three research questions to test predictions from and extend knowledge about the TIMSI framework in the context of STEM education. First, do social influence processes mediate the effect of social influence agents on social integration into STEM over an undergraduates’ tenure in college? Second, do social influence processes mediate the effect of social integration in STEM on future engagement with social influence agents over the undergraduates’ tenure in college? Third, do the mediated effects operate longitudinally, contemporaneously, or both?

Materials and methods

Participants

All study procedures were approved by the University of Connecticut institutional review board (#H14-213WVU). Written informed consent was obtained from all study participants. The current study was drawn from a larger longitudinal study (N = 1,839) of student development in the graduating class of 2019 at a research-intensive (i.e., Carnegie classification of “very high research activity”), four-year public land-grant university located in the northeastern U.S. The larger study focused on the development cognitive, emotional, and behavioral self-regulation among all students (regardless of major) over the college tenure. However, students in non-STEM majors were not asked questions about their scientific persistence intentions (the primary outcome of this study) in an effort to reduce fatigue and mitigate potential reactivity to irrelevant survey questions. Historical enrollment data at the university indicate that university undergraduates are 51% female and 49% male, 56% White, 11% Asian, 11% Hispanic, 10% foreign nationals, 6% Black, 3% multi-racial, and 3% undeclared race/ethnicity [80]. Prior research in the larger longitudinal study indicated that study participants largely mirrored the demographics of the university, with the exception of somewhat smaller proportion of students who chose not to declare their race, African American students, and Hispanic students [81]. However, the present study focuses on a subsample of the larger sample, that is, HO students in STEM majors.

The analytic sample for the present study consists of 751 first-year HO students that declared a STEM major over their college tenure. STEM majors included those related to science (i.e., agricultural, biological/life, physical), technology (e.g., computer science), engineering, mathematics (e.g., actuarial, mathematics, statistics), and pre-professional medicine (e.g., pre-pharmacology, nursing, nutrition science). As noted above, only students that self-identified as being in a STEM major were asked questions about their intention to persist in a scientific career. Of the larger sample, 589 were excluded from analyses, because they were non-STEM majors, 243 were non-first-year students (e.g., transfer), 162 were from HU groups or did not respond to demographic questions, 56 did not respond to the surveys after giving consent, and 38 were excluded due to academic dismissal from the university.

At the time of recruitment, in the spring and summer prior to the first-year of college, 58% of the analytic sample (N = 751) self-identified as female and 42% as male (Table 1). For race and ethnicity, 76% of the majority students in the analytic sample self-identified as White and 24% as Asian (Table 1). Concerning family background, 22% of the sample that responded to the parental education questions (n = 572 of 751) indicated that they were first-generation in their family to attend college (i.e., reported that neither their mother nor father had earned a baccalaureate degree or higher), and the average family annual household income was between $75,000-$100,000 per year (Table 1). Finally, with respect to performance, according to university administrative records the average first-semester of college cumulative grade point average was 3.24 on a 4.0 scale (Table 1).

Table 1. Summary of sample descriptive statistics.

Variables Time N M SD Skew Kurtosis
Female (0 = male, 1 = female) T1 751 0.58 0.49 -0.30 -1.90
First-generation (0 = not, 1 = First Gen.) T1 572 0.22 0.42 1.34 -0.20
Family income T1 583 4.66 1.82 -0.18 -0.36
First semester cumulative GPA Fall Year 1 723 3.28 0.63 -1.28 2.01
STEM Career Persistence Intentions T1 613 7.95 1.78 -1.09 0.71
STEM Career Persistence Intentions T2 463 7.55 1.95 -0.95 0.81
STEM Career Persistence Intentions T2 548 7.62 1.97 -0.99 0.65
STEM Career Persistence Intentions T3 548 8.09 1.97 -0.85 0.27
STEM Career Persistence Intentions T4 463 7.60 2.02 -0.78 -0.08
Science Self-Efficacy T1 618 3.85 0.64 -0.34 0.24
Science Self-Efficacy T2 463 3.69 0.80 -0.26 -0.10
Science Self-Efficacy T3 548 3.73 0.74 -0.36 0.37
Science Self-Efficacy T4 549 3.78 0.73 -0.30 0.13
Science Self-Efficacy T5 463 3.87 0.77 -0.59 0.55
Science Identity T1 617 3.67 0.87 -0.59 0.15
Science Identity T2 462 3.58 0.85 -0.29 0.09
Science Identity T3 547 3.67 0.87 -0.48 -0.04
Science Identity T4 549 3.62 0.90 -0.30 -0.43
Science Identity T5 462 3.62 0.93 -0.50 -0.24
Scientific Community Values T1 613 5.08 0.94 -1.33 1.71
Scientific Community Values T2 460 4.89 0.99 -0.97 0.95
Scientific Community Values T3 548 4.98 0.95 -1.09 1.22
Scientific Community Values T4 548 4.24 0.65 -1.19 2.80
Scientific Community Values T5 462 4.13 0.75 -1.04 0.93
Faculty Mentorship Support T2 136 3.36 0.76 -0.03 0.25
Faculty Mentorship Support T3 224 3.47 0.69 -0.32 1.05
Faculty Mentorship Support T4 242 3.55 0.69 -0.25 0.79
Faculty Mentorship Support T5 256 3.64 0.75 -0.43 0.30
Mentor Network Diversity T1 619 2.74 1.88 0.21 -0.63
Mentor Network Diversity T2 516 1.48 1.39 0.98 0.42
Mentor Network Diversity T3 614 1.67 1.48 0.62 -0.44
Mentor Network Diversity T4 613 1.85 1.59 0.53 -0.65
Mentor Network Diversity T5 549 1.93 1.63 0.52 -0.72
Research Experiences T2 475 0.72 1.15 2.52 8.75
Research Experiences T3 568 1.15 1.44 1.66 3.10
Research Experiences T4 569 1.53 1.74 1.46 2.31
Research Experiences T5 549 1.85 1.99 1.04 0.35

M = mean. N = sample size (cases with complete data for a given variable). SD = standard deviation. T1 = pre-college, T2 = spring 1st year of college, T3 = spring 2nd year of college, T4 = fall 3rd year of college, T5 = spring 4th year of college. Concerning race/ethnicity, n = 177 self-identified as Asian and n = 574 self-identified as White; Family income was an ordinal variable coded 1 = <$30k, 2 = $30k-50k, 3 = <$50k-$75k, 4 = $75k-$100k, 5 = $100k-$150k, 6 = $150k-$200k, 7 = $200k-$250k, 8 = >$250k.

Procedure

The incoming cohort of students accepted for fall 2015 admissions to the university was recruited to participate in this study. Study recruitment involved (a) a study flyer included in the official university orientation materials emailed to students in the spring prior to college, (b) announcements during university orientation sessions in the summer prior to college, and (c) email invitations and reminders sent to students accepted to the university. In the spring and summer of 2015 (i.e., prior to the first-year of college), participants completed an informed consent form, as well as a two-part online survey, which included the ACT ENGAGE survey (i.e., a self-report assessment typically used by colleges to help identify students at risk of academic struggles in college) and a custom-designed research survey administered in Qualtrics.

As part of the longitudinal design, participants completed follow-up online surveys each semester, and university administrative data were gathered to track student progress toward degree attainment (e.g., academic standing, declared major, courses taken, grade point average). Participants received nominal compensation ($20) for completing each survey.

Measures

All scales and checklists were administered via self-report in online surveys. All reliability estimates and psychometric tests (e.g., CFAs, tests of measurement invariance) are included in the supplemental materials and S1 and S2 Tables. Unless otherwise noted, scales were administered on five occasions from high school through the fourth year of college (a) T1 is spring and summer prior to college (2015), (b) T2 is spring first year of college, (c) T3 is spring second year of college, (d) T4 is fall third year of college, and (e) T5 is spring fourth year of college.

Scientific career persistence intentions

The primary social integration outcome, scientific persistence intention, was measured using a three-item scale [82]. Participants read the following items: “To what extent do you plan to pursue a science-related research career?,” “What is the likelihood of you obtaining a science-related degree?,” and “What is the likelihood of you applying to graduate school?” Participants rated the strength of their intentions on a scale from 0 (definitely will not) to 10 (definitely will). Persistence intentions scale scores were derived as the average of the items, with higher scores indicating stronger intentions. Prior validation research indicates that this measure, and similar measures of persistence intentions, are related to STEM persistence behaviors (e.g., applications to STEM-related graduate programs, post baccalaureate STEM career choices) [62, 82]. In addition, the current study found evidence of acceptable psychometric properties (e.g., longitudinal invariance and reliability), see supplemental materials.

Scientific self-efficacy

This six-item scale measured participants’ confidence in their ability to complete a variety of scientific tasks (e.g., “Use technical science skills [use of tools, instruments, and/or techniques]”) [46]. Participants rated their confidence on a scale from 1 (not at all confident) to 5 (absolutely confident). Self-efficacy scale scores were derived as the average of the six items, with higher scores indicating higher scientific self-efficacy. Prior validation evidence indicates that this measure of self-efficacy, as well as other similar measures of self-efficacy, are related to both mentoring supports and persistence in STEM [13, 46, 63]. In addition, the current study found evidence of acceptable psychometric properties (e.g., longitudinal invariance and reliability), see supplemental materials.

Scientific identity

This five-item scale measured the degree to which participants think of themselves as a scientist (e.g., “I have come to think of myself as a scientist.”) [46]. Participants rated agreement with each statement on a scale from 1 (strongly disagree) to 5 (strongly agree). Identity scale scores were derived as the average of the five items, with higher scores indicating higher scientific identity. Prior validation evidence indicates that this measure of identity, as well as other measures of identity, are related to both mentoring supports and persistence in STEM [13, 46, 63]. In addition, the current study found evidence of acceptable psychometric properties (e.g., longitudinal invariance and reliability), see supplemental materials.

Internalization of scientific community values

This four-item scale measured level of internalization of scientific community values [62]. Participants read descriptions of a person and rated “how much the person in the description is like you” (e.g., “A person who thinks discussing new theories and ideas between scientists is important.”). Participants rated the degree to which each statement was like themselves on a scale from 1 (not at all like me) to 6 (very much like me). Values scale scores were derived as the average of the four items, with higher scores indicating higher internalization of scientific community values. Prior validation evidence indicates that this measure of identity is related to both mentoring supports and persistence in STEM [63, 65]. In addition, the current study found evidence of acceptable psychometric properties (e.g., longitudinal invariance and reliability), see supplemental materials.

Mentor network diversity index

Participants were instructed to think of a mentor as someone “who provides guidance, assistance, and encouragement on professional and academic issues. A mentor is more than an academic advisor and is someone you turn to for guidance and assistance beyond selecting classes or meeting academic requirements” [50]. On the pre-college survey, participants indicated (yes = 1 or no = 0) if people in any of the following roles served as a mentor in their lives (a) teachers, (b) guidance counselors, (c) program staff members, (d) graduate students, (e) peers, (f) professionals outside of the school setting, (g) family members/relatives, or (h) others. On the college surveys, a similar set of questions was administered; however, these questions focused on potential mentors within the college context. Specifically, participants indicated if people in any of the following roles served as a mentor in their lives (a) university faculty, (b) guidance counselors, (c) program staff members, (d) graduate students, or (e) peers. The mentor network diversity index scores were derived as the sum of the items, with higher scores indicating larger and more diverse mentor networks. Prior validation evidence indicates that measures of mentor network are related to developing deeper interest in STEM [50].

Global measure of faculty mentoring practices

Only students who indicated that they had a university faculty mentor were asked follow-up mentoring practices questions about their faculty mentor. This 16-item scale measured the degree to which the faculty mentor provided instrumental and psychosocial support in a global fashion over the last six months (e.g., “To what extent has your mentor conveyed feelings of respect for you?”) [83, 84]. Participants rated the degree of support received on a scale from 1 (not at all) to 5 (to a large extent). Faculty mentoring support scale scores were derived as the average of the 16 items, with higher scores indicating higher levels of mentoring support. This scale was administered on four occasions from the first through the fourth years of college (i.e., T2-T5). Prior validation evidence indicates that this measure of the mentoring practices is related to the development of scientific identity, science values, and persistence-related activities, such as scholarly productivity [63, 65, 84]. In addition, the current study found evidence of acceptable psychometric properties (i.e., reliability), see supplemental materials.

Research experiences index

This 10-item index asked participants to report on their level of involvement in research experiences [85]. Participants indicated their involvement (yes = 1 or no = 0) in a variety of research activities over the prior year (e.g., hands-on research in a class, research in a laboratory or on a research team outside of class, presented original research at a national or regional conference). Research experience index scores were derived as the sum of the items, with higher scores indicating more research experiences. This checklist was administered on four occasions from the first through the fourth years of college (i.e., T2-T5). Prior validation evidence indicates that this, and other measures of research engagement, are related to the development of scientific self-efficacy, identity, values, and persistence in STEM [63, 85, 86].

Plan of analysis and preliminary analyses

Assessment of model fit in SEM

All longitudinal analyses were conducted in a structural equation modeling (SEM) framework using Mplus version 8.00 [87]. The adequacy of model-data fit in SEM analyses was assessed with a variety of global fit indices, such as the χ2 test, root-mean-square error of approximation (RMSEA), comparative fit index (CFI), and standardized root-mean-square residual (SRMR) [8891]. The observed fit index values compared to values representing acceptable model fit, such as CFI ≥ .95, RMSEA ≤ .05 (or a 90% CI that included .05 but did not include .10), or SRMR ≤ .08. In addition, when nested models were compared, the cutoff value of ΔCFI values ≥ .01 or ΔRMSEA values ≤ -.015 indicated worse model fit [92].

Consistent with recommendations for controlling Type-I error rate inflation in complex or exploratory SEMs, we used the Benjamini-Hochberg False Discovery Rate (FDR) procedure when evaluating the statistical significance of structural coefficients in the final substantive model (i.e., Model-8) [9395].

Statistical assumption checking

Prior to substantive analyses, two sets of preliminary analyses were conducted. First, we examined the patterns of missing data, screened for outliers, and tested the statistical assumptions related to distributions. Response rates to the survey varied across occasions (Table 1). The response rate among the 751 STEM students in this study was 82.3% at T1, 68.7% at T2, 81.8% at T3, 81.6% at T4 and 73.1% at T5. Furthermore, 33.1% of STEM students completed all five surveys (i.e., 100% completion rate across all waves of data collection), 25.2% of the STEM students completed four out of five surveys (i.e., 80% completion rate), 15.5% of the STEM students completed three out of five surveys (i.e., 60% completion rate), 12.6% of the STEM students completed two out of five surveys (i.e., 40% completion rate), and 13.7% of the STEM students completed only one out of five surveys (i.e., 20% completion rate). Little’s MCAR test [96] revealed that the data were not missing completely at random χ2(6,370) = 6,860.51, p < .001. Therefore, full information maximum likelihood (FIML) estimation methods were used, as FIML estimation has been shown to ensure unbiased estimates under the more reasonable missing-at-random (MAR), even when the percent of missing data is large [97]. That is, MAR allows missing data when they are conditioned on observed data used in the analysis [98]. Recent research has argued that longitudinal panel studies, such as this one, are highly unlikely to violate the MAR assumption because missing data on each variable can be conditioned on the data from the same variable collected on prior waves [99]. This approach has been shown to be adequately address missing data in large longitudinal studies, such as the current investigation [100]. In addition to missing data analyses, outlier analyses (using leverage values, Studentized deleted residuals, and Cook’s distance values) and distributional assumptions (i.e., normality of residuals, homoscedasticity of residuals, and linearity) were conducted [101]. The analyses revealed no extreme outliers and confirmed the tenability of distributional assumptions.

Longitudinal and cross-group measurement invariance CFA models

The second set of preliminary analyses focused on the assumption of longitudinal measurement invariance for our outcome and social influence process (mediating) variables [89]. Unfortunately, it was not possible to estimate the measurement invariance of the global measure of faculty mentoring practices in the present study due to the relatively small sample size of college students that reported having a mentor at any given time point across their college tenure. That is, the number of parameter estimates for CFA models of the global measure of faculty mentoring practices vastly exceeded the number of participants with a faculty mentor, which resulted in models that did not converge. For all other latent constructs of interest consistent with best practices, individual tests of longitudinal measurement invariance for the outcome and mediators were conducted separately for men and women [89]. Furthermore, we tested multiple-groups measurement invariance (men, women) for the outcome and mediators at each time point. Maximum likelihood estimation with robust standard errors were used in CFA models to account for non-normality in the item-level data, while ML estimation was used with scale scores which were more consistent with distributional assumptions.

Consistent with expectations, the results of the CFA models indicated acceptable model-data fit for tests of longitudinal measurement invariance within groups (S2 Table). Furthermore, tests of cross-group (men, women) measurement invariance indicated acceptable data-model fit at each time point (S2 Table), with the exception that model fit was slightly below the cutoff levels at T2 (i.e., first-year of college). An examination of the standardized residual covariances indicated stronger than typical relationships between scientific persistence intentions (i.e., indicators-1, intention to pursue a scientific research career) with science values (i.e., indicators-4, “scientific research can solve many of today’s world challenges”) for both men and women in the first-year of college. This pattern did not repeat at any other time-points and thus we proceeded with analysis. As a final assessment of cross-group invariance, we compared the fit of models that held correlations among latent factors to be invariant for men and women at each time point. Fit indices indicated that model fit was not worsened by constraining correlations to be equivalent across groups (S2 Table). Therefore, the gender groups were combined for all substantive analyses.

Results

Prior to formally testing mediation models in SEM, as noted above, we tested and confirmed (a) longitudinal measurement invariance, (b) cross-gender measurement invariance, and (c) cross-gender invariance in the pattern and magnitude of correlations among constructs at each time-point. Having found no evidence of moderation due to gender status, the gender was not considered further in any of the statistical analyses. Next, we examined the descriptive statistics and pattern of correlations among the social influence factors, social influence processes, and social integration (i.e., persistence intentions) at each time point (Table 1 and S1 Table). Consistent with expectations from TIMSI, faculty mentorship, mentor network diversity, and research experiences exhibited small-to-moderate positive correlations (i.e., r’s .10-.30) with science efficacy, science identity, science community values, and scientific career persistence intentions over time (S1 Table). Furthermore, science efficacy, science identity, and science community values exhibited moderate positive correlations with scientific career persistence intentions (i.e., r’s .25-.60; S1 Table).

Longitudinal SEMs

Having found correlations that were consistent with our expectations, we next conducted a set of preliminary analyses concerned with identifying the most parsimonious and best fitting longitudinal SEM (see supplemental materials for a complete discussion of Models 1–8; S1 and S2 Figs). As shown in Fig 2, the series of tests of eight nested SEMs revealed that the longitudinal model that provided maximum parsimony without sacrificing good model-data fit included (a) freely estimated first- and higher-order relations within each construct (i.e., stability paths), (b) first-order cross-lagged relationships across constructs (i.e., cross-lagged paths), (c) relationships across constructs within each time point (i.e., contemporaneous paths), (d) cross-lagged developmental equilibrium constraints (holding cross-lagged paths equal across time), and (e) contemporaneous equilibrium constraints (holding contemporaneous paths equal across time; see Fig 2; for complete details of nested model comparisons see the supplemental materials and S3 Table). For example, Fig 2 shows cross-lagged developmental equilibrium in that paths from the influence agents (i.e., Xs) to the social influence processes (i.e., Ms) are constant over time (i.e., paths are denoted with the symbol “f” to show that these coefficients held constant from T1→T2, T2→T3, etc…). Similar notation was used in Fig 2 to denote all aspects of cross-lagged developmental (i.e., paths labeled a-f), as well as, contemporaneous equilibrium (i.e., paths labeled g-i).

Fig 2. Three time point conceptual representation of the final simplified longitudinal model with cross-lagged and contemporaneous equilibrium constraints (Model-8).

Fig 2

Y = outcome (i.e., scientific career persistence intentions [indicator of integration]), Mj = mediators (i.e., science self-efficacy, science identity, and science community values [indicators of social influence processes]), Xk = contextual factors (i.e., faculty mentor support, mentor network diversity, research experiences [indicators of social influence agents]). Stability paths shown as solid lines, first-order longitudinal cross-lagged paths shown as dashed lines, and contemporaneous mediation paths from the contextual factors to the outcome are shown as dotted lines. Subscripts 1 = T1 spring/summer prior to college, 2 = T2 spring first year of college, 3 = T3 spring second year of college, but T4 fall third year of college, and T5 spring fourth year of college are not shown for the sake of parsimony.

Social influence operates contemporaneously and reciprocal influence operates longitudinally

Next, we inspected the parameter estimates from Model-8 to address research questions concerning the mediated pathways linking the social influence agents to persistence intentions, as well as reciprocal influence. The contemporaneous paths linking social influence agents to persistence intentions through the social influence process were consistent with our expectations (paths coefficients are represented in the lower section of Table 2 and are also shown in diagram form in S3 Fig. as paths under the “T5 (4th Year of College);” S3 Fig. shows a graphical representation of the statistically significant standardized coefficients in Table 2). More specifically, mentor network diversity, faculty mentor support, and research experiences exhibited small-to-moderate positive predictive relationships with science self-efficacy and science identity. For example, the standardized path coefficient linking faculty mentor support with science identity was in the small-to-moderate range (i.e., β = .12) and the standardized coefficient linking mentor network diversity to science identity was very small (i.e., β = .06). Furthermore, mentor network diversity and faculty mentor support showed small-to-moderate positively predictive relationships with science community values (Table 2). In general, the quality of faculty mentor support was the strongest predictor, as evidenced by having relatively larger standardized coefficients. Regarding the information presented in Table 2, given that (a) our research questions concern cross-lagged and contemporaneous paths and (b) Model-8 constrains cross-lagged and contemporaneous coefficients to be invariant across time, Table 2 presents only one example time-lag (third to fourth year of college). The relevant coefficients do not change across time and thus one time-lag is representative of all other time-lags. However, all time-lags (High school through fourth year of college) are shown in S1 and S4 Tables.

Table 2. Trimmed summary of the standardized coefficient from the final model highlighting reciprocal social influence from the third to fourth year of college (Model 8, N = 751).

T5 4th Year of College Outcomes
Outcome Social Influence Processes Social Influence Agents
Time Predictors Persistence Intentions Science Efficacy Science Identity Science Values Mentor Network Diversity Faculty Mentor Support Research Experiences
T4 3rd year of college Persistence Intentionsa .36*** .07** .13*** .08*** .03 -.02 .07***
Science Efficacyb -.08*** .26*** -.02 .06 -.03
Science Identityb -.13*** .23*** .05 -.05 .10***
Science Valuesb -.04* .11 -.01 .04 .01
Mentor Network Diversityc .02 -.06* -.03 -.04 .36***
Faculty Mentor Supportc .05 -.03 -.03 -.05 .35***
Research Experiencesc .004 -.02 -.06 -.03 .46***
T5 4th year of college (Contemporaneous) Science Efficacyb .05*
Science Identityb .33***
Science Valuesb .17***
Mentor Network Diversityc .01 .07** .06** .06**
Faculty Mentor Supportc -.01 .15*** .12*** .12**
Research Experiencesc .05 .08** .12*** .06
R2 .58 .34 .43 .21 .28 .20 .37

a = outcome

b = social influence processes

c = social influence agents. T4 = fall 3rd year of college, T5 = spring 4th year of college. All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients; coefficients in standard text associated with predictors from the prior year in college are first-order cross-lagged coefficients, and coefficients associated with predictors from the current year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 are reported statistically significant.

*p≤.023

**p≤.01

***p≤.001.

Next we examined the paths linking the social influence processes (i.e., science self-efficacy, science identity, and science community values) to contemporaneously measured persistence intentions and found that they exhibited small-to-moderate positive predictive relationships with scientific career persistence intentions (Table 2, paths coefficients are represented in the lower section). For example, the standardized path coefficient linking science identity with persistence intentions was moderate in size (i.e., β = .33) and the standardized coefficient linking science efficacy to persistence intentions was very small (i.e., β = .05). In general, science identity was the strongest predictor, followed by science values, followed by science efficacy. Table 2, which only shows the T3 → T4, is used for illustration purposes because the effects were constrained to be consistent over time in the cross-lagged model.

Next we examined the longitudinal paths linking prior engagement with influence agents with future levels of social influence processes and social integration, as well as longitudinal reciprocal relationships. Inconsistent with expectations, the longitudinal cross-lagged paths linking prior engagement with social influence agents to future persistence intentions through the social influence processes were all negative in sign (Table 2). By contrast, bivariate correlations of cross-lagged associations were positive in sign (S1 Table). For example, the standardized path coefficient linking prior science identity with future persistence intentions was small-to-moderate and negative (i.e., β = -.13); however, the bivariate correlations between prior science identity and future persistence intentions were moderate and positive (i.e., rs range from .41-.43, see S1 Table). Thus, we interpret the negative sign of the cross-lagged coefficients under Model-8 as indicating a “classical” suppression effect due to multiple mediators and contemporaneous mediated effects [74, 102]. Therefore, engagement with social influence agents appears to be operating through contemporaneous, rather than cross-lagged processes. For example, T4 mentoring and research experiences only influence T5 science efficacy, identity, values, and persistence intentions through the effects on their T4 counterparts (i.e., through their respective stability paths).

Next, we examined the reciprocal paths linking prior persistence intentions to future engagement with social influence agents through the social influence processes. The results indicated that (a) prior scientific persistence intentions exhibited small-to-moderate positive influence on future science efficacy, identity, community values, and engagement in research experiences, and (b) prior science identity exhibited small-to-moderate positive influence on future research experiences (Table 2; presented in the top of the table and also shown in diagram form in S3 Fig. as paths linking “T4 (3rd Year of College)” to “T5 (4th Year of College)”). For example, the standardized path coefficient linking prior science career persistence intentions with future science identity was small-to-moderate (i.e., β = .13), the path linking prior science career persistence intentions with future science efficacy was very small (i.e., β = .07), and the path linking prior science identity with engagement in undergraduate research was small (i.e., β = .10). Therefore, early levels of social integration (scientific persistence intentions) exhibit reciprocal direct and indirect effects on future engagement with social influence agents.

Mediation

A bootstrapping procedure with 20,000 repetitions was used to estimate percentile-based confidence intervals around the contemporaneous and reciprocal mediated effects [103]. Since the contemporaneous coefficients did not vary over time due to contemporaneous equilibrium, we report the mediated effects for a single time point (i.e., T5 or fourth year of college; Fig 3). As shown in Fig 3, the analysis revealed small, positive, statistically significant contemporaneous mediated effects for all of the social influence agents on persistence intentions through science identity and/or science community values. More specifically, we found that faculty mentor support exhibited the largest indirect effect on scientific career persistence intentions through science identity (i.e., βa×b = .04), followed by research experiences and mentor network diversity through identity. Relatively smaller positive indirect effects were observed for indirect effects through scientific community values.

Fig 3. Contemporaneous mediated paths linking social influence agents to intentions through the social influence processes at T5 (Model-8).

Fig 3

T5 = spring 4th year of college. Only one model is shown since the contemporaneous mediation was invariant across the first, second, and third years of college. The full SEM is not shown for the sake of parsimony. All coefficients are standardized (STDXY). Confidence intervals were estimated using percentile bootstrapping method. *p ≤.023, **p≤.01 ***p≤.001.

Finally, we examined reciprocal longitudinal mediation. Since the cross-lagged coefficients did not vary over time due to developmental equilibrium, we report the mediated effects for a single two-year time-lag (i.e., T3 →T4 →T5 or 2nd through 4th years of college). As shown in Fig 4, the analysis revealed small, positive, longitudinal reciprocal mediated effects of T3 scientific persistence intentions on T5 engagement in research experiences through T4 science identity.

Fig 4. Reciprocal longitudinal mediated paths linking early intentions to later engagement with influence agents through science identity (Model-8).

Fig 4

All coefficients are standardized (STDXY). The full SEM is not shown for the sake of parsimony. Confidence intervals were estimated using percentile bootstrapping method. Subscripts T3 = spring second year of college 2017, T4 = fall third year of college 2017, T5 = spring fourth year of college 2018. *p ≤.023, **p≤.01 ***p≤.001.

Discussion

Social influence leads to short-term student integration

The TIMSI framework posits that persons and social contexts can operate as social influence agents. Influence agents integrate the targets of social influence into a social system by rewarding compliance with social norms (or sanctioning non-compliance), cuing the role by which the target to influence is identified, and/or reinforcing how the groups’ values are consistent with the target of influence’s internalized values. The result of successful influence is greater efficacy to engage in normative behaviors, stronger identification with the group of the influencing agent, and internalization of that group’s values. Partially consistent with TIMSI predictions (Fig 1 solid lines Social Influence Agents → Social Influence Processes → Social Integration), we found that among students from HO group in STEM higher levels of engagement with influencing agents of the scientific academic community (operationalized as quality of faculty mentor support, mentor network diversity, and undergraduate research experiences) predicted higher levels of social influence processes (operationalized as science self-efficacy, identity, and internalization of community values). Science efficacy, identity, and values, in turn, predicted higher levels of social integration (operationalized as persistence intentions). Furthermore, although the pattern of predictive associations was consistent with those hypothesized from TIMSI, not all variables were found to be equally predictive (i.e., mentor network diversity and science efficacy exhibited very small effects).

These findings are consistent with prior research showing moderate positive associations between the quality of faculty mentorship and psychosocial outcomes, but weaker positive associations with persistence-related outcomes [4547, 63, 104]. Taken together, the current and previous findings indicate that faculty mentors exert influence and draw their mentees into their disciplinary community by helping them to see themselves as belonging in the community, by internalizing community values, and to a lesser extent, seeing themselves as competent. The present findings reaffirm the unique and influential role that faculty mentors can play in drawing students into the STEM community. However, high quality faculty mentorship can be a relatively scarce commodity in higher education. Accordingly, our parallel findings concerning research experiences suggest potentially more scalable ways to support students interested in STEM careers.

The present findings are partially consistent with theory and empirical evidence on the direct and indirect impacts of undergraduate research experiences on integration into the scientific community [52, 56, 62, 63, 85, 105110]. That is, our study found that research experiences indirectly support persistence through the development of science identity and internalization of community values; however, these indirect effects only manifested contemporaneously (i.e., within an academic year, not longitudinally). The present findings reinforce calls to broaden access to undergraduate research experiences through high-quality and institution-wide scalable solutions, such as course-based undergraduate research experiences or CUREs [14, 52, 111, 112]. That is, recent work has shown that CUREs (a.k.a., CREs) can be a cost-effective and scalable way to engage large numbers of undergraduates in authentic and transformative research experiences at any-point during the undergraduate tenure [52, 113, 114].

Mentor network diversity, a novel indicator of quantity of interactions with social influence agents, proved to be the weakest predictor of social influence. However, we suspect that refinements to the operationalization of mentor network characteristics may produce stronger effects than were shown in the present study. Specifically, recent research has shown unique benefits associated with having peer mentors, as well as being involved in an undergraduate–postgraduate–faculty triadic mentoring relationship [49, 66, 67, 115]. Therefore, future research on the effects of mentor networks may need to measure specific network structures and the quality of those relationships, rather than mentor network role diversity, as was done in the present study. While the unique effects of mentor network diversity predicting integration were not robust in the present study, the overall results suggest that curricular and co-curricular efforts to promote diversified peer- and community-based approaches to help students develop their network of mentors may be beneficial to integration [13, 50, 55, 68, 72, 105, 110, 115117].

Finally, it was notable that science identity and values were the two primary mechanism through which social influence agents (i.e., faculty mentors and research experiences) impacted contemporaneous persistence intentions. That is, although science self-efficacy was moderately correlated with persistence intentions at each time point (see S1 Table), self-efficacy was a relatively weak unique predictor in the longitudinal models. The TIMSI framework posits that the motivations to comply with the rules, roles, or values of influence agents may differ across individuals [61] and we propose that it may also differ across developmental stages. That is, we suspect that this pattern of results points to a developmental process, whereby self-efficacy, identity, and values impact integration and persistence differently, depending upon professional career stage. Specifically, science self-efficacy (i.e., feeling confident one can do the science) may be the most important process in supporting social integration for students at earlier points in the career development continuum (i.e., pre-college). However, for undergraduates, self-efficacy may be a necessary, but not the unique or sufficient determining orientation that predicts persistence, with science identity becoming a stronger predictor. Data drawn from graduate students and postdoctoral fellows finds that values become a strong predictor when scholars are choosing to stay or leave academia [118, 119]. Future research across a longer developmental span (e.g., secondary school–college–graduate school and beyond) are needed to continue to elaborate on and test this developmental hypothesis.

Although some aspects of the findings converge with the prior literature, the longitudinal analyses also revealed that the social influence process leading from agents to integration only operated contemporaneously. That is, the effects of influence agents on social integration into the scientific community was fleeting, in that the impact was present when the agent was present, but the impact disappeared a year later when the influence agent was removed or withdrew. This finding is consistent with classical social influence literature showing that proximity, which can be physical or temporal, to an influence agent determines the strength and longevity of the social influence [120, 121]. Kelman [59] noted in his early writing that “surveillance by influencing agent,” “salience of relationship to agent,” and “relevance of values to issue” each made social influence more likely to occur (p. 67). Proximity in time and space to a mentor or engagement in a socializing research experience would make each of these more likely, resulting in greater influence occurring.

Longitudinal findings depart from earlier longitudinal research

The absence of a longitudinal mediated effect of interactions with influence agents on social integration was unexpected and departed from earlier research findings. Specifically, previous research had shown that mentorship quality or undergraduate research experiences influenced later science self-efficacy, identity, values, and/or integration into the STEM communities and careers [45, 46, 62, 63, 65]. We did not find a similar pattern in the present study. Several factors may be at play in distinguishing the current finding of a fleeting relationship to previous findings of a longitudinal relationship. Most notably, methodological differences may help to explain the departure of the current pattern of findings from patterns found prior research. The current and prior studies operated under different protocols for the timing of repeated measurements. For example, one study followed undergraduates over relatively shorter intervals of time and collected fewer observations over time during students’ undergraduate tenure (e.g., three times over a 10-week summer research experience) [65], while another longitudinal study tracked students on an irregular basis (e.g., junior year, senior year, and 4-years post baccalaureate attainment) [63]. By contrast, the present study tracked students annually from the senior year of high school through their senior year of college. The optimal timing for repeated measurements to fully capture the influence process is not yet well understood; however, based on the present and prior findings, it appears that socializing agents may exert more rapid impact on integration than could be fully captured by annual assessments. Influence may be bounded by the beginning, middle, and ending of a socializing experience (e.g., one- or two-semester course-based research experiences). Future research should attend to the natural timing of socializing events to fully capture their potential longitudinal influence. In addition, the current and prior studies utilized different approaches to modeling typical and reciprocal influence. Prior studies have not examined reciprocal influence, whereas the current study was the first to heed recommendations for best practices for longitudinal mediation by utilizing a full forward model that allowed for reciprocal influence when testing the TIMSI predictions [74, 75, 89]. It is possible that if prior studies had used a similar approach, that similar pattern may have emerged.

Another possible factor contributing to the different patterns of longitudinal results concerns demographics. That is, much of the prior research has focused on the social integration of HU students into STEM careers and furthermore, one of the few prior longitudinal studies that tested TIMSI predictions did so among undergraduates from HU groups in STEM [63]. Estrada and colleagues [63] found that science identity alone mediated the relationship between agents and integration (operationalized as post-baccalaureate persistence in a STEM field). By contrast, the present study, which focused on undergraduates from HO groups in STEM, found that both identity and values mediated the relationship between agents and integration. These differences may indicate that undergraduates from under- and over-represented groups are socializing into the scientific community via distinct social influence processes. Previous research on workforce development has shown that even when socioeconomic and academic preparation were controlled, undergraduates from HU groups are not persisting (and, in turn, integrating) into their fields of study at the same rate as students from HO groups, and this difference can be attributed to how they are socially experiencing their academic environment [122]. Thus, there may be culturally different emphases on what psychosocial variables are most central to the integration process for undergraduate students. The integration process is further complicated by a potential intersection with developmental processes. That is, culturally different emphases may change at different developmental periods, as there is emerging evidence that values play an increasingly important role in STEM career decision making among graduate students and postdocs from HU groups [119]. However, future research measuring the emergent patterns across the undergraduate tenure could identify true subgroup similarities or differences in the patterns of social integration into STEM fields.

Integration leads to engagement with social influence agents

Consistent with TIMSI predictions, our study found compelling evidence of longitudinal reciprocal influence into the scientific community via two distinct processes. First, students with stronger intentions to persist in the scientific community at an earlier time point were more likely to seek out and engage in research experiences one year later. This finding is consistent with social psychological theories of human behavior (e.g., SCCT) that hypothesize a direct reciprocal link from performance or persistence outcomes to future engagement with learning experiences that support the development of continued motivation [40, 41, 44]. Second, students with stronger persistence intentions at an earlier time point developed higher levels of science self-efficacy, identity, and values one year later, which, in turn, promoted higher levels of research engagement the following year. This finding is consistent with TIMSI, from which we expected that the reciprocal link from integration to interactions with influencing agents of the scientific community would be mediated by social influence processes (see dashed lines in Fig 1, Social Integration → Social Influence Processes → Social Influence Agents).

Several potential implications of the robust evidence for reciprocal influence should be noted. One is that individuals, particularly individuals from HO groups, are actively engaged in self-socialization–seeking out relationships and experiences that cyclically reinforce their integration into their disciplinary community. This finding affirms hypotheses of reciprocal or cyclical influence as described in multiple social psychological theories of human behavior [20, 40, 41, 61]. However, these findings also put meat on the bones of heretofore generic reciprocal hypotheses by showing that early levels of social integration have both direct influence on future engagement with socializing experiences, as well as indirect influence of future engagement with socializing experiences through the development of stronger identity. Therefore, social influence and other motivational theories may need to be revised regarding the thinking on reciprocal influence to include both direct and indirect pathways.

These findings also suggest that future research studies should identify “if” and “when” HU students are as equally likely as HO students to seek out socializing activities. Given the present and prior findings, it is an open question as to whether or not a similar reciprocal cycle may be occurring for HU students. Future studies could examine if HO and HU students experiencing greater science efficacy, identity, and value endorsement take similar initiative to seek out research experiences. Contextualizing the findings by assessing such experiences as microagressions and microaffirmations from influencing agents could also inform interpretation of the outcomes.

The TIMSI socialization process is highly stable in the college years

The present study addressed a gap in the literature concerning the degree to which TIMSI predictions varied at critical time points in the undergraduate tenure from the senior year of high school through the senior year of college. For example, a lingering question in the research experiences literature has concerned relative impact of early versus later exposure to undergraduate research experiences [85]. Our study found no strong evidence for a critical time point for social influence. Rather, formal tests of developmental and contemporaneous equilibrium indicated a high degree of consistency in the associations among mentoring and research experiences, social influence processes, and social integration from the first through the fourth years of college. In addition, the present study found evidence of a high degree of consistency in the measurement of the social influence and social integration constructs over time and across genders. More specifically, formal tests of measurement invariance revealed that (a) each social influence and integration construct exhibited stability of measurement (in terms of factor loadings) from high school through senior year of college (longitudinal measurement invariance), (b) the measurement of each construct operated equally well for men and women at each time point (multiple groups measurement invariance), and (c) the strength and direction of associations among the constructs were equivalent for men and women at each time point (multiple groups correlation invariance).

Limitations and implications for future research

Although the present study provides unique insights into how HO students integrate into their disciplinary communities, several notable caveats limit generalizations of the findings. The present study made use of a cohort of HO students pursuing a STEM major at a single large northeastern public research-intensive university. As described above, the pattern of associations linking interactions with influence agents to social integration may operate differently for students from HU groups or less research intensive colleges or universities. Therefore, additional research across diverse types of institutions and diverse samples of HU and HO student groups pursuing STEM degrees using the same rigorous modeling approach will be needed to show for whom and under what conditions the observed patterns hold. For example, it would be informative to test for potential subgroup differences in the degree to which influence operates contemporaneously or longitudinally. Moreover, further study is needed on the degree to which TIMSI derived hypotheses hold for first- versus multi-generational students in STEM fields when accounting for the influence of pre-college factors [123]. In addition, the present study used a single and self-reported operationalization of social integration. Although the present measure of social integration has been shown to be predictive of post-baccalaureate STEM career choices among HU students [63, 82], diverse measures of social integration, such as major, course taking, belonging to pre-professional societies and/or national organizations, applications to graduate school, and post-graduation employment would broaden the results and determine the limits of these findings. Furthermore, diverse and objective or non-self-reported measures of social integration would reduce the potential threat that common method bias may have had on the magnitude of associations between predictors and integration in the present study. Similarly, the present study focused on mentee perceptions of the quality of psychosocial and instrumental support received from a faculty mentor, rather than other aspects of mentoring relationships (e.g., relationship duration, the mentor’s perspective). Future research should ascertain reports from both mentor and mentee perspectives to gain insights into the influence of mentoring relationships on social influence processes and social integration. Furthermore, as noted above, the current study measured all constructs annually, which may not have been sufficiently frequent to fully characterize more rapidly mediated links from agents of the scientific community to social integration, through the social influence processes. Therefore, future research will need to consider timing–and, particularly more rapid timing of measurement to illuminate the short-term longitudinal social influence paths.

The sum of the distinctions between the present and prior research endeavors likely accounts for much of the variation in findings and points to recommendations for future research. Future longitudinal research on TIMSI predictions should attend to (a) the possibility of distinct socialization processes for students from HU and HO groups in STEM, (b) examining the entire undergraduate tenure, (c) the frequency and timing of repeated measurement occasions, (d) capture a breadth of theoretically meaningful socializing experiences and all TIMSI identified social influence processes, (e) the inclusion of a variety of measures of integration into STEM career pathways, and (f) the close adherence to best practices in longitudinal mediation and causal ordering research.

Conclusion

The overarching purpose of this longitudinal study was to improve our understanding of STEM workforce development by testing TIMSI predictions about the ways in which individuals socialize into STEM communities and careers. In particular, this study followed a cohort of HO students from high school through their senior year of college. We examined the process whereby agents of the scientific academic community exert influence on integration into the scientific community through social influence processes. Advancing research in this area, the findings also measure the reciprocal influencing processes whereby those who are most integrated seek out more exposure to additional influencing opportunities–resulting in a cycle of deeper integration. The results of this study clearly show that (a) agents of the scientific academic community exert contemporaneous or fleeting indirect influence on social integration, (b) early social integration exerts reciprocal longitudinal influence on future engagement with agents of the scientific academic community, and (c) the socialization process described by the TIMSI framework is highly stable from senior year of high school through senior year of college.

Practically, these results demonstrate that faculty mentors exert influence and draw their mentees into their disciplinary community by helping them to see themselves as belonging in the community and by helping them to internalize scientific community values. Further, students benefit from having increased integration into their professional communities by seeking out more opportunities to socialize into their communities. Therefore, faculty interested in broadening participation may need to support students who are not proactive in finding mentors or research opportunities through systematic curriculum-infused opportunities for authentic research engagement, such as course based undergraduate research experiences. In sum, this study shows how using the lens of social influence theory is useful for identifying processes that may improve interventions to increase academic persistence for all students and to support workforce development.

Supporting information

S1 Fig. Three time point conceptual full-forward plus contemporaneous mediation model.

Y = outcome (i.e., scientific career persistence intentions [indicator of integration]), Mj = mediators (i.e., science self-efficacy, science identity, and science community values [indicators of social influence processes]), Xk = contextual factors (i.e., faculty mentor support, mentor network diversity, research experiences [indicators of social influence agents]). Stability paths shown as solid lines, first- and higher-order longitudinal cross-lagged paths shown as dashed lines, and contemporaneous mediation paths from the contextual factors to the outcome are shown as dotted lines. Subscripts 1 = T1 spring/summer prior to college 2015, 2 = T2 spring first year of college 2016, 3 = T3 spring second year of college 2017, but T4 fall third year of college (2017) and T5 spring fourth year of college (2018) are not shown for the sake of parsimony.

(TIF)

S2 Fig. Planned tests of simplifications of the full-forward plus contemporaneous mediation models.

Model-1 represents the full-forward (i.e., first- and higher-order stability and cross-lagged paths) plus contemporaneous mediation model. Model-2 represents only first-order stability and cross-lagged plus contemporaneous mediation model. Model-3 represents first- and higher-order stability and first-order cross-lagged plus contemporaneous mediation model. Model-4 represents first- and higher-order cross-lagged and first-order stability plus contemporaneous mediation model. Model-5 represents the full forward without contemporaneous mediation model. Model-6 represents developmental equilibrium of the cross-lagged coefficients (i.e., invariance constraints) placed on the simplest and best fitting model identified from Models 1–5. Model-7 represents developmental equilibrium of the stability coefficients added to the simplest and best fitting model from Models 1–6. Model-8 represents contemporaneous equilibrium of the contemporaneous/cross-sectional coefficients added to the simplest and best fitting model from Models 1–7. Correlations among variables not shown for the sake of parsimony.

(TIF)

S3 Fig. Trimmed summary of the standardized coefficient from the final model highlighting third to fourth year of college (Model 8, N = 751).

Only statistically significant paths are shown from coefficients in Table 2. All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients; coefficients in standard text associated with predictors from the prior year in college are first-order cross-lagged coefficients, and coefficients associated with predictors from the current year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

(TIF)

S1 Table. Summary of descriptive statistics and correlations between predictors, mediators, and outcomes across time.

Cronbach’s alphas are presented on the diagonals. *p ≤ .05, **p ≤ .01, ***p ≤ .001.

(PDF)

S2 Table. Summary of longitudinal confirmatory factor analyses (N = 751).

T1 = pre-college, T2 = spring 1st year of college, T3 = spring 2nd year of college, T4 = fall 3rd year of college, T5 = spring 4th year of college. aThe residual variance of item-2 at time-1 of the persistence intentions scale was not different from zero which causes convergence problems. Therefore, the variance of item-2 at time-1 was constrained to zero as were all residual correlations with the item. bThe residual variance of item-2 at times 1, 2, & 3 of the persistence intentions scale was not different from zero which causes convergence problems. Therefore, the variance of item-2 at times 1–3 was constrained to zero as were all residual correlations with the item. *p ≤ .05, **p ≤ .01, ***p ≤ .001.

(PDF)

S3 Table. Summary of model fit and model comparison statistics for nested longitudinal mediation analysis models (N = 751).

Model 1 T-size results for equivalent testing were as follows (a) CFI = .970 and (b) RMSEA = .045; Model 1 T-size results relative to descriptive cutoff values were as follows for CFI (a) Excellent = .989, (b) Close = .950, (c) Fair = .920 and for RMSEA (a) Excellent = .022, (b) Close = .057, (c) Fair = .087; Model 8 T-Size results for equivalent testing were as follows (a) CFI = .946 and (b) RMSEA = .032; Model 8 T-size results relative to descriptive cutoff values were as follows for CFI (a) Excellent = .985, (b) Close = .942, (c) Fair = .909 and for RMSEA (a) Excellent = .017, (b) Close = .055, (c) Fair = .088. ***p ≤ .001.

(PDF)

S4 Table. Summary of standardized structural coefficients predicting engagement with social influence agents, social influence processes, and integration into STEM in the first-year of college (Model 8, N = 751).

T1 = pre-college, T2 = spring 1st year of college, T3 = spring 2nd year of college, T4 = fall 3rd year of college, T5 = spring 4th year of college. All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients, coefficients in standard text associated with predictors from the pre-college are first-order cross-lagged coefficients, and coefficients associated with predictors from the 1st year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 for unstandardized coefficients are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

(PDF)

S5 Table. Summary of standardized structural coefficients for social influence factors, social influence processes, and integration in the second-year of college (Model 8, N = 751).

All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients, coefficients in standard text associated with predictors from the pre-college are first-order cross-lagged coefficients, and coefficients associated with predictors from the 1st year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 for unstandardized coefficients are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

(PDF)

S6 Table. Summary of standardized structural coefficients for social influence factors, social influence processes, and integration in the third-year of college (Model 8, N = 751).

All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients, coefficients in standard text associated with predictors from the pre-college are first-order cross-lagged coefficients, and coefficients associated with predictors from the 1st year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 for unstandardized coefficients are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

(PDF)

S7 Table. Summary of standardized structural coefficients for social influence factors, social influence processes, and integration in the fourth-year of college (Model 8, N = 751).

All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients, coefficients in standard text associated with predictors from the pre-college are first-order cross-lagged coefficients, and coefficients associated with predictors from the 1st year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 for unstandardized coefficients are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

(PDF)

S1 File

(DOCX)

Data Availability

All data and meta-data files are available from the online Dryad database (doi:10.5061/dryad.k98sf7m3k.)

Funding Statement

C. Park and M. Williams. This project was funded was provided by National Institute of General Medical Sciences (Grant No. 1R01GM107707). https://www.nigms.nih.gov/ The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Valantine HA, Collins FS. National Institutes of Health addresses the science of diversity. Proceedings of the National Academy of Sciences. 2015;112(40):12240–2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.National Academy of Sciences, National Academy of Engineering, Institute of Medicine. Rising above the gathering storm: Energizing and employing America for a brighter economic future. Washington, D.C: National Academies Press; 2007. [Google Scholar]
  • 3.Olson S, Riordan DG. Engage to excel: Producing one million additional college graduates with degrees in science, technology, engineering, and mathematics. Report to the president. Washington D.C: Executive Office of the President; 2012. [Google Scholar]
  • 4.National Science Board. Science and engineering indicators 2020: Science and engineering labor force. 2019. Report No.: NSB-2019-8.
  • 5.Griliches Z. The search for R&D spillovers. The Scandinavian Journal of Economics. 1992;94:S29–S47. [Google Scholar]
  • 6.Jones CI. Time series tests of endogenous growth models. The Quarterly Journal of Economics. 1995;110(2):495–525. [Google Scholar]
  • 7.Langdon D, McKittrick G, Beede D, Khan B, Doms M. STEM: Good jobs now and for the future. 2011. Contract No.: ESA Issue Brief# 03–11.
  • 8.Carnevale AP, Smith N, Melton M. STEM: Science Technology Engineering Mathematics. 2011. [Google Scholar]
  • 9.Deming DJ, Noray KL. STEM careers and the changing skill requirements of work. National Bureau of Economic Research Working Paper Series. 2018;No. 25065.
  • 10.Carnevale AP, Smith N, Strohl J. Help wanted: Projecting jobs and education requirements through 2018. Washington, DC: The Georgetown University Center on Education and the Workforce; 2010. [Google Scholar]
  • 11.Chen X. STEM Attrition: College students' paths into and out of STEM Fields (NCES 2014–001). Washington, DC: National Center for Education Statistics, Institute of Education Sciences, and U.S. Department of Education; 2013. 104 p. [Google Scholar]
  • 12.Litzler E, Young J. Understanding the risk of attrition in undergraduate engineering: Results from the project to assess climate in engineering. Journal of Engineering Education. 2012;101(2):319–45. [Google Scholar]
  • 13.Graham MJ, Frederick J, Byars-Winston A, Hunter A-B, Handelsman J. Increasing persistence of college students in STEM. Science. 2013;341(6153):1455–6. 10.1126/science.1240487 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Linn MC, Palmer E, Baranger A, Gerard E, Stone E. Undergraduate research experiences: Impacts and opportunities. Science. 2015;347(6222):12617571–6. [DOI] [PubMed] [Google Scholar]
  • 15.National Academies of Sciences Engineering & Medicine. The Science of Effective Mentorship in STEMM. Byars-Winston A, Dahlberg ML, editors. Washington, DC: The National Academies Press; 2019. 306 p. [PubMed] [Google Scholar]
  • 16.Crisp G, Cruz I. Mentoring college students: A critical review of the literature between 1990 and 2007. Research in Higher Education. 2009;50(6):525–45. [Google Scholar]
  • 17.Jacobi M. Mentoring and undergraduate academic success: A literature review. Review of Educational Research. 1991;61(4):505–32. [Google Scholar]
  • 18.Johnson WB, Rose GL, Schlosser LZ. Student-Faculty mentoring: Theoretical and methodological issues. In: Allen TD, Eby LT, editors. The Blackwell handbook of mentoring: A multiple perspectives approach. Oxford: Blackwell; 2007. p. 49–70. [Google Scholar]
  • 19.Pfund C, Byars-Winston A, Branchaw J, Hurtado S, Eagan K. Defining attributes and metrics of effective research mentoring relationships. AIDS and behavior. 2016;20:S238–S48. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Schunk DH, Mullen CA. Toward a conceptual model of mentoring research: Integration with self-regulated learning. Educational Psychology Review. 2013;25(3):361–89. [Google Scholar]
  • 21.Hernandez PR. Landscape of assessments of mentoring relationship processes in postsecondary STEMM contexts: A synthesis of validity evidence from mentee, mentor, institutional/programmatic perspectives. Paper commissioned by the National Academies of Sciences Engineering & Medicine Committee on The Science of Effective Mentorship in STEMM. 2019. 10.17226/24918 [DOI] [PubMed] [Google Scholar]
  • 22.Baier ST, Markman BS, Pernice-Duca FM. Intent to persist in college freshmen: The role of self-efficacy and mentorship. Journal of College Student Development. 2016;57(5):614–9. [Google Scholar]
  • 23.Bordes-Edgar V, Arredondo P, Kurpius SR, Rund J. A longitudinal analysis of Latina/o students’ academic persistence. Journal of Hispanic Higher Education. 2011;10(4):358–68. [Google Scholar]
  • 24.Campbell TA, Campbell DE. Outcomes of mentoring at risk college students: gender and ethnic matching effects. Mentoring & Tutoring. 2007;15(2):135–48. [Google Scholar]
  • 25.Cosgrove TJ. The effects of participation in a mentoring-transcript program on freshmen. Journal of College Student Personnel. 1986;27(2):119–24. [Google Scholar]
  • 26.Rodger S, Tremblay PF. The effects of a peer mentoring program on academic success among first year university students. Canadian Journal of Higher Education. 2003;33(3):1–17. [Google Scholar]
  • 27.Salinitri G. The effects of formal mentoring on the retention rates for first-year, low achieving students. Canadian Journal of Education. 2005;28(4):853–73. [Google Scholar]
  • 28.Damkaci F, Braun TF, Gublo K. Peer mentor program for the general chemistry laboratory designed to improve undergraduate STEM retention. Journal of Chemical Education. 2017. [Google Scholar]
  • 29.Bordes V, Arredondo P. Mentoring and 1st-Year latina/o college students. Journal of Hispanic Higher Education. 2005;4(2):114–33. [Google Scholar]
  • 30.Crisp G. The impact of mentoring on the success of community college students. The Review of Higher Education. 2010;34(1):39–60. [Google Scholar]
  • 31.Davis DJ. Mentorship and the socialization of underrepresented minorities into the professoriate: examining varied influences. Mentoring & Tutoring: Partnership in Learning. 2008;16(3):278–93. [Google Scholar]
  • 32.Phinney JS, Campos CMT, Kallemeyn DMP, Kim C. Processes and outcomes of a mentoring program for latino college freshmen. J Soc Issues. 2011;67(3):599–621. [Google Scholar]
  • 33.Torres Campos CM, Phinney JS, Perez-Brena N, Kim C, Ornelas B, Nemanim L, et al. A mentor-based targeted intervention for high-risk latino college freshmen: A pilot study. Journal of Hispanic Higher Education. 2009;8(2):158–78. [Google Scholar]
  • 34.Torres V, Hernandez E. Influence of an identified advisor/mentor on urban Latino students' college experience. Journal of College Student Retention: Research, Theory and Practice. 2009;11(1):141–60. [Google Scholar]
  • 35.Blake-Beard S, Bayne ML, Crosby FJ, Muller CB. Matching by race and gender in mentoring relationships: Keeping our eyes on the prize. J Soc Issues. 2011;67(3):622–43. [Google Scholar]
  • 36.Campbell TA, Campbell DE. Faculty/student mentor program: Effects on academic performance and retention. Research in Higher Education. 1997;38(6):727–42. [Google Scholar]
  • 37.Davis DJ. The academic influence of mentoring upon African American undergraduate aspirants to the professoriate. The Urban Review. 2009;42(2):143–58. [Google Scholar]
  • 38.Eby LT, Allen TD, Evans SC, Ng T, Dubois D. Does mentoring matter? A multidisciplinary meta-analysis comparing mentored and non-mentored individuals. Journal of Vocational Behavior. 2008;72(2):254–67. 10.1016/j.jvb.2007.04.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Eby LT, Allen TD, Hoffman BJ, Baranik LE, Sauer JB, Baldwin S, et al. An interdisciplinary meta-analysis of the potential antecedents, correlates, and consequences of protégé perceptions of mentoring. Psychological Bulletin. 2013;139(2):441–76. 10.1037/a0029279 [DOI] [PubMed] [Google Scholar]
  • 40.Eccles JS, Wigfield A. Motivational beliefs, values, and goals. Annual Review of Psychology. 2002;53(1):109–32. [DOI] [PubMed] [Google Scholar]
  • 41.Lent RW, Brown SD, Hackett G. Toward a unifying social cognitive theory of career and academic interest, choice, and performance. Journal of Vocational Behavior. 1994;45(1):79–122. [Google Scholar]
  • 42.Bandura A. Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice-Hall, Inc; 1986. [Google Scholar]
  • 43.Wood R, Bandura A. Social cognitive theory of organizational management. The Academy of Management Review. 1989;14(3):361–84. [Google Scholar]
  • 44.Bandura A. Human agency in social cognitive theory. American Psychologist. 1989;44(9):1175–84. 10.1037/0003-066x.44.9.1175 [DOI] [PubMed] [Google Scholar]
  • 45.Byars-Winston AM, Branchaw J, Pfund C, Leverett P, Newton J. Culturally diverse undergraduate researchers' academic outcomes and perceptions of their research mentoring relationships. International Journal of Science Education. 2015;37(15):2533–54. 10.1080/09500693.2015.1085133 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Chemers MM, Zurbriggen EL, Syed M, Goza BK, Bearman S. The role of efficacy and identity in science career commitment among underrepresented minority students. J Soc Issues. 2011;67(3):469–91. [Google Scholar]
  • 47.Robnett RD, Nelson PA, Zurbriggen EL, Crosby FJ, Chemers MM. Research mentoring and scientist identity: insights from undergraduates and their mentors. International Journal of STEM Education. 2018;5(1):41 10.1186/s40594-018-0139-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Byars-Winston A, Rogers J, Branchaw J, Pribbenow C, Hanke R, Pfund C. New measures assessing predictors of academic persistence for historically underrepresented racial/ethnic undergraduates in science. CBE Life Sciences Education. 2016;15(3):ar32 10.1187/cbe.16-01-0030 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Dennehy TC, Dasgupta N. Female peer mentors early in college increase women’s positive academic experiences and retention in engineering. Proceedings of the National Academy of Sciences. 2017;114(23):5964–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Hernandez PR, Bloodhart B, Barnes RT, Adams AS, Clinton SM, Pollack I, et al. Promoting professional identity, motivation, and persistence: Benefits of an informal mentoring program for female undergraduate students. PLOS ONE. 2017;12(11):e0187531 10.1371/journal.pone.0187531 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Cialdini RB, Goldstein NJ. Social influence: Compliance and conformity. Annual Review of Psychology. 2004;55:591–621. 10.1146/annurev.psych.55.090902.142015 [DOI] [PubMed] [Google Scholar]
  • 52.National Academies of Sciences Engineering and Medicine. Undergraduate research experiences for STEM students: Successes, challenges, and opportunities. Gentile J, Brenner K, Stephens A, editors. Washington, DC: The National Academies Press; 2017. 278 p. [Google Scholar]
  • 53.Bauer TN, Green SG. Effect of newcomer involvement in work-related activities: A longitudinal-study of socialization. Journal of Applied Psychology. 1994;79(2):211–23. 10.1037/0021-9010.79.2.211 [DOI] [PubMed] [Google Scholar]
  • 54.Green SG. Professional entry and the adviser relationship: Socialization, commitment, and productivity. Group & Organization Studies. 1991;16(4):387–407. [Google Scholar]
  • 55.Wilson ZS, Holmes L, deGravelles K, Sylvain MR, Batiste L, Johnson M, et al. Hierarchical mentoring: A transformative strategy for improving diversity and retention in undergraduate STEM disciplines. Journal of Science Education and Technology. 2011;21(1):148–56. [Google Scholar]
  • 56.Laursen S, Hunter A, Seymour E, Thiry H, Melton G. Undergraduate research in the sciences: Engaging students in real science. San Francisco, CA: John Wiley & Sons, Inc.; 2010. [Google Scholar]
  • 57.Leary MR. Affiliation, acceptance, and belonging: The pursuit of interpersonal connection. In: Fiske ST, Gilbert DT, Lindzey G, editors. Handbook of Social Psychology. 5th ed ed. Hoboken, N.J: John Wiley & Sons; 2010. [Google Scholar]
  • 58.Kelman HC. Compliance, identification, and internalization: Three processes of attitude change. Journal of Conflict Resolution. 1958;2(1):51–60. [Google Scholar]
  • 59.Kelman HC. Processes of opinion change. Public Opinion Quarterly. 1961;25:57–78. [Google Scholar]
  • 60.Kelman HC. Further thoughts on the processes of compliance, identification, and internalization. In: Tedeschi JT, editor. Perspectives on Social Power Chicago: Aldine; 1974. p. 125–71. [Google Scholar]
  • 61.Kelman HC. Interests, relationships, identities: Three central issues for individuals and groups in negotiating their social environment. Annual Review of Psychology. 2006;57:1 10.1146/annurev.psych.57.102904.190156 [DOI] [PubMed] [Google Scholar]
  • 62.Estrada M, Woodcock A, Hernandez PR, Schultz PW. Toward a model of social influence that explains minority student integration into the scientific community. Journal of Educational Psychology. 2011;103(1):206–22. 10.1037/a0020743 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Estrada M, Hernandez PR, Schultz PW. A longitudinal study of how quality mentorship and research experience integrate underrepresented minorities into STEM careers. CBE-Life Sciences Education. 2018;17:ar9(1):1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Hanauer DI, Graham MJ, Hatfull GF. A measure of college student persistence in the sciences (PITS). CBE-Life Sciences Education. 2016;15(4). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Hernandez PR, Hopkins PD, Masters K, Holland L, Mei BM, Richards-Babb M, et al. Student integration into STEM careers and culture: A longitudinal examination of summer research mentors and project ownership. CBE-Life Sciences Education. 2018;17:ar50(3):1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Aikens ML, Robertson MM, Sadselia S, Watkins K, Evans M, Runyon CR, et al. Race and gender differences in undergraduate research mentoring structures and research outcomes. CBE-Life Sciences Education. 2017;16(2). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Aikens ML, Sadselia S, Watkins K, Evans M, Eby LT, Dolan EL. A social capital perspective on the mentoring of undergraduate life science researchers: An empirical study of undergraduate–postgraduate–faculty triads. CBE-Life Sciences Education. 2016;15(2). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Glessmer MS, Wang YV, Kontak R. Networking as a tool for earth science women to build community and succeed. Eos, Transactions American Geophysical Union. 2012;93(41):406–7. [Google Scholar]
  • 69.Higgins MC, Kram KE. Reconceptualizing mentoring at work: A developmental network perspective. Acad Manage Rev. 2001;26(2):264–88. [Google Scholar]
  • 70.Packard BWL, Walsh L, Seidenberg S. Will that be one mentor or two? A cross-sectional study of women's mentoring during college. Mentoring & Tutoring: Partnership in Learning. 2004;12(1):71–85. [Google Scholar]
  • 71.San Miguel AM, Kim MM. Successful Latina scientists and engineers: Their lived mentoring experiences and career development. J Career Dev. 2015;42(2):133–48. [Google Scholar]
  • 72.DeCastro R, Sambuco D, Ubel PA, Stewart A, Jagsi R. Mentor networks in academic medicine: Moving beyond a dyadic conception of mentoring for junior faculty researchers. Academic Medicine. 2013;88(4):488–96. 10.1097/ACM.0b013e318285d302 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Joshi M, Aikens ML, Dolan EL. Direct ties to a faculty mentor related to positive outcomes for undergraduate researchers. BioScience. 2019;69(5):389–97. 10.1093/biosci/biz039 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.MacKinnon DP. Longitudinal mediation models. Introduction to statistical mediation analysis. New York, NY: Taylor & Francis Group; 2008. p. 193–236. [Google Scholar]
  • 75.Marsh HW, Byrne BM, Yeung AS. Causal ordering of academic self-concept and achievement: Reanalysis of a pioneering study and. . . Educational Psychologist. 1999;34(3):155–67. [Google Scholar]
  • 76.Arens AK, Marsh HW, Pekrun R, Lichtenfeld S, Murayama K, vom Hofe R. Math self-concept, grades, and achievement test scores: Long-term reciprocal effects across five waves and three achievement tracks. Journal of Educational Psychology. 2017;109(5):621–34. [Google Scholar]
  • 77.Buunk BP, Schaufeli WB. Reciprocity in interpersonal relationships: An evolutionary perspective on its importance for health and well-being. Eur Rev Soc Psychol. 1999;10(1):259–91. [Google Scholar]
  • 78.Guay F, Marsh HW, Boivin M. Academic self-concept and academic achievement: Developmental perspectives on their causal ordering. Journal of Educational Psychology. 2003;95(1):124–36. [Google Scholar]
  • 79.Marsh HW, Craven RG. Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science. 2006;1(2):133–63. 10.1111/j.1745-6916.2006.00010.x [DOI] [PubMed] [Google Scholar]
  • 80.US Department of Education, Institute of Education Sciences, National Center for Education Statistics. Integrated Postsecondary Education Data System. In: US Department of Education, editor.
  • 81.Park C. L., Williams M., Hernandez P. R., Agocha V. B., Carney L. M., DePetris A., & Lee S. Y. Self-regulation and STEM persistence in minority and non-minority students across the first year of college. Social Psychology of Education. 2019;22(1):91–112. 10.1007/s11218-018-9465-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Woodcock A, Hernandez PR, Schultz PW. Diversifying science: Intervention programs moderate the effect of stereotype threat on motivation and career choice. Social Psychological and Personality Science. 2015;7(2):184–92. 10.1177/1948550615608401 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Dreher GF, Ash RA. A comparative-study of mentoring among men and women in managerial, professional, and technical positions. Journal of Applied Psychology. 1990;75(5):539–46. [Google Scholar]
  • 84.Tenenbaum HR, Crosby FJ, Gliner MD. Mentoring relationships in graduate school. Journal of Vocational Behavior. 2001;59(3):326–41. [Google Scholar]
  • 85.Hernandez PR, Woodcock A, Estrada M, Schultz PW. Undergraduate research experiences broaden diversity in the scientific workforce. BioScience. 2018;68(3):204–11. [Google Scholar]
  • 86.Schultz PW, Hernandez PR, Woodcock A, Estrada M, Chance RC, Aguilar M, et al. Patching the pipeline: Reducing educational disparities in the sciences through minority training programs. Educational evaluation and policy analysis. 2011;33(1):95–114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Muthén BO, Muthén LK. Mplus user's guide. 8.0 ed. Los Angeles, CA: Muthén & Muthén; 1998–2017. [Google Scholar]
  • 88.Hu L, Bentler PM. Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6(1):1–55. [Google Scholar]
  • 89.Little TD. Longitudinal structural equation modeling. New York: The Guilford Press; 2013. xxii, 386 pages p. [Google Scholar]
  • 90.Marsh HW, Hau K-T, Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal. 2004;11(3):320–41. [Google Scholar]
  • 91.Kline RB. Principles and practice of structural equation modeling. 4 ed Kenny D, editor. New York, NY: Guilford Press; 2016. [Google Scholar]
  • 92.Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal. 2002;9(2):233–55. [Google Scholar]
  • 93.Cribbie RA. Evaluating the importance of individual parameters in structural equation modeling: the need for type I error control. Personality and Individual Differences. 2000;29(3):567–77. [Google Scholar]
  • 94.Cribbie RA. Multiplicity control in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal. 2007;14(1):98–112. [Google Scholar]
  • 95.Benjamini Y, Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. 1995;57(1):289–300. [Google Scholar]
  • 96.Little RJA. A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association. 1988;83(404):1198–202. [Google Scholar]
  • 97.Enders CK. Applied missing data analysis. New York, NY: Guilford Press; 2010. [Google Scholar]
  • 98.Schafer JL, Graham JW. Missing data: Our view of the state of the art. Psychological Methods. 2002;7(2):147–77. [PubMed] [Google Scholar]
  • 99.Marsh HW, Pekrun R, Parker PD, Murayama K, Guo J, Dicke T, et al. The murky distinction between self-concept and self-efficacy: Beware of lurking jingle-jangle fallacies. Journal of Educational Psychology. 2019;111(2):331–53. [Google Scholar]
  • 100.Jeličić H, Phelps E, Lerner RM. Use of missing data methods in longitudinal studies: The persistence of bad practices in developmental psychology. Developmental psychology. 2009;45(4):1195–9. 10.1037/a0015665 [DOI] [PubMed] [Google Scholar]
  • 101.Judd CM, McClelland GH, Ryan CS. Outliers and ill-mannered error. Data analysis: A model comparison approach. 2nd ed New York, NY: Routledge; 2009. p. 328. [Google Scholar]
  • 102.Hayes AF. Introduction to mediation, moderation, and conditional process analysis. Little TD, editor. New York, NY: Guilford Press; 2013. 507 p. [Google Scholar]
  • 103.MacKinnon DP. Introduction to statistical mediation analysis. New York, NY: Taylor & Francis Group; 2008. [Google Scholar]
  • 104.Mendez Sylvia L. Mentorship in the engineering professoriate: Exploring the role of social cognitive career theory. International Journal of Mentoring and Coaching in Education. 2017;6(4):302–16. [Google Scholar]
  • 105.Balster N, Pfund C, Rediske R, Branchaw J. Entering research: A course that creates community and structure for beginning undergraduate researchers in the STEM disciplines. CBE Life Sciences Education. 2010;9(2):108–18. 10.1187/cbe.09-10-0073 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 106.Eagan MK, Hurtado S, Chang MJ, Garcia GA, Herrera FA, Garibay JC. Making a difference in science education: The impact of undergraduate research programs. American Educational Research Journal. 2013;50(4):683–713. 10.3102/0002831213482038 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 107.Linn MC, Palmer E, Baranger A, Gerard E, Stone E. Undergraduate research experiences: Impacts and opportunities. Science. 2015;347(6222). [DOI] [PubMed] [Google Scholar]
  • 108.Lopatto D. Survey of undergraduate research experiences (SURE): First findings. Cell Biology Education. 2004;3(4):270–7. 10.1187/cbe.04-07-0045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 109.Russell SH, Hancock MP, McCullough J. Benefits of undergraduate research experiences. Science. 2007;316(5824):548–9. 10.1126/science.1140384 [DOI] [PubMed] [Google Scholar]
  • 110.Wei CA, Woodin T. Undergraduate research experiences in biology: Alternatives to the apprenticeship model. CBE—Life Sciences Education. 2011;10(2):123–31. 10.1187/cbe.11-03-0028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 111.Dolan EL. Undergraduate research as curriculum. Biochemistry and Molecular Biology Education. 2017;45(4):293–8. 10.1002/bmb.21070 [DOI] [PubMed] [Google Scholar]
  • 112.Estrada M, Burnett M, Campbell AG, Campbell PB, Denetclaw WF, Gutiérrez CG, et al. Improving underrepresented minority student persistence in STEM. CBE-Life Sciences Education. 2016;15(3). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Hanauer DI, Graham MJ, SEA-PHAGES, Betancur L, Bobrownicki A, Cresawn SG, et al. An inclusive Research Education Community (iREC): Impact of the SEA-PHAGES program on research outcomes and student learning. Proceedings of the National Academy of Sciences. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 114.Rodenbusch S, Hernandez PR, Simmons SL, Dolan EL. Early engagement in course-based research increases graduation rates and completion of science, engineering, and mathematics degrees. CBE—Life Sciences Education. 2016;15(Summer 2016):1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115.Pfund C, Pribbenow CM, Branchaw J, Lauffer SM, Handelsman J. The merits of training mentors. Science. 2006;311(5760):473–4. 10.1126/science.1123806 [DOI] [PubMed] [Google Scholar]
  • 116.Hernandez PR, Bloodhart B, Adams AS, Barnes RT, Burt M, Clinton SM, et al. Role modeling is a viable retention strategy for undergraduate women in the geosciences. Geosphere. 2018;14(6):2585–93. [Google Scholar]
  • 117.Montgomery BL. Mapping a mentoring roadmap and developing a supportive network for strategic career advancement. SAGE Open. 2017;7(2):2158244017710288. [Google Scholar]
  • 118.Gibbs KD, Basson J, Xierali IM, Broniatowski DA. Decoupling of the minority PhD talent pool and assistant professor hiring in medical school basic science departments in the US. eLife. 2016;5:e21393 10.7554/eLife.21393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 119.Gibbs KD, Griffin KA. What do I want to be with my PhD? The roles of personal values and structural dynamics in shaping the career interests of recent biomedical science PhD graduates. CBE Life Sciences Education. 2013;12(4):711–23. 10.1187/cbe.13-02-0021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 120.Milgram S. Behavioral Study of obedience. The Journal of Abnormal and Social Psychology. 1963;67(4):371–8. [DOI] [PubMed] [Google Scholar]
  • 121.Latané B. The psychology of social impact. American Psychologist. 1981;36(4):343–56. [Google Scholar]
  • 122.Chang MJ, Eagan MK, Lin MH, Hurtado S. Considering the Impact of Racial Stigmas and Science Identity: Persistence among Biomedical and Behavioral Science Aspirants. The Journal of Higher Education. 2011;82(5):564–96. 10.1353/jhe.2011.0030 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 123.Bettencourt GM, Manly CA, Kimball E, Wells RS. STEM degree completion and first-generation college students: A cumulative disadvantage approach to the outcomes gap. The Review of Higher Education. 2020;43(3):753–79. [Google Scholar]

Decision Letter 0

Frantisek Sudzina

15 May 2020

PONE-D-20-08469

Testing Models of Reciprocal Relations between Social Influence and Integration in STEM across the College Years

PLOS ONE

Dear Dr. Hernandez,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Jun 29 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Frantisek Sudzina

Academic Editor

PLOS ONE

Additional Editor Comments:

There are multiple ways to deal with the comments. Take time to think what would be the best option from your point view after reading the three reviews; I do not want to push you one way or the other.

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: See my attached full review of the paper. My concerns are not with the way the study was conducted or analyzed. I do have concerns about the interpretation given to the model presented. In my attached review I have tried to explain the way in which i would interpret the findings. I think the research need to revise the final sections of the paper. They are in my opinion a bit too wedded to their original theoretical orientation and the data may not fully support their conclusions. I encourage the researchers to rethink those final sections.

Reviewer #2: This paper presents the results of a longitudinal study spanning the entirety of undergraduates’ careers and investigating the Tripartite Integration Model of Social Influences (e.g., how Social Influence Agents affect Social Influence Processes which may intern influence Social Integration and other relationships among these factors). Their results indicate that more diverse mentor networks and high quality faculty mentorship support and research engagement support STEM integration through (mediated by) their influence on science identity and science community values. In addition the authors find that high levels of initial integration predict pursuit of additional research experiences via the effect on science identity.

I find this paper to adhere to all standards and metrics for publication in PLOSone. Experiments and analyses are performed to a high technical standard, conclusions are appropriate and claims are aligned with results, and the study clearly identifies a gap in the literature. Furthermore, the writing is clear, concise, and while it is technically complex at times, I feel it would be accessible to a reader who is not overly familiar with SEM and the other techniques used.

Responses to the following minor comments would improve the paper:

Line 127. You have not yet discussed the process of reciprocal influence in the manuscript, clarify for what and whom the influence could be reciprocal.

Lines 214-218 It may be worth mentioning in this paragraph why you did not use the data set you drew on for this study, which includes HU students, to also analyze HU students and compare their outcomes to HO students. Was this a sample size issue?

Line 276 You explain that 22% of your HO sample were first-generation college students. In many studies, these students are reported as underserved or underrepresented. Could you comment on why these students are included in the HO sample?

Table 1. It may not be immediately clear to readers who do not frequently do statistics what N, M, and SD mean. Perhaps add these to the notes at the end of your table. In addition, please briefly explain how to interpret the numbers for N as these are not intuitive.

Lines 357-369. Please provide an explanation for why the pre-college survey responses and college survey responses differ substantially. It is clear why ‘university faculty’ are on one survey and ‘teachers’ are on the other, but it is not clear why family members and others were removed from the second scale.

Line 504 and Table 2. The p value cutoff you use in your table is 0.023 and it appears that research experiences did not make this cutoff for predicting scientific career persistence intentions as indicated by the absence of an * in the table (unless I am somehow reading the table incorrectly). Do you still want to discuss this result? ...or perhaps you just need to add the “*” in the table.

Table 2.

-Should the first listing of “Research Experiences” under T5 4th Year of College Outcomes actually be “Persistence Intentions”?

- It gets a little challenging to remember which components are “Social Influence Agents” and “Social Influence Processes.”. Could you somehow designate “agents” and “processes” in the table to remind readers of these components?

Lines 494-535

-It would be nice if you created a supplementary structural equation model figure that would present a schematic representation of the data in Table 2 and referenced it somewhere in your descriptive text. For readers who are helped by diagrams and schematics of data, this would elucidate relationships between variables. This figure would be a bit complex and large (hence the recommendation to include it in the supplement), but I feel it would help readers to interpret the results and view the data from a temporal perspective.

-It is a little counter intuitive having the contemporaneous coefficients discussed first when they are in the second part of the table. Could you cue the reader to look in the lower section of the table for these results in the text so that it is easier to cross-reference?

Line 615. Consider also referencing the earlier call: https://www.lifescied.org/doi/full/10.1187/cbe.11-03-0028

Lines 617-624 - Did you explore the possibility that influence operates more rapidly for HO students than for HU students? Did the prior literature that you refer to here explore HO or HU students? This may be worth commenting on.

Lines 626-644 - Do you have any hypotheses as to why values, specifically, are a mediator for HO students but not for HU students? Can you find or point to any literature that explores the differences between values and identity and discusses how these two social processes may be acting in order to explain your results?

Grammatical/Wording Suggestions:

Line 179 - It may make more sense to say ‘processes’ instead of ‘process’

Line 226 - Change ‘design’ to ‘designed’

Line 499 - Please add the word “and” between “self-efficacy” and “science identity”

Reviewer #3: This study examined longitudinal links among mentoring, psychological processes, and science career intentions among historically overrepresented university students. The paper has many strengths, and in particular I appreciated the rigorous mediation and model selection methods along with the ambitious goals to comprehensively test these processes. However, I have a moderate to serious concerns about the rationale for the study, the methods, and the results as outlined in detail below:

1. I wondered why the focus was on historically overrepresented groups. Prior studies having largely examined HU groups (lines 170-180) is not really an adequate rationale for the exclusion of HU students from the sample. Further, if an aim of the study is to identify subgroup differences/similarities (line 217-218), it makes more sense to include the subgroups in the current study. Currently, the study does not allow for direct comparisons, so differences between this study and prior studies could be attributed to the many differences in the data and study design that were earlier identified as unique strengths of this paper.

2. The rationale for the need and purpose of this study might be greatly strengthened by mentioning a specific theory or theories and their tenets rather than relying broadly on the propositions and potential extensions of “social psychology theories” (e.g., lines 69, 82, 666). Social cognitive models, for example, would be a more specific framework to draw upon, or expectancy-value theory in particular seems very relevant to this study.

3. I also have concerns about the measures. First, the reliabilities are a bit low for scientific career intentions. Second, why were measurement analyses presented for some but not all constructs (e.g., why was the faculty mentoring support measure not included in the CFAs or tests of measurement invariance)? Third, what was the rationale for the use of composite (mean) scores rather than latent constructs or factor scores? Lastly, all measures are self-report, introducing the strong possibility of over-inflated relations among variables due to common method bias.

4. Missing data presents another major concern. There is a great deal of missing data, on some variables greater than 80%. Importantly, there was no evidence presented for the MAR assumption (line 416) that must be met for FIML estimation to produce unbiased estimates. Reasons for missing data are clearly non-random as, for example, students did not complete the mentoring practices measure if they did not have a university faculty mentor. It does not seem appropriate to estimate relations of mentoring quality with the other variables for students who did not experience university faculty mentoring at all. Further, the available evidence (e.g., demographic percentages) does not support the claim that “participants largely mirror the demographics of the university” (line 259-260), particularly within this analytic sample (e.g., 58% female in the study vs. 51% female at the university; entire racial/ethnic groups were excluded).

5. The modelling approach is in need of more detailed explanation and rationale in the text. For example, it was unclear whether the many variables were modeled in separate models or together in one model, or whether this was the most appropriate approach given the potential for multicollinearity, higher-order factor structures, etc.

6. The results are very hard to understand because there are so many processes under consideration and because of the aforementioned lack of clarity in the modelling approach. I recommend more deliberately explaining each finding in both technical terms as well as plain-language interpretations of the meaning of the findings to help readers more easily digest the results. Due to the lack of clarity, it was difficult to determine how well the results support conclusions such as “social influence operates rapidly” (line 616).

7. What criteria (e.g., statistical test) were used to determine which is the “strongest” predictor (e.g., lines 502, 506, 544)?

8. The writing is generally strong, however a number of typos indicate the need for a thorough proofreading. For example: (line 191-192) “STEM majors with a larger and more diverse networks”; (line 208-209) “we hypothesized that the level faculty support”; (line 437) “persistence intensions”; (line 505-506).

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-20-08469 Review May 2020.docx

Decision Letter 1

Frantisek Sudzina

13 Aug 2020

Testing models of reciprocal relations between social influence and integration in STEM across the college years

PONE-D-20-08469R1

Dear Dr. Hernandez,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Frantisek Sudzina

Academic Editor

PLOS ONE

Acceptance letter

Frantisek Sudzina

20 Aug 2020

PONE-D-20-08469R1

Testing models of reciprocal relations between social influence and integration in STEM across the college years

Dear Dr. Hernandez:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Frantisek Sudzina

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Three time point conceptual full-forward plus contemporaneous mediation model.

    Y = outcome (i.e., scientific career persistence intentions [indicator of integration]), Mj = mediators (i.e., science self-efficacy, science identity, and science community values [indicators of social influence processes]), Xk = contextual factors (i.e., faculty mentor support, mentor network diversity, research experiences [indicators of social influence agents]). Stability paths shown as solid lines, first- and higher-order longitudinal cross-lagged paths shown as dashed lines, and contemporaneous mediation paths from the contextual factors to the outcome are shown as dotted lines. Subscripts 1 = T1 spring/summer prior to college 2015, 2 = T2 spring first year of college 2016, 3 = T3 spring second year of college 2017, but T4 fall third year of college (2017) and T5 spring fourth year of college (2018) are not shown for the sake of parsimony.

    (TIF)

    S2 Fig. Planned tests of simplifications of the full-forward plus contemporaneous mediation models.

    Model-1 represents the full-forward (i.e., first- and higher-order stability and cross-lagged paths) plus contemporaneous mediation model. Model-2 represents only first-order stability and cross-lagged plus contemporaneous mediation model. Model-3 represents first- and higher-order stability and first-order cross-lagged plus contemporaneous mediation model. Model-4 represents first- and higher-order cross-lagged and first-order stability plus contemporaneous mediation model. Model-5 represents the full forward without contemporaneous mediation model. Model-6 represents developmental equilibrium of the cross-lagged coefficients (i.e., invariance constraints) placed on the simplest and best fitting model identified from Models 1–5. Model-7 represents developmental equilibrium of the stability coefficients added to the simplest and best fitting model from Models 1–6. Model-8 represents contemporaneous equilibrium of the contemporaneous/cross-sectional coefficients added to the simplest and best fitting model from Models 1–7. Correlations among variables not shown for the sake of parsimony.

    (TIF)

    S3 Fig. Trimmed summary of the standardized coefficient from the final model highlighting third to fourth year of college (Model 8, N = 751).

    Only statistically significant paths are shown from coefficients in Table 2. All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients; coefficients in standard text associated with predictors from the prior year in college are first-order cross-lagged coefficients, and coefficients associated with predictors from the current year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

    (TIF)

    S1 Table. Summary of descriptive statistics and correlations between predictors, mediators, and outcomes across time.

    Cronbach’s alphas are presented on the diagonals. *p ≤ .05, **p ≤ .01, ***p ≤ .001.

    (PDF)

    S2 Table. Summary of longitudinal confirmatory factor analyses (N = 751).

    T1 = pre-college, T2 = spring 1st year of college, T3 = spring 2nd year of college, T4 = fall 3rd year of college, T5 = spring 4th year of college. aThe residual variance of item-2 at time-1 of the persistence intentions scale was not different from zero which causes convergence problems. Therefore, the variance of item-2 at time-1 was constrained to zero as were all residual correlations with the item. bThe residual variance of item-2 at times 1, 2, & 3 of the persistence intentions scale was not different from zero which causes convergence problems. Therefore, the variance of item-2 at times 1–3 was constrained to zero as were all residual correlations with the item. *p ≤ .05, **p ≤ .01, ***p ≤ .001.

    (PDF)

    S3 Table. Summary of model fit and model comparison statistics for nested longitudinal mediation analysis models (N = 751).

    Model 1 T-size results for equivalent testing were as follows (a) CFI = .970 and (b) RMSEA = .045; Model 1 T-size results relative to descriptive cutoff values were as follows for CFI (a) Excellent = .989, (b) Close = .950, (c) Fair = .920 and for RMSEA (a) Excellent = .022, (b) Close = .057, (c) Fair = .087; Model 8 T-Size results for equivalent testing were as follows (a) CFI = .946 and (b) RMSEA = .032; Model 8 T-size results relative to descriptive cutoff values were as follows for CFI (a) Excellent = .985, (b) Close = .942, (c) Fair = .909 and for RMSEA (a) Excellent = .017, (b) Close = .055, (c) Fair = .088. ***p ≤ .001.

    (PDF)

    S4 Table. Summary of standardized structural coefficients predicting engagement with social influence agents, social influence processes, and integration into STEM in the first-year of college (Model 8, N = 751).

    T1 = pre-college, T2 = spring 1st year of college, T3 = spring 2nd year of college, T4 = fall 3rd year of college, T5 = spring 4th year of college. All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients, coefficients in standard text associated with predictors from the pre-college are first-order cross-lagged coefficients, and coefficients associated with predictors from the 1st year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 for unstandardized coefficients are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

    (PDF)

    S5 Table. Summary of standardized structural coefficients for social influence factors, social influence processes, and integration in the second-year of college (Model 8, N = 751).

    All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients, coefficients in standard text associated with predictors from the pre-college are first-order cross-lagged coefficients, and coefficients associated with predictors from the 1st year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 for unstandardized coefficients are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

    (PDF)

    S6 Table. Summary of standardized structural coefficients for social influence factors, social influence processes, and integration in the third-year of college (Model 8, N = 751).

    All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients, coefficients in standard text associated with predictors from the pre-college are first-order cross-lagged coefficients, and coefficients associated with predictors from the 1st year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 for unstandardized coefficients are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

    (PDF)

    S7 Table. Summary of standardized structural coefficients for social influence factors, social influence processes, and integration in the fourth-year of college (Model 8, N = 751).

    All standardized structural coefficients ascertained from STDXY in Mplus as all variables were continuous. Underlined values represent stability coefficients, coefficients in standard text associated with predictors from the pre-college are first-order cross-lagged coefficients, and coefficients associated with predictors from the 1st year of college are contemporaneous. The B-H FDR procedure was used to determine the statistical significance of all unstandardized coefficients. Based on the FDR procedure, all p-values less than .023 for unstandardized coefficients are reported statistically significant. *p≤.023, **p≤.01, ***p≤.001.

    (PDF)

    S1 File

    (DOCX)

    Attachment

    Submitted filename: PONE-D-20-08469 Review May 2020.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All data and meta-data files are available from the online Dryad database (doi:10.5061/dryad.k98sf7m3k.)


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES