Skip to main content
Journal of Clinical and Translational Science logoLink to Journal of Clinical and Translational Science
. 2020 Sep 22;5(1):e53. doi: 10.1017/cts.2020.547

Measuring organizational mentoring climate: Importance and availability scales

Beth B Tigges 1,, Akshay Sood 2, Nora Dominguez 3, Jonathan M Kurka 4, Orrin B Myers 5, Deborah Helitzer 4
PMCID: PMC8057472  PMID: 33948274

Abstract

Introduction:

Although organizational climate may affect faculty’s mentoring behaviors, there has not been any way to measure that climate. The purpose of this study was to test the reliability and validity of two novel scales to measure organizational mentoring climate importance and availability at two public research universities.

Methods:

We developed 36 content-valid mentoring climate items in four dimensions: Structure, Programs/Activities, Policies/Guidelines, and Values. In total, 355 faculty completed an anonymous, structured, online survey asking about the importance (very important to very unimportant) and availability (no, don’t know, yes) of each of the items. We conducted reliability analyses and construct validity testing using exploratory common factor analysis, principal axis factoring, and oblique rotation.

Results:

The majority of the predominantly female, White non-Hispanic, senior, tenure-track faculty were not currently mentoring another faculty or being mentored. Analyses demonstrated a 15-item solution for both the Organizational Mentoring Climate Importance (OMCI) and the Availability (OMCA) Scales, with three factors each: Organizational Expectations, Mentor–Mentee Relationships, and Resources. Standardized Cronbach alphas ranged from 0.74 to 0.90 for the subscales, and 0.94 (OMCI) and 0.87 (OMCA) for the full scales. Faculty rated all items as somewhat to very important; however, perceived availability was very low ranging from mentor training programs (40%) to guidelines for evaluating mentoring success or managing conflict (2.5%).

Conclusions:

The scales will allow studying of how organizational climate may affect mentoring behavior and whether climate can be changed to improve faculty mentoring outcomes. We provide recommendations for furthering the science of organizational mentoring climate and culture.

Keywords: Faculty mentoring, organizational climate, organizational culture, measurement

Introduction

Evidence suggests that mentoring improves professional outcomes for both faculty mentors and mentees. In descriptive correlational studies, mentorship has been associated with improved mentee productivity [16], promotion [1,2,7], academic self-efficacy [811], likelihood of mentoring others [6], and career satisfaction [1214]. In a systematic review, mentorship has also been linked to personal development, career guidance, and career success [3]. Furthermore, in the only study with a comparison group, mentored faculty’s mean grant dollars and proposal counts were higher than the comparison cohort [15]. Thus, the preponderance of evidence and anecdotal confirmation reveal the implicit impact of mentoring for faculty career development.

Individual faculty behavior, such as serving as a mentor, is likely influenced by individual beliefs, knowledge and actions; social network expectations and behaviors (perceived or real); and characteristics of the organization in which the individual works (Fig. 1) [1619]. Organizational climate is defined as the shared perceptions of and the meaning attached to the policies, practice, and procedures employees experience and the behaviors they observe that are supported, expected, or rewarded [20]. In general, climates arise due to three distinct processes within organizations: exposure to tangible structural characteristics (e.g. committees); practices that lead to the attraction, selection, and retention of people with similar characteristics; and socialization that teaches appropriate behavior [2123]. Organizations do not have single climates; multiple climates co-exist, each related to various organizational processes and strategic outcomes [20]. For example, the climate for safety may be different from the climate for mentoring.

Fig. 1.

Fig. 1.

Individual and organizational influences on mentoring behavior and outcomes (adapted from [17]).

While there are measures of individual outcomes related to research mentoring [24], no reliable and valid scales currently exist for assessing the importance and availability of components of the organizational mentoring climate at research institutions of higher education [16,25]. There is also no information about which components of mentoring climate are relevant to faculty, whether the content or quality of organizational support for mentoring is related to mentoring behavior, and how to measure the impact of climate interventions. The lack of reliable and valid scales to assess the organizational mentoring climate constitutes a critical gap in studying interventions to advance the climate, which is crucial in order to achieve the long-term goal of creating and strengthening a skilled and diverse academic workforce. Our study’s objective was to perform psychometric testing of two novel scales to measure organizational mentoring climate importance and availability at research institutions of higher education.

Materials and Methods

Sample

In this cross-sectional, psychometric study, we invited a study population of 6152 faculty from two public, research-intensive universities in the southwest United States, one with 3195 faculty across main, health sciences, and branch campuses, and the other a university without a medical school with 2957 faculty. A total of 616 (10.0%) surveys were returned; 355 (5.8%) had complete data (defined as answering at least one item near the end of the survey; 8.4% from University #1 and 2.7% from University #2) and constituted the final sample for psychometric analyses. The sample size for the initial 36-item scales was adequate with 5–10 participants per item (per scale) using accepted techniques for sample size calculations for exploratory models of factor analysis when statistical significance is not being tested and the concept of power does not apply [2629].

Procedures

Procedures for instrument development included item development based on the literature and investigators’ experience, the evaluation and rating of content validity, and final administration to faculty to evaluate the reliability and construct validity of the Organizational Mentoring Climate Importance (OMCI) Scale and the Organizational Mentoring Climate Availability (OMCA) Scale.

Item development

We developed 37 mentoring climate items classified in four dimensions: Structure (13 items), Programs/Activities (11 items), Policy/Guidelines (9 items), and Overall Value (4 items). Items in the first three dimensions were based on Keyser and colleagues’ [16] conceptual model of institutional efforts to support academic mentoring. We supplemented those items with additional items from a literature review and our own experiences, particularly with mentoring faculty from under-represented populations.

Content validity

Content validity of the items was determined using established methods [30]. Four independent, nationally-known content experts from the National Research Mentoring Network [31] with expertise in mentoring and mentoring climate (all from outside the institutions where items were developed and construct validity was studied) participated in this phase. The experts separately evaluated whether each item was relevant to the overall conceptual framework of organizational mentoring climate and was related to the dimension in which it was placed in the survey, using an ordinal 4-point rating scale (1 = not relevant; 2 = unable to assess relevance without revision or needs such a revision that it would no longer be relevant; 3 = relevant but needs minor alteration; 4 = very relevant and succinct). Based on the content validity process, 3 of the 37 items were deleted, 2 new items were written, and 8 were modified based on feedback. The remaining 36 items were judged as content valid and retained. The mean content validity scores for the individual items as they related to the overall conceptual framework ranged from 3.25 to 4.0 [32]. The number of items in the developed instrument was consistent with guidelines that an instrument’s initial item pool be composed of 1.5 to 2 times as many items as the final instrument [33].

Instrument testing

We created email distribution lists using faculty rosters from both universities with permission from the appropriate institutional offices and distributed email invitations to participate in the online Research Electronic Data Capture (REDCap) survey [34]. The invitation clearly stated that participation in the study was purely voluntary. Faculty were provided a web-linked option in the email to accept or decline participation. Those who did not decline or complete the survey were sent additional bi-weekly invitations over 4 months using the automated REDCap survey administration feature. Those who started but did not complete the survey were provided a reminder to finish.

The online survey included an IRB-approved informed consent document, with an implicit consent if the participant clicked on the link provided in the email. The link provided access to the anonymous, structured, self-administered REDCap survey. The survey took approximately 20 min to complete. The first scale (OMCI) asked about the importance of 36 items (organizational structures, programs, policies, and values related to mentoring) using 5-point Likert response options ranging from “very important (1)” to “very unimportant (5)” and a neutral midpoint. A sample importance item is: “Rate how important you think the following is to mentoring success, in general, at any institution – An annual award for excellence in mentorship to a faculty member.” The second scale (OMCA), located in a different section of the survey, used the same 36 items but asked respondents about the presence or absence of the item at their college/school/department/division (30 items) or their institution (6 items). Response options were “no (−1),” “don’t know (0),” and “yes (1).” We also included a brief set of demographic questions including gender, race, ethnicity, career stage, institution, faculty track and rank, and experience with mentoring.

Data Analysis

For construct validity testing of both the OMCI and the OMCA Scales, we used exploratory common factor analysis with principal axis factoring and oblique Promax rotation, assuming that each item was composed of both systematic and random measurement error and that factors would be correlated. Because a higher correlation makes it more difficult to interpret the factor structure loadings, delta (δ) was set at −1.0 in SAS software [35] to limit the degree of correlation (obliqueness) between factors to approximately 0.30 [33,36]. Factor extraction followed guidance that extraction be continued until all extracted factors account for at least 90% of the explained variance or until the last factor accounts for only a small portion (<5%) of the explained variance [37], as well as Eigen value and scree plot examination. We examined factor pattern matrices to determine simple structure for both scales as these matrices control for correlation among the factors and are most easily interpreted [37,38]. Criteria for retaining items included (a) rounded loading of ≥0.40 on a given factor; (b) loading is at least 0.10 to 0.15 higher than loading on any other factor; and (c) theoretical considerations.

We assessed internal consistency reliability using Cronbach’s alpha coefficients. We made final decisions about item retention and subscale composition by examining inter-item correlation matrices, average inter-item and item-to-total correlation coefficients, and alpha estimates if the items were dropped [39].

Results

Sample

Table 1 shows the characteristics of the 355 respondents from the two universities. The sample was predominantly female (62.5%), White (76.3%), non-Hispanic (77.5%), and on tenure-track (54.9%) from non-health science campuses (54.2%). In total, 54.6% of the respondents were at senior faculty ranks of Associate or Full Professor, evenly split across the individual ranks. The majority were not involved in a faculty mentoring relationship as mentors (59.7%) or mentees (73%) at the time of the study.

Table 1.

Respondent characteristics (n = 355)

Characteristic n %
Gender
 Female 222 62.5
 Male 110 31.0
 Gender non-binary 5 1.4
 No response 18 5.1
Race
 American Indian 11 3.1
 Asian 15 4.2
 Black 8 2.3
 Native Hawaiian/Pacific Islander 1 0.3
 White 271 76.3
 Other 26 7.3
 No response 23 6.5
Ethnicity
 Hispanic 51 14.4
 Non-Hispanic 275 77.5
 No response 29 8.2
University
 University #1: Health Sciences Campus 156 43.9
 University #1: Main Campus 95 26.8
 University #1: Other 18 5.1
 University #2: Non-health sciences 79 22.3
 No response 7 2.0
Faculty track
 Tenure track 195 54.9
 Clinical educator track 76 21.4
 Lecturer/Instructor/Educator 56 15.8
 Research track 15 4.2
 Flex track 5 1.4
 Other 3 0.8
 No response 5 1.4
Faculty rank
 Instructor 52 14.6
 Assistant Professor 93 26.2
 Associate Professor 98 27.6
 Professor 96 27.0
 Other/No response 16 4.5
Currently mentoring another faculty
 Yes 138 38.9
 No 212 59.7
 No response 5 1.4
Currently being mentored by another faculty
 Yes 91 25.6
 No 259 73.0
 No response 5 1.4

Item Analysis and Descriptive Statistics

Responses for each of the final 15 items (from the 36 initial items) ranged from 1 (very important) to 5 (very unimportant) for the OMCI; and −1 (no) to 0 (don’t know) to 1 (yes) for the OMCA Scales. The means of the individual items for the OMCI Scale (Table 2) ranged from 1.5 to 2.1 (SD = 0.8–1.1), indicating a general perception that all items were at least somewhat important.

Table 2.

Descriptive statistics of 15-item Organizational Mentoring Climate Importance (OMCI) scale, and Organizational Mentoring Climate Availability (OMCA) scale items

Item OMCA Scale2
(n = 352–355)
OMCI Scale1
(n = 347–355)
Available?
M (SD) M (SD) Yes
n (%)
Don’t Know
n (%)
No3
n (%)
1. Promotion and tenure committees evaluate the success of mentoring relationships for promotion to senior faculty 1.8 (1.0) −0.25 (0.77) 71 (20) 125 (35.2) 158 (44.5)
2. Leaders ensure that each senior faculty meets the requirement for mentoring junior faculty 1.7 (1.0) −0.42 (0.76) 58 (16.3) 90 (25.4) 207 (58.3)
3. The requirement that senior faculty will mentor junior faculty is discussed at faculty orientations, meetings and/or evaluations 1.8 (0.9) −0.24 (0.88) 103 (29) 62 (17.5) 189 (53.2)
4. The quality of the mentor–mentee relationship is discussed as part of the annual faculty review process 1.7 (0.9) −0.55 (0.70) 42 (11.8) 77 (21.7) 236 (66.5)
5. Qualifications for mentors are discussed at faculty orientations, meetings, and/or evaluations 1.8 (0.9) −0.65 (0.66) 36 (10.1) 53 (14.9) 266 (74.9)
6. A policy or guidelines that delineate criteria that can be used to evaluate mentoring success 1.7 (0.9) −0.53 (0.54) 8 (2.3) 151 (42.5) 195 (54.9)
7. A committee that reviews mentor qualifications and mentor–mentee assignments 2.1 (1.0) −0.59 (0.63) 27 (7.6) 93 (26.2) 235 (66.2)
8. Mentoring partnership agreements between mentors and mentees are formally documented in writing 2.0 (1.1) −0.52 (0.72) 48 (13.5) 76 (21.4) 231 (65.1)
9. A committee develops criteria for evaluating mentoring relationships 1.9 (1.0) −0.58 (0.54) 8 (2.3) 132 (37.2) 214 (60.3)
10. A policy or guidelines about managing conflict in the mentor–mentee relationship 1.9 (1.0) −0.47 (0.55) 9 (2.5) 168 (47.3) 175 (49.3)
11. A committee for hearing and adjudicating mentor–mentee conflicts 2.0 (1.0) −0.45 (0.57) 14 (3.9) 168 (47.3) 173 (48.7)
12. A mentor training program 1.5 (0.8) 0.12 (0.82) 141 (39.7) 114 (32.1) 100 (28.2)
13. Mentorship training materials are available 1.5 (0.8) 0.16 (0.74) 130 (36.6) 150 (42.3) 74 (20.8)
14. An Office of Diversity (or equivalent) that helps to facilitate relationships between mentors and under-represented minority faculty 1.8 (1.0) −0.13 (0.61) 46 (13.0) 216 (60.8) 93 (26.2)
15. A policy or guidelines that all faculty will have access to training in unconscious bias 1.7 (1.0) −0.05 (0.76) 93 (26.2) 148 (41.7) 112 (31.5)
1

Rate how important you think each of the following are to mentoring success, in general, at any institution. Responses: 1 = Very important; 2 = Somewhat important; 3 = Neither important nor unimportant; 4 = Somewhat unimportant; 5 = Very unimportant.

2

Available at my college/school/department/division (items 1–11) or institution (items 12–15). Responses: −1 = No; 0 = Unsure; 1 = Yes.

3

Remaining percentages to equal 100% from those who did not respond (only 0–3 respondents).

For the OMCA Scale, the means ranged from −0.65 to 0.16 (SD = 0.54–0.88), indicating that the perceived availability of the 15 items was generally low. At one extreme, 39.7% of respondents reported that their institution had a mentor training program, 36.6% had mentorship training materials, 29% discussed mentoring requirements at meetings, and 26.2% had a policy or guideline providing access to unconscious bias training for all faculty. On the other extreme, only 2.5% reported any type of policy or guideline to manage conflict in the mentor–mentee relationship; furthermore, as little as 2.3% reported the availability of either a policy or a committee delineating the criteria to evaluate mentoring success. In total, 14.9% to 60.8% of respondents reported that they did not know about availability of the 15 items.

Exploratory Factor Analysis

Matrix analysis demonstrated that factor analysis was appropriate to evaluate the data for both the OMCI and OMCA items. For the OMCI Scale, the Kaiser–Meyer–Olkin measure of sampling adequacy (MSA) was 0.95 and all MSAs for the individual items were higher than 0.90. For the OMCA Scale, the Kaiser–Meyer–Olkin MSA was 0.88 and all MSAs for the individual items were greater than 0.82.

We wanted to develop two parallel scales (OMCI and OMCA) with identical items for administration and interpretation ease. Our analysis began with 36 importance items. After examination of the correlation matrices, we dropped eight items highly correlated (r > 0.79) with similar items. Initial principal axis factor analysis with oblique rotation of the remaining 28 items suggested a three-factor solution and resulted in the elimination of four items with weak loadings (<0.40) and two items with cross-loadings separated ≤0.10 on two different factors. All six deleted items had other retained items with similar content.

We conducted factor analysis, using a three-factor solution, of the 22 OMCA items corresponding to the 22 remaining OMCI scale items to ascertain whether there was a similar factor structure for the two scales. Fifteen OMCA items loaded identically to the same OMCI scale items, resulting in the final two 15-item scales presented in this paper. Of the final seven items dropped from both scales based on the OMCA analysis, one item did not load on any factor, two had cross-loadings, and four loaded on different factors than the OMCI analysis. All seven deleted items had other retained items with similar content.

The final exploratory analyses showed a three-factor solution for each of the two scales that explained 94% and 88% of the variance for the OMCI and OMCA Scales, respectively. Table 3 shows the final factor pattern matrices for the 15-item scales and their three subscales: Organizational Expectations, Mentor–Mentee Relationships, and Resources. Loadings are similar to partial standardized regression coefficients in multiple regression.

Table 3.

Oblique rotated (PROMAX) factor pattern matrices, means, standard deviations and standardized Cronbach alpha reliabilities for 15-item Organizational Mentoring Climate Importance (OMCI) and Availability (OMCA) scales and subscales

Subscales and items OMCI scale subscales/Factor loadings OMCA scale subscales/Factor loadings
M (SD) = 1.8 (0.7); Alpha = 0.94 M (SD) = −0.34 (0.41); Alpha = 0.87
Organizational expectation Mentor–mentee relationships Resources Organizational expectation Mentor–mentee relationships Resources
M (SD) = 1.8 (0.8); Alpha = 0.88 M (SD) = 1.9 (0.8); Alpha = 0.90 M (SD) = 1.6 (0.8); Alpha = 0.84 M (SD) = −0.42 (0.53); Alpha = 0.74 M (SD) = −0.52 (0.44); Alpha = 0.84 M (SD) = 0.02 (0.55); Alpha = 0.74
Organizational expectations subscale (five items)
 Promotion and tenure committees evaluate the success of mentoring relationships for promotion to senior faculty 0.81 0.42
 Leaders ensure that each senior faculty meets the requirement for mentoring junior faculty 0.67 0.46
 The requirement that senior faculty will mentor junior faculty is discussed at faculty orientations, meetings and/or evaluations 0.60 0.69
 The quality of the mentor–mentee relationship is discussed as part of the annual faculty review process 0.62 0.38
 Qualifications for mentors are discussed at faculty orientations, meetings, and/or evaluations 0.57 0.46
Mentor–mentee relationships subscale (six items)
 A policy or guidelines that delineate criteria that can be used to evaluate mentoring success 0.44 0.66
 A committee that reviews mentor qualifications and mentor-mentee assignments 0.58 0.63
 Mentoring partnership agreements between mentors and mentees are formally documented in writing 0.39 0.38
 A committee develops criteria for evaluating mentoring relationships 0.66 0.71
 A policy or guidelines about managing conflict in the mentor–mentee relationship 0.69 0.75
 A committee for hearing and adjudicating mentor–mentee conflicts 0.68 0.67
Resources subscale (four items)
 A mentor training program 0.43 0.57
 Mentorship training materials are available 0.59 0.85
 An Office of Diversity (or equivalent) that helps to facilitate relationships between mentors and under-represented minority faculty 0.63 0.53
 A policy or guidelines that all faculty will have access to training in unconscious bias 0.73 0.50

Internal Consistency Reliability

Table 3 shows the means, standard deviations, and standardized Cronbach alpha internal consistency reliabilities for the two scales and their three subscales. Cronbach alpha values ranged from 0.74 to 0.90 for the subscales, a very acceptable range for newly developed instruments [26,33]. Cronbach alpha values for the full 15-item OMCI and OMCA Scales were 0.94 and 0.87, respectively.

Discussion

For decades, faculty at research institutions of higher education have contended that mentoring is critical to faculty success [17,18,25,31]. Although organizational climate may affect faculty’s mentoring behaviors, until now, there has not been a research-based instrument to measure organizational mentoring climate. The results of this study provide evidence of the preliminary reliability and validity for the newly developed OMCI and OMCA Scales designed to measure the importance and availability of critical organizational structures, programs, and policies related to mentoring. Measures like these are essential for studying whether organizational climate is associated with mentoring behavior and if so, what interventions might be effective in changing the organizational mentoring climate.

We chose the items in this study based on the literature and our experience-based hypotheses about which organizational characteristics are important for mentoring climate; we empirically tested these items with faculty to determine perceived importance and availability. Based on this data, we posit that organizations that desire to have a positive organizational mentoring climate should invest in elements in three areas: organizational expectations related to mentoring involvement, guidance in formalizing the mentor–mentee relationship, and concrete resources to support mentoring. These investments would entail creating explicit expectations for senior faculty’s engagement in mentoring relationships with junior faculty; establishing opportunities for the regular discussion of specific qualifications to be an effective mentor; implementing structures for the frequent examination of the quality of the relationships; and including mentoring success as a criterion for tenure and promotion. There is a need to formalize the mentor–mentee relationship by assessing the mentors’ qualifications and mentor–mentees’ assignments; establishing the criteria to evaluate the success of the relationship; and, providing guidance and structures for managing conflict between mentors and mentees. Finally, mentor training is a major initiative identified for improving mentoring in academia [17,40] and the results of this study support that emphasis; mentor training programs and materials are identified as concrete resource components of organizational mentoring climate. Resources to support mentoring of under-represented groups are also crucial [41,42].

There is a glaring discrepancy between the perceived importance of all organizational mentoring climate characteristics and their actual availability. What is considered important is often not available. These data suggest that research institutions of higher education may be slightly better in providing concrete resources than setting explicit expectations or formalizing mentor–mentee relationships. Even if one assumes that some of the respondents did not know that specific resources are available at their institution, the lack of awareness in itself is a concern. Further study is indicated to determine the accuracy of faculty’s perceptions of institutional mentoring supports relative to the actual availability of those resources. However, the results from this study are consistent with other reports demonstrating that less than half of the studied universities or departments require mentoring for faculty promotion [5,43]; have formal mentor training [43,44]; or have criteria to qualify as a mentor, stated mentor responsibilities, mentor/mentee written agreements, or guidelines for conflict management [44]. It is not surprising then that nearly two-thirds of faculty report that they are not currently involved in mentoring relationships with other faculty [43]. Only one-third to one-half of faculty report having a mentor; in some fields, the prevalence is as low as 20% [3,11,12,45], and overall, less than half of the faculty surveyed have had sustained, influential mentoring relationships [6].

Based on the results of this study, we offer several recommendations for advancing the science of faculty mentoring. First, we found beginning support for the reliability, content, and construct validity of the newly developed OMCI and OMCA Scales; however, construct validity must be further developed with additional diverse faculty samples from multiple institutions, using confirmatory factor analysis to test for evidence of replicated factor structure. Test–retest reliability, convergent, and discriminant validity must also be explored.

Second, we need to assess whether activities that address specific gaps in organizational mentoring climate impact faculty mentoring success and whether our measures of mentoring climate are sensitive or responsive to organizational interventions designed to improve that climate. Little agreement exists about organizational characteristics that will encourage, improve, or reward faculty mentoring behavior and relationships [16,25,44]. In studies of climates other than mentoring, not all demonstrate a significant moderator effect for climate strength in predicting outcomes, so merely counting the number of available mentoring climate items at an institution may be inadequate [20]. We may need to explore more complex causal models related to desired outcomes (see Fig. 1).

Third, consistent with existing measures of organizational climate, the scales measure individual faculty’s perceptions of the mentoring climate; however, there may be aggregate effects, such as school- or department-, or division-level effects, that are different from the individual. Microclimate or the climate of the organization most proximal to an individual may be more important than the climate of the overall parent organization. In this study, we asked participants to focus on the level most relevant to them when answering questions related to availability. Items in the availability scale that were linked to the college/school/department/division levels rather than the institutional level (the resource items) were also items with the highest ratings on the importance scale. We recommend that future studies pay attention to the level at which the mentoring climate is measured. Examination of inter-rater agreement, including both within and between-group inter-rater reliability in future studies would provide support for aggregation of individual perceptions into group or organizational levels of analysis [20]. Studies using multilevel modeling are ultimately necessary to discriminate between individual, dyadic, group, and organizational influences on mentoring behavior.

Finally, while there is some debate, we need to carefully consider whether or not organizational mentoring climate is the same as mentoring culture. Culture is defined as: “the shared values and basic assumptions that explain why organizations do what they do and focus on what they focus on; it exists at a fundamental, perhaps preconscious level of awareness that is grounded in history and tradition” (p. 468) [46]. In this study, we made a distinction between organizational climate and organizational culture related to mentoring. Organizational climate includes factors that are more visible and easier to assess and change. In contrast, organizational culture includes the unspoken rules, values, and beliefs that may influence faculty behavior and engagement [20,25,46]. Organizational mentoring culture is likely initiated and reinforced by the organizational climate – the structures, programs, and policies related to mentoring. In this study, the four values items developed in the content validity phase did not load in the final factor analyses; this suggests that either they were integral to the final remaining items and did not contribute unique variance or that they represented some other incompletely measured construct such as organizational culture. Organizational leaders play a crucial role in establishing and reinforcing a values-based organizational culture [21], and it is likely that both the climate and culture set the tone for the importance, value, rewards, and consequences of mentoring [18,45,47,48].

This study has several limitations. First, although we sent multiple email invitations, only a small number of potential participants responded to the survey. Despite that, the number of participants was sufficient to do the planned psychometric testing. Psychometric studies typically require 1.5–2 times as many initial items as the items in the final instruments [33]. Our survey was lengthy due to the need to test 36 items for two different scales. The possibility that length may have affected response is based on the observation that while 616 (10%) of surveys were returned, only 355 (5.8%) respondents completed an item toward the end of the survey and were usable. In addition, response was highest at the lead investigator’s institution (8.4% vs. 2.7%). We anticipate that shorter surveys (15-item scales), ideally sent from an investigator affiliated with the study university, would improve response rates in the future.

In addition, respondents were predominantly female (62.5%), White (76.3%), non-Hispanic (77.5%), and slightly more than half were on the tenure-track (54.9%). Female, Whites, and Hispanics on the tenure-track were over-represented in the sample when compared to the university populations. (For comparison, University 1: 50.8% female, 62.8% White, 85.6% non-Hispanic, 31.3% tenure-track [49]; University 2: 45.4% female, 73.2% White, 92.4% non-Hispanic, 42.1% tenure-track [50,51]). Just as construct validity of the scales must be tested in additional samples, future subgroup analyses are warranted to determine if perceptions of climate are the same across different demographic and professional groups. One could speculate that female, Whites, or Hispanics on the tenure-track may be more likely to respond to a survey about, and have heightened interest in, mentoring climate when compared to individuals in other groups. Finally, some respondents may have had limited knowledge about certain organizational characteristics related to mentoring, possibly reflecting the relatively high number of “I don’t know” responses. This perceived limited availability may reveal either a lack of high-level initiatives or designated leadership support for the promotion of mentoring activities at the institution.

Conclusions

This research addresses a new area of science, the study of organizational mentoring climate in universities. For the first time, there are self-report scales that may be used to describe and quantify both the availability of and perceptions about the importance of specific mentoring structures, programs, and policies; this will allow further studies about how organizational mentoring climate may affect mentor–mentee behavior and whether it is possible to change organizational mentoring climate to improve faculty mentoring outcomes.

Changing the organizational mentoring climate is not easy; however, it could have important ramifications for faculty development and sustainability, particularly the career advancement of individuals from under-represented groups [25]. Change requires a shared vision, energetic change agents, significant long-term support from institutional leaders, and widespread buy-in from all faculty. A healthy organizational mentoring climate is essential for achieving the long-term goal of a skilled and diverse academic workforce.

Acknowledgements

This study was supported by a University of New Mexico School of Medicine Research Allocation Committee grant; the U.S. National Institutes of Health, National Institute of General Medical Sciences, Grant Number U01 GM132175; and the U.S. National Institutes of Health, National Center for Advancing Translational Sciences, Grant Number UL1 TR001449.

Disclosures

The authors have no conflicts of interest to declare.

References

  • 1. Bertram A, et al. How we developed the GIM clinician-educator mentoring and scholarship program to assist faculty with promotion and scholarly work. Medical Teacher 2015; 37: 131–135. [DOI] [PubMed] [Google Scholar]
  • 2. Lach HW, et al. The challenges and benefits of distance mentoring. Journal of Professional Nursing 2013; 29: 39–48. [Google Scholar]
  • 3. Sambunjak D, Straus SE, Marusic A. Mentoring in academic medicine: A systematic review. Journal of the American Medical Association 2006; 296(9): 1103–1115. [DOI] [PubMed] [Google Scholar]
  • 4. Shaw KB, et al. The Oregon Center for Complementary and Alternative Medicine career development program: Innovation in research training for complementary and alternative medicine. Teaching and Learning in Medicine 2003; 15: 45–51. [DOI] [PubMed] [Google Scholar]
  • 5. Shea JA, et al. Career development of physician scientists: A survey of leaders in academic medicine. American Journal of Medicine 2011; 124(8): 779–787. [DOI] [PubMed] [Google Scholar]
  • 6. Steiner JF, et al. Assessing the role of influential mentors in the research development of primary care fellows. Academic Medicine 2004; 79(9): 865–872. [DOI] [PubMed] [Google Scholar]
  • 7. Buch K, et al. Removing the barriers to full professor: A mentoring program for associate professors. Change: The Magazine of Higher Learning 2011; 43(6): 38–45. [Google Scholar]
  • 8. Feldman MD, et al. Does mentoring matter: Results from a survey of faculty mentees at a large health sciences university. Medical Education Online 2010; 15: 5063. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Garman KA, Wingard DL, Reznik V. Development of junior faculty’s self-efficacy: Outcomes of a national center of leadership in academic medicine. Academic Medicine 2001; 76(10): S74–S76. [DOI] [PubMed] [Google Scholar]
  • 10. Herbert JL, et al. Consultancies: A model for interdisciplinary training and mentoring of junior faculty investigators. Academic Medicine 2011; 86: 866–871. [DOI] [PubMed] [Google Scholar]
  • 11. Palepu A, et al. Junior faculty members’ mentoring relationships and their professional development in U.S. medical schools. Academic Medicine 1998; 73: 318–323. [DOI] [PubMed] [Google Scholar]
  • 12. Chung CE, Kowalski S. Job stress, mentoring, psychological empowerment and job satisfaction among nursing faculty. Journal of Nursing Education 2012; 51(7): 381–388. [DOI] [PubMed] [Google Scholar]
  • 13. Mahoney MR, et al. Minority faculty voices on diversity in academic medicine: Perspectives from one school. Academic Medicine 2008; 83(8): 781–786. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. August L, Waltman J. Cultural, climate, and contribution: Career satisfaction among female faculty. Research in Higher Education 2004; 45(2): 177–192. [Google Scholar]
  • 15. Libby AM, et al. Grant success for early-career faculty in patient-oriented research: Difference-in-differences evaluation of an interdisciplinary mentored research training program. Academic Medicine 2016; 91: 1666–1675. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Keyser DJ, et al. Advancing institutional efforts to support research mentorship: a conceptual framework and self-assessment tool. Academic Medicine 2008; 83(3): 217–225. [DOI] [PubMed] [Google Scholar]
  • 17. Sood A, Tigges B, Helitzer D. Mentoring early career faculty researchers is important—but first “train the trainer”. Academic Medicine 2016; 91(12): 1598–1600. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Steiner JF. Promoting mentorship in translational research: Should we hope for Athena or train mentor? Academic Medicine 2014; 89: 702–704. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Zachary LJ. Creating a Mentoring Culture: The Organization’s Guide. Hoboken, NJ: John Wiley and Sons, 2011. [Google Scholar]
  • 20. Schneider B, Ehrhart MG, Macey WH. Organizational climate and culture. Annual Review of Psychology 2013; 64: 361–388. [DOI] [PubMed] [Google Scholar]
  • 21. Grojean MW, Resick CJ, Dickson MW. Leaders, values, and organizational climate: Examining leadership strategies for establishing an organizational climate regarding ethics. Journal of Business Ethics 2004; 55(3): 223–241. [Google Scholar]
  • 22. Schneider B, Reichers A. On the etiology of climates. Personnel Psychology 1983; 36: 19–39. [Google Scholar]
  • 23. Schneider B. The people make the place. Personnel Psychology 1987; 40: 437–453. [Google Scholar]
  • 24. Fleming M, et al. The Mentoring Competency Assessment: Validations of a new instrument to evaluate the skills of research mentors. Academic Medicine 2013; 88(7): 1002–1008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. National Academies of Sciences, Engineering, and Medicine. The Science of Effective Mentorship in STEMM. Washington, DC: The National Academies Press, 2019. [PubMed] [Google Scholar]
  • 26. DeVellis RF. Scale Development (2nd ed.). Thousand Oaks, CA: Sage, 2003. [Google Scholar]
  • 27. Comrey AL. Factor-analytic methods of scale development in personality and clinical psychology. Journal of Consulting and Clinical Psychology 1988; 56(5): 754–761. [DOI] [PubMed] [Google Scholar]
  • 28. MacCallum RC, et al. Sample size in factor analysis. Psychological Methods 1999; 4: 84–99. [Google Scholar]
  • 29. Tinsley HEA, Tinsley DJ. Use of factor analysis in counseling psychology research. Journal of Counseling Psychology 1987; 34: 414–424. [Google Scholar]
  • 30. Lynn MR. Determination and quantification of content validity. Nursing Research 1986; 35(6): 382–385. [PubMed] [Google Scholar]
  • 31. Sorkness CA, et al. A new approach to mentoring for research careers: the National Research Mentoring Network. BMC Proceedings 2017; 11(Suppl 12): 22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Sood A, Tigges B, Helitzer D. Validating an institutional mentoring climate survey at a health sciences center. The Chronicle of Mentoring and Coaching 2017; 1(Special Issue 10): 817–820. [PMC free article] [PubMed] [Google Scholar]
  • 33. Nunnally JC, Bernstein IH. Psychometric Theory (3rd ed.). New York: McGraw-Hill Inc., 1994. [Google Scholar]
  • 34. Harris PA, et al. Research electronic data capture (REDCap) – A metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics 2009; 42(2): 377–381. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. SAS Software, Version 9.4. Cary, NC: SAS Institute Inc., 2013.
  • 36. Pett MA, Lackey NR, Sullivan JJ. Making Sense of Factor Analysis. Thousand Oaks, CA: Sage, 2003. [Google Scholar]
  • 37. Hair JF, et al. Multivariate Data Analysis with Readings (4th ed.). Englewood Cliffs, NJ: Prentice Hall, 1995. [Google Scholar]
  • 38. Tabachnick BG, Fidell LS. Using Multivariate Statistics (4th ed.). Boston, MA: Allyn & Bacon, 2001. [Google Scholar]
  • 39. Ferketich S. Aspects of item analysis. Research in Nursing & Health 1991; 14: 165–168. [DOI] [PubMed] [Google Scholar]
  • 40. Pfund C, et al. Training mentors of clinical and translational research scholars: A randomized controlled trial. Academic Medicine 2014; 89(5): 774–782. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Gibson SK. Mentoring of women faculty: The role of organizational politics and culture. Innovative Higher Education 2006; 31(1). 10.1007/s10755-006-9007-7. [DOI] [Google Scholar]
  • 42. Pololi L, Cooper LA, Carr P. Race, disadvantage and faculty experiences in academic medicine. Journal of General Internal Medicine 2010, 25(12): 1363–1369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Stolzenberg EB, et al. Undergraduate Teaching Faculty: The HERI Faculty Survey 2016–2017. Los Angeles, CA: Higher Education Research Institute, UCLA, 2019. [Google Scholar]
  • 44. Tillman RE, et al. Policies, activities, and structures supporting research mentoring: A national survey of academic health centers with Clinical and Translational Science Awards. Academic Medicine 2013; 88: 90–96. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Ramanan RA, et al. Mentoring in medicine: Keys to satisfaction. American Journal of Medicine 2002; 112: 336–340. [DOI] [PubMed] [Google Scholar]
  • 46. Schneider B, et al. Organizational climate and culture: Reflections of the history of the constructs in the Journal of Applied Psychology. Journal of Applied Psychology 2017; 102(3): 468–482. [DOI] [PubMed] [Google Scholar]
  • 47. Castellanos J, et al. Mentoring matters: Racial ethnic minority undergradutates’ cultural fit, mentorship, and college and life satisfaction. Journal of College Reading and Learning 2016; 46(2): 81–98. [Google Scholar]
  • 48. Chandler DE, Kram KE, Yip J. An ecological systems perspective on mentoring at work: A review and future prospects. Academy of Management Annals 2017; 5: 1. 10.5465/19416520.2011.576087. [DOI] [Google Scholar]
  • 49. University of New Mexico [Internet]. Albuquerque: University of New Mexico, c2019. (https://public.tableau.com/profile/unm.oia#!/)
  • 50. Arizona State University [Internet]. Phoenix: Arizona State University, c2019. (https://uoia.asu.edu/sites/default/files/facts_at_a_glance_fall_2019.pdf)
  • 51. Arizona State University [Internet]. Phoenix: Arizona State University, c2019. (https://uoia.asu.edu/sites/default/files/asu_total_2006-2016_to_post.pdf)

Articles from Journal of Clinical and Translational Science are provided here courtesy of Cambridge University Press

RESOURCES