Abstract
Background
There has been limited research on the positive aspects of physician wellness and to our knowledge there have been no validity studies on measures of resilience and grit among internal medicine (IM) residents.
Objectives
To investigate the validity of resilience (10 items Connor-Davidson Resilience Scale (CD-RISC 10)) and grit (Short Grit Scale (GRIT-S)) scores among IM residents at a large academic centre, and assess potential associations with previously validated measures of medical knowledge, clinical performance and professionalism.
Methods
We evaluated CD-RISC 10 and GRIT-S instrument scores among IM residents at the Mayo Clinic Rochester, Minnesota between July 2017 and June 2019. We analysed dimensionality, internal consistency reliability and criterion validity in terms of relationships between resilience and grit, with standardised measures of residents’ medical knowledge (in-training examination (ITE)), clinical performance (faculty and peer evaluations and Mini-Clinical Evaluation Examination (mini-CEX)) and professionalism/dutifulness (conference attendance and evaluation completion).
Results
A total of 213 out of 253 (84.2%) survey-eligible IM residents provided both CD-RISC 10 and GRIT-S survey responses. Internal consistency reliability (Cronbach alpha) was excellent for CD-RISC 10 (0.93) and GRIT-S (0.82) overall, and for the GRIT subscales of consistency of interest (0.84) and perseverance of effort (0.71). CD-RISC 10 scores were negatively associated with ITE percentile (β=−3.4, 95% CI −6.2 to −0.5, p=0.02) and mini-CEX (β=−0.2, 95% CI −0.5 to −0.02, p=0.03). GRIT-S scores were positively associated with evaluation completion percentage (β=2.51, 95% CI 0.35 to 4.67, p=0.02) and conference attendance (β=2.70, 95% CI 0.11 to 5.29, p=0.04).
Conclusions
This study revealed favourable validity evidence for CD-RISC 10 and GRIT-S among IM residents. Residents demonstrated resilience within a competitive training environment despite less favourable test performance and grittiness that was manifested by completing tasks. This initial validity study provides a foundation for further research on resilience and grit among physicians in training.
Keywords: internal medicine, medical education & training, statistics & research methods
Strengths and limitations of this study.
This is the first validity study of 10-item Connor-Davidson Resilience Scale 10 and Short Grit Scale scores among internal medicine (IM) residents for resilience and grit respectively, and was completed at a large academic centre in the USA.
This study evaluated the dimensionality, internal consistency reliability and the criterion validity of these two measures among IM residents.
This study provides a foundation for further research on resilience and grit among physicians in training.
This was an observational study, which limits the ability to draw causal inferences about the relationships found.
The analysis did not adjust for resident age, gender or international versus US medical graduation status, as they are non-modifiable variables in terms of career development and enhancing residency curricula.
Background
The prevalence of physician burn-out in the USA is estimated to be approximately 50% among physicians in training1–4 and practising physicians.5–7 Notably, burn-out rates are higher for physicians than other professionals even after adjusting for work hours.8 9 It is unclear why burn-out rates are higher in certain residency programmes and among particular individuals within the same clinical settings.10 Since burn-out seems to begin during medical school,3 11 tackling this problem at earlier stages could help mitigate its consequences later. Furthermore, although there has been much research on correlates of burn-out,12 there is limited research on the positive aspects of physician wellness and very little known about resilience and grit among internal medicine (IM) residents.
The American Psychological Association describes resilience as adapting effectively to stressors such as relationship problems, serious health issues or workplace and financial challenges.13 That is, resilience is the capacity to respond to adversity such that goals are achieved at minimal psychological and physical cost. Essentially, resilient individuals ‘bounce back’ after challenges while also growing stronger.14 Although several models of resilience have evolved over the years,15 the dominant paradigm of resilience is dynamic, linking neurobiology, behaviour and environmental conditions.16 Resilience is considered essential for enhancing quality of medical care, empathy for patients and sustainability of the healthcare workforce as a whole.14 Moreover, low resilience may impair brain function, even resulting in post-traumatic stress disorder, depression and other psychiatric disorders.17 Yet, most people do not develop such conditions after experiencing difficult life events and are thus considered to be ‘resilient’. Resilience as a successful adaptation relies on effective responses to environmental challenges and, ultimately, resistance to the harmful effects of stress.18 Therefore, a greater understanding of the factors that promote resilience is critical.19
The most widely used assessment of resilience is the Connor-Davidson Resilience Scale (CD-RISC). Use of the CD-RISC has shown that resilience is modifiable and can be improved. A shorter version of this scale, which has similar psychometric properties, is the CD-RISC 10.20 Evidence based on the use of this assessment measure suggests that resilience can be promoted in healthcare workplaces,21 although research on physicians is scarce.
Grit is defined as the perseverance and passion for long-term goals.22–24 Rather than avoidance and shying away, grit means working towards achieving specific outcomes despite difficulty, failure or adversity.25 Individuals who remain focused on a goal or task and see it through to satisfactory completion would be described as ‘gritty’.26 Grit is a predictor of success in stressful, high-achievement fields including, but not limited to, surgical residency,27–29 emergency residency,30 military23 and pharmacy.31 The original Grit Scale (Grit-O) consists of 12 items, each rated on a 5-point scale,1–5 classified under two main domains: (1) consistency of interest and (2) perseverance of effort, with six elements each.22 Subsequently, an abbreviated (8-question) scale with improved psychometric properties was developed by the same investigators to measure trait-level perseverance and passion for long-term goals (Short Grit Scale, Grit-S).23
Although there has been ample research on relationships between burn-out and various aspects of professionalism and clinical performance among resident physicians,32–36 to our knowledge the CD-RISC 10 and Grit-S scales have not been previously validated in US IM residents. Furthermore, there remains the need for further research on positive aspects of physician wellness—such as resilience and grit—which may serve to counterbalance burn-out.
In this study, we assessed the validity of CD-RISC 10 and Grit-S scores among IM residents at a large academic medical centre. Additionally, we examined associations between resident resilience and grit based on CD-RISC 10 and Grit-S scores, respectively, with previously standardised measures of medical knowledge (the in-training examination (ITE)), professionalism (dutifulness based on conference attendance and evaluation completion) and clinical performance (validated, multisource, clinical performance evaluations).
Methods
Study design and sample
This was a longitudinal cohort study of IM residents training at Mayo Clinic Rochester between July 2017 and June 2019 who were invited to participate in the Mayo Internal Medicine Well-Being (IMWELL) Study. We used existing survey data from the IMWELL study in addition to administrative data collected routinely on IM residents at Mayo Clinic in Rochester, Minnesota, USA.
The Mayo IMWELL study
The prospective, longitudinal, Mayo IMWELL study was initiated in 2003 to evaluate IM residents’ burn-out, quality of life and empathy, along with other measures of well-being.37–40 Enrolment is voluntary and is offered during the orientation of all new interns (categorical and preliminary) in the IM residency programme. Incentives were not given. For the time frame between July 2017 and June 2019, 253 residents were eligible to be enrolled as participants and were surveyed twice per year. An additional survey was sent each spring to graduating categorical residents. Identities of participants were anonymised during data collection and before analysis using numerical codes. The CD-RISC 10 and Grit-S instruments were added to the IMWELL study surveys starting July 2017. The CD-RISC 10 and Grit-S scores from the IMWELL study for each resident were merged with each resident’s residency performance metrics during the subsequent 6 months (July to December or January to June) on the other relevant instruments described below.
Validity evidence
The validity argument for this study was based on a modern approach to validity which states that all validity is construct validity, and that validity evidence is gathered from the categories of content, internal structure, relations to other variables, response process and consequences.41 Content refers to relationships between an assessment’s wording and the construct that it purportedly measures. Internal structure refers to the degree to which instrument items fit the underlying construct and is often reported in terms of dimensionality and reliability. Relations to other variables evidence is the relationship between scores and other variables relevant to the construct being measured, such that the relationships may be positive or negative depending on the constructs being measured.42 Notably, research has indicated that commonly reported categories of validity evidence among education research studies come from the categories of content, internal structure and relations to other variables.42
Instruments and scales used
Short Grit Scale
An 8-item assessment, each rated on a 5-point scale (1=Not like me at all, 2=Not much like me, 3=Somewhat like me, 4=Mostly like me, 5=Very much like me), covering two factors,23 that measures trait-level perseverance and passion for long-term goals. It has four fewer items than the Original Grit Scale (Grit-O)22 with improved psychometric properties. The Short Grit (Grit-S) scale is a brief version of the original 12-item Grit-O scale. Previous studies have shown that it has predictive validity, consensual validity and test–retest stability. Factor analysis, and later confirmatory factor analysis, has supported a two-factor structure of the scale reflecting ‘consistency of interest’ and ‘perseverance of effort’. Both factors showed adequate internal consistency reliability.23
10 item Connor-Davidson Resilience Scale
An assessment consisting of 10 items, rated on a 5-point scales (0=Not true at all, 1=Rarely true, 2=Sometimes true, 3=Often true, 4=True nearly all of the time), with higher scores indicating greater resilience.43 It has ability to distinguish between those with greater and lesser resilience levels, and to demonstrate that resilience is modifiable and can be improved. The reliability and validity of the CD-RISC were previously evaluated and performed well in other settings. Factor analysis revealed five factors for the CD-RISC scale.43 CD-RISC 10 is a 10-item version of this scale with good internal consistency and evidence to support construct validity.20 Further validation studies have shown excellent performance of the CD-RISC 10 among the general population44 and trainees in the US Air Force.45
Knowledge measures
This included In-Training Examination (ITE) score percentiles. The ITE is administered to all US IM residents annually. Residents in this study were administered the ITE annually each fall. Validity of the ITE scores has been established in several studies.46 47
Professionalism and dutifulness measures
This included conference attendance and evaluation completion, which were reported as relations to variables validity evidence in our previous studies of residents at the Mayo Clinic.48 Conference attendance was assessed using in-person card-swipe data. Evaluation completion percentage was determined from the MedHub residency evaluation system for our study’s time frame.
Clinical performance
We selected clinical performance measures as association variables for this study, because we believed that standardised assessments of performance are among the most rigorous challenges for testing residents’ resilience and grit. Clinical performance was determined by faculty and peer evaluations and the standardised Mini Clinical Evaluation Examination (Mini-CEX).49 50 The Mini-CEX evaluates core clinical skills by trainees, namely medical interviewing, physical examination, informed decision-making/counselling and clinical judgement/reasoning. The Mini-CEX has demonstrated validity evidence among IM residents.49–52 The mini-CEX used at Mayo Clinic Rochester incorporates a 5-point scale. Multisource assessments of residents’ clinical performance at Mayo Clinic Rochester are completed by faculty, peers and senior medical residents. Items within these clinical performance assessments have shown multidimensionality and excellent internal consistency reliability.53 54 The clinical performance evaluations (peer evaluations, faculty evaluations and mini-CEX ratings) are administered by the residency evaluation platform, MedHub. Aggregate reports of evaluations can be obtained by time frame of interest, with all assessments standardised to a score in the range of 0–10.
Data analysis
Participants’ demographics were summarised using descriptive statistics. Continuous variables such as age were summarised as mean (SD). Nominal variables, such as gender, were reported using a count (percent of total). Only fully completed Grit-S and CD-RISC 10 instruments were included in the analysis. A threshold of p<0.05 was used to determine statistical significance. Statistical analyses were conducted using SAS V.9.4 (SAS Institute).
Validation of the CD-RISC 10 and Grit-S Scales among IM residents
It has been recommended to re-examine the validity of assessments when applying them to new contexts and educational settings.55 Therefore, we evaluated the internal structure validity of the CD-RISC 10 and Grit-S for this study as follows:
Factor analyses of the CD-RISC 10 and Grit-S instruments were done using principal components analysis with a minimum eigenvalue of 1 criterion. An orthogonal Varimax rotation was used to estimate item loadings. Items with factor loadings of 0.48 or more were retained.56 Internal consistency reliabilities for items comprising each factor and overall were determined using Cronbach alpha, where alpha >0.7 was considered acceptable.56 Scale values were reversed for the ‘Consistency of Interest’ factor items of Grit-S (1, 3, 5 and 6) so that 1=very much like me, 2=mostly like me, 3=somewhat like me, 4=not much like me, 5=not like me at all, so that higher item scores reflect increased ‘Grit’.
Criterion validity (relations to other variables): Unadjusted bivariate associative analyses used generalised linear models with normal response distributions and identity link functions estimated via generalised estimating equations with an exchangeable covariance matrix. The CD-RISC 10 and Grit-S scores were treated as the explanatory variables, and residency performance in the various metrics during the subsequent 6 months were the outcome variables.
Patient and public involvement
Patients and the public were not involved in this research study.
Results
Sample characteristics
From a total of 253 eligible IM residents training at Mayo Clinic Rochester between July 2017 and June 2019, 213 (84.2%) completed at least 1 IMWELL survey, resulting in 468 completed CD-RISC 10 and 472 Grit-S surveys from a total of 801 possible surveys. A total of 461 IMWELL surveys included complete responses for both scales. The distributions of overall scores were assessed visually, with Grit-S appearing approximately normal and CD-RISC 10 displaying some left-skewness. There were 193 ITE percentiles and 358 mini-CEX evaluations available for the same time period. The demographic characteristics of the participants are shown in table 1.
Table 1.
Variable | Level | Total (n=253) | ≥1 survey (n=213) | No survey (n=40) | P value |
Sex | Male | 165 (65.2%) | 137 (64.3%) | 28 (70.0%) | 0.59 |
Female | 88 (34.8%) | 76 (35.7%) | 12 (30%) | ||
Programme | Categorical | 196 (77.5%) | 170 (79.8%) | 26 (65.0%) | 0.06 |
Preliminary | 57 (22.5%) | 43 (20.2%) | 14 (35.0%) | ||
Match year | 2015 | 50 (19.8%) | 40 (18.8%) | 10 (25.0%) | 0.40 |
2016 | 47 (18.6%) | 39 (18.3%) | 8 (20.0%) | ||
2017 | 78 (30.8%) | 70 (32.9%) | 8 (20.0%) | ||
2018 | 78 (30.8%) | 64 (30.1%) | 14 (35.0%) | ||
Age | Mean (SD) | 27.72 (2.62) | 27.69 (2.66) | 27.90 (2.43) | 0.62 |
Possible surveys | Mean (SD) | 3.17 (1.17) | 3.20 (1.17) | 3.00 (1.18) | 0.33 |
Completed surveys | Mean (SD) | – | 2.16 (1.08) | – | – |
Baseline characteristics of 253 survey eligible IM resident physicians from July 2017 to June 2019 (213 (84.2%). IM resident physicians completed 461 (57.6%) CD-RISC 10/Grit s Surveys out of 801 possible).
CD-RISC, connor-davidson resilience scale; IM, internal medicine.
Medical knowledge, clinical performance and professionalism metrics
The ITE score percentiles among residents in our study (N=193) ranged from 18 to 100, with a mean (SD) of 83.3 (15.5). Clinical performance, as reflected by faculty evaluations (N=429), peer evaluations (N=362), and mini-CEX (N=358) showed mean (SD) scores of 7.84 (0.69), 8.09 (0.83), and 8.19 (1.59), respectively. Performance measure summaries are shown in table 2.
Table 2.
Variable | Metric (scale) | n (Eligible) | n (Responses) | Mean (SD) | Range |
Medical knowledge | IM-ITE, percentile | 353 | 193 | 83.3 (15.5) | 18–100 |
Professionalism | Conference attendance, no | 705 | 429 | 53.8 (14.3) | 6–95 |
Evaluation completion, % | 705 | 429 | 77.3 (11.5) | 22–100 | |
Clinical performance | Faculty evaluations (0–10) | 705 | 429 | 7.84 (0.69) | 4.49–9.37 |
Peer evaluations (0–10) | 705 | 362 | 8.09 (0.83) | 4.13–10 | |
Mini-CEX (0–10) | 705 | 358 | 8.19 (1.59) | 4.00–10 |
IM, internal medicine; ITE, in-training examination; Mini-CEX, mini-clinical evaluation examination.
Validity analyses of the CD-RISC 10 and GRIT-S instruments
Regarding the internal structure validity evidence for the scales among IM residents, the CD-RISC 10 index demonstrated a single dimension of resilience while the GRIT-S index demonstrated two dimensions of grittiness. The internal consistency reliability for both scales overall, and for the GRIT subscales, was high (Cronbach α’s >0.7, tables 3 and 4).
Table 3.
Item | Mean score (SD) | Item loading | Cronbach α |
CD-RISC 10 overall (0–40) | 31.5 (6.1) | 0.93 | |
1. Able to adapt to change | 3.29 (0.68) | 0.80 | |
2. Can deal with whatever comes | 3.18 (0.74) | 0.82 | |
3. Tries to see humorous side of problems | 3.19 (0.79) | 0.71 | |
4. Coping with stress can strengthen me | 3.11 (0.79) | 0.72 | |
5. Tend to bounce back after illness or hardship | 3.25 (0.76) | 0.83 | |
6. Can achieve goals despite obstacles | 3.34 (0.71) | 0.82 | |
7. Can stay focused under pressure | 3.03 (0.78) | 0.81 | |
8. Not easily discouraged by failure | 2.74 (0.91) | 0.75 | |
9. Thinks of self as strong person | 3.20 (0.78) | 0.83 | |
10. Can handle unpleasant feeling | 3.19 (0.73) | 0.81 |
CD-RISC, connor-davidson resilience scale; IM, internal medicine.
Table 4.
Item | Mean score (SD) | Item loading | Cronbach α | |
Consistency of interest | Perseverance of effort | |||
Consistency of Interest (reverse scored) | 0.84 | |||
1. New ideas and projects sometimes distract me from previous ones. | 2.99 (0.95) | 0.83 | 0.002 | |
3. I have been obsessed with a certain idea or project for a short time but later lost interest. | 3.39 (0.95) | 0.84 | 0.11 | |
5. I often set a goal but later choose to pursue a different one. | 3.63 (0.88) | 0.80 | 0.26 | |
6. I have difficulty maintaining my focus on projects that take more than a few months to complete. | 3.56 (1.03) | 0.76 | 0.29 | |
Overall consistency of Interest mean | 3.39 (0.79) | |||
Perseverance of effort | 0.71 | |||
2. Setbacks don't discourage me. | 3.40 (0.94) | 0.08 | 0.49 | |
4. I am a hard worker. | 4.48 (0.70) | 0.05 | 0.86 | |
7. I finish whatever I begin. | 3.95 (0.84) | 0.47 | 0.63 | |
8. I am diligent. | 4.33 (0.72) | 0.17 | 0.87 | |
Overall perseverance of effort mean | 4.04 (0.59) | |||
Grit-S overall1–5 | 3.72 (0.59) | 0.82 |
Grit-S, short grit scale; IM, internal medicine.
The 468 completed CD-RISC 10 scales showed mean scores for individual items ranging from 2.74 (not easily discouraged by failure) to 3.34 (can achieve goals despite obstacles) on the 0–4 scale (table 3). The overall mean summed (SD) CD-RISC score was 31.5 (6.1). The 472 completed GRIT-S scales showed individual-item mean scores ranging from 2.99 (new ideas and projects sometimes distract me from previous ones) to 4.48 (I am a hard worker) on the 1–5 scale (table 4). The overall mean (SD) GRIT-S score was 3.72 (0.59).
Regarding relations to other variables (ie, criterion) validity evidence, the CD-RISC 10 overall summed scores correlated negatively with medical knowledge acquisition as measured by ITE score percentile (β=−0.34, 95% CI −0.62 to −0.05, p=0.02). The CD-RISC 10 overall summed scores also correlated negatively with clinical performance as measured by the mini-CEX (β=−0.02, 95% CI −0.05 to −0.002, p=0.03) (table 5).
Table 5.
Variable | Metric (scale) | CD-RISC 10 (0–40) | Grit-S1–5 | ||||
β | 95% CI | P value | β | 95% CI | P value | ||
Medical Knowledge | IM-ITE, percentile | −0.34 | −0.62 to –0.05 | 0.02 | 0.42 | −3.29 to 4.12 | 0.83 |
Professionalism | Conference attendance, no | −0.07 | −0.31 to 0.18 | 0.59 | 2.70 | 0.11 to 5.29 | 0.04 |
Evaluation completion, % | 0.19 | −0.05 to 0.43 | 0.13 | 2.51 | 0.35 to 4.67 | 0.02 | |
Clinical performance | Faculty evaluations (0–10) | 0.0002 | −0.01 to 0.01 | 0.98 | 0.06 | −0.08 to 0.20 | 0.38 |
Peer evaluations (0–10) | 0.02 | −0.0006 to 0.03 | 0.06 | 0.09 | −0.09 to 0.26 | 0.33 | |
Mini-CEX (0–10) | −0.02 | −0.05 to –0.002 | 0.03 | −0.20 | −0.47 to 0.06 | 0.13 |
CD-RISC, connor-davidson resilience scale; Grit-S, short grit scale; IM, internal medicine; ITE, in-training examination; Mini-CEX, mini-clinical evaluation examination.
The GRIT-S overall mean score correlated positively with evaluation completion percentage (β=2.51, 95% CI 0.35 to 4.67, p=0.02) and in-person conference attendance (β=2.70, 95% CI 0.11 to 5.29, p=0.04) (table 5), which are measures of the dutifulness aspect of professionalism.
Discussion
The CD-RISC 10 and GRIT-S instruments have strong validity in measuring resilience and grit in several populations20 23 45 57 and there have been studies of grit in surgical28 29 58 and emergency medicine residents.30 However, to our knowledge, this is the first validity study of the CD-RISC 10 and GRIT-S among IM residents. Both instruments showed excellent internal consistency reliability, statistically significant associations with previously validated measures of resident physician performance, and dimensionality characteristics that are consistent with previous research.
We identified a negative association between residents’ CD-RISC 10 scores and measures of clinical performance (mini-CEX) and medical knowledge (ITE). This finding might reflect resilient residents’ abilities to thrive within a high-pressured IM training environment, despite performing less favourably on standardised assessments within this setting. Notably, whether a resident thrives is not determined by their performance on one of these measures, but rather, by their overall standing within our rigorous training environment. This finding may be supported by the residents’ highest score on the item, ‘achieve goals despite obstacles.’ We also identified a positive association between GRIT-S scores and evaluation completion, which is a dutifulness aspect of professionalism.22 59 This finding suggests that, as expected, residents with grittiness tend to finish tasks. Additionally, this finding corresponds to residents’ highest score on the item, ‘I am a hard worker.’ Overall, our research should inform future interventions to improve resident performance and well-being by using the CD-RISC 10 and GRIT-S as roadmaps for curricular interventions.
Compared with the general US population included in the original validation studies,43 57 60 the overall mean (SD) resilience score in our sample was comparable (31.5 (6.1) vs 32.1 (5.8) and 31.8 (5.4)). However, compared with the reference group aged 25–34 years in the original validation study, the overall mean (SD) GRIT-S score in our sample was higher (3.72 (0.59) vs 3.2 (0.7)).23 Our study participants noted strong perseverance as reflected by their highest GRIT-S score on the item ‘I am a hard worker.’ Additionally, the dimensionalities for the GRIT-S and CD-RISC 10 scales in our study were consistent with findings from research in different populations.61 62 However, despite having higher grit and comparable resilience as compared with the general population, burn-out rates among physicians and physicians-in-training appear to be greater than that of the US working population.3 8 This suggests that the medical profession selects gritty and resilient individuals, yet still manages to burn them out. Furthermore, research shows that well-being indicators are highest on matriculation to medical school, and subsequently wane throughout medical training.63 Consequently, future research should examine the interactions between burn-out, empathy, resilience and grit.
This study has several limitations. First, it was observational, which constrains the ability to draw causal inferences about the relationships that were identified. Second, the analysis did not adjust for age, gender and international versus US medical graduation status. Nonetheless, these are non-modifiable variables that would not facilitate efforts at professional development or enhancing residency curricula. Third, this study involved IM residents at a large academic medical centre, which may limit generalisation to some other specialties and settings. Fourth, although we implicate potential, counterbalancing interactions between grit and wellness with burn-out, this remains speculative until there is further research that actually examines interactions between performance on these scales among IM residents. Fifth, residents’ self-selection to participate in the study introduces the potential for selection and response biases, though it is noteworthy that the response/participation rate for this study was high.
Resilience and grit may lessen burn-out, yet these relationships remain unclear among physicians in training. Thus, research on resilience and grit could assist interventions to mitigate physician burn-out64 65 and provide a deeper understanding of dynamics between the issues at play.66 Findings from this study support of use of the CD-RISC 10 and GRIT-S among IM residents and should serve as a foundation for future research on resilience and grit in medical learners. This research should examine associations among IM residents between CD-RISC 10 and GRIT-S, with validated measures of burn-out and well-being. It is noteworthy that burn-out is prevalent within current medical education and training systems and may be an indicator of organisational health.67 68 Therefore, improved understanding of resilience and grit may enhance graduate medical education curricula36 69–72 and the well-being of physicians.
There have been ample investigations on physician burn-out and depression, yet there has been less research on positive aspects of physician wellness including resilience and grit among IM residents. Especially during this era of the COVID-19 pandemic, it is necessary to better understand characteristics of physicians that allow them to surmount adversity and thrive. Since high resiliency and grit have been correlated with positive attributes in other populations, we are hopeful that further study of these traits in residents’ will help to improve their quality of life.27 58 73
Supplementary Material
Footnotes
Contributors: Idea conception: TB, FA, CW and VMM. Study design and methodology: FA, TB and AJH. Data management and analysis: AJH and JM. Interpretation of the data: FA, AJH, TB, MHM and BEV. Manuscript drafting: FA. Supervision: TB. Revising, editing and final approval of manuscript: all authors.
Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Patient consent for publication: Not required.
Ethics approval: This study was deemed exempt by the Mayo Institutional Review Board.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement: No data are available. No further data are available.
References
- 1.Dyrbye L, Shanafelt T. A narrative review on burnout experienced by medical students and residents. Med Educ 2016;50:132–49. 10.1111/medu.12927 [DOI] [PubMed] [Google Scholar]
- 2.Dyrbye LN, Thomas MR, Massie FS, et al. . Burnout and suicidal ideation among U.S. medical students. Ann Intern Med 2008;149:334–41. 10.7326/0003-4819-149-5-200809020-00008 [DOI] [PubMed] [Google Scholar]
- 3.Dyrbye LN, West CP, Satele D, et al. . Burnout among U.S. medical students, residents, and early career physicians relative to the general U.S. population. Acad Med 2014;89:443–51. 10.1097/ACM.0000000000000134 [DOI] [PubMed] [Google Scholar]
- 4.West CP, Shanafelt TD, Kolars JC. Quality of life, burnout, educational debt, and medical knowledge among internal medicine residents. JAMA 2011;306:952–60. 10.1001/jama.2011.1247 [DOI] [PubMed] [Google Scholar]
- 5.Linzer M, Visser MR, Oort FJ, et al. . Predicting and preventing physician burnout: results from the United States and the Netherlands. Am J Med 2001;111:170–5. 10.1016/S0002-9343(01)00814-2 [DOI] [PubMed] [Google Scholar]
- 6.Allegra CJ, Hall R, Yothers G. Prevalence of burnout in the U.S. oncology community: results of a 2003 survey. J Oncol Pract 2005;1:140–7. 10.1200/jop.2005.1.4.140 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Shanafelt TD, Boone S, Tan L, et al. . Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med 2012;172:1377–85. 10.1001/archinternmed.2012.3199 [DOI] [PubMed] [Google Scholar]
- 8.Shanafelt TD, Hasan O, Dyrbye LN, et al. . Changes in burnout and satisfaction with work-life balance in physicians and the general us working population between 2011 and 2014. Mayo Clin Proc 2015;90:1600–13. 10.1016/j.mayocp.2015.08.023 [DOI] [PubMed] [Google Scholar]
- 9.Shanafelt TD, West CP, Sinsky C, et al. . Changes in burnout and satisfaction with work-life integration in physicians and the general us working population between 2011 and 2017. Mayo Clin Proc 2019;94:1681–94. 10.1016/j.mayocp.2018.10.023 [DOI] [PubMed] [Google Scholar]
- 10.Quinn MA, Bazari H, Ripp J, et al. . A roadmap for research on resident well-being. Am J Med 2018;131:323–8. 10.1016/j.amjmed.2017.12.001 [DOI] [PubMed] [Google Scholar]
- 11.Brazeau CMLR, Shanafelt T, Durning SJ, et al. . Distress among matriculating medical students relative to the general population. Acad Med 2014;89:1520–5. 10.1097/ACM.0000000000000482 [DOI] [PubMed] [Google Scholar]
- 12.Williams ES, Manwell LB, Konrad TR, et al. . The relationship of organizational culture, stress, satisfaction, and burnout with physician-reported error and suboptimal patient care: results from the MEMO study. Health Care Manage Rev 2007;32:203–12. 10.1097/01.HMR.0000281626.28363.59 [DOI] [PubMed] [Google Scholar]
- 13.Lillian Comas-Diaz P, Luthar SS, American Psychological Association . The road to resilience, 2012. Available: https://www.apa.org/topics/resilience
- 14.Epstein RM, Krasner MS. Physician resilience: what it means, why it matters, and how to promote it. Acad Med 2013;88:301–3. 10.1097/ACM.0b013e318280cff0 [DOI] [PubMed] [Google Scholar]
- 15.Chmitorz A, Kunzler A, Helmreich I, et al. . Intervention studies to foster resilience - A systematic review and proposal for a resilience framework in future intervention studies. Clin Psychol Rev 2018;59:78–100. 10.1016/j.cpr.2017.11.002 [DOI] [PubMed] [Google Scholar]
- 16.Sapienza JK, Masten AS. Understanding and promoting resilience in children and youth. Curr Opin Psychiatry 2011;24:267–73. 10.1097/YCO.0b013e32834776a8 [DOI] [PubMed] [Google Scholar]
- 17.Patel R, Bachu R, Adikey A, et al. . Factors related to physician burnout and its consequences: a review. Behav Sci 2018;8:98 10.3390/bs8110098 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Russo SJ, Murrough JW, Han M-H, et al. . Neurobiology of resilience. Nat Neurosci 2012;15:1475–84. 10.1038/nn.3234 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wu G, Feder A, Cohen H, et al. . Understanding resilience. Front Behav Neurosci 2013;7:10. 10.3389/fnbeh.2013.00010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Campbell-Sills L, Stein MB. Psychometric analysis and refinement of the Connor-davidson resilience scale (CD-RISC): validation of a 10-item measure of resilience. J Trauma Stress 2007;20:1019–28. 10.1002/jts.20271 [DOI] [PubMed] [Google Scholar]
- 21.Jackson D, Firtko A, Edenborough M. Personal resilience as a strategy for surviving and thriving in the face of workplace adversity: a literature review. J Adv Nurs 2007;60:1–9. 10.1111/j.1365-2648.2007.04412.x [DOI] [PubMed] [Google Scholar]
- 22.Duckworth AL, Peterson C, Matthews MD, et al. . Grit: perseverance and passion for long-term goals. J Pers Soc Psychol 2007;92:1087–101. 10.1037/0022-3514.92.6.1087 [DOI] [PubMed] [Google Scholar]
- 23.Duckworth AL, Quinn PD. Development and validation of the short grit scale (grit-s). J Pers Assess 2009;91:166–74. 10.1080/00223890802634290 [DOI] [PubMed] [Google Scholar]
- 24.Robertson-Kraft C, Duckworth AL. True grit: trait-level perseverance and passion for long-term goals predicts effectiveness and retention among novice teachers. Teach Coll Rec 2014;116. [PMC free article] [PubMed] [Google Scholar]
- 25.Eskreis-Winkler L, Shulman EP, Beal SA, et al. . The grit effect: predicting retention in the military, the workplace, school and marriage. Front Psychol 2014;5:36. 10.3389/fpsyg.2014.00036 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Silvia PJ, Eddington KM, Beaty RE, et al. . Gritty people try harder: grit and effort-related cardiac autonomic activity during an active coping challenge. Int J Psychophysiol 2013;88:200–5. 10.1016/j.ijpsycho.2013.04.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Burkhart RA, Tholey RM, Guinto D, et al. . Grit: a marker of residents at risk for attrition? Surgery 2014;155:1014–22. 10.1016/j.surg.2014.01.015 [DOI] [PubMed] [Google Scholar]
- 28.Salles A, Lin D, Liebert C, et al. . Grit as a predictor of risk of attrition in surgical residency. Am J Surg 2017;213:288–91. 10.1016/j.amjsurg.2016.10.012 [DOI] [PubMed] [Google Scholar]
- 29.Samuelsen BT, Desai VS, Turner NS, et al. . Generational differences in Grit, self-control, and conscientiousness among orthopaedic surgeons: from Millennials to baby boomers. J Bone Joint Surg Am 2019;101:e71. 10.2106/JBJS.18.00275 [DOI] [PubMed] [Google Scholar]
- 30.Kalantari A. Faculty assessment of emergency medicine resident Grit: a multicentered study. AEM Educ Train 2019;3:100. 10.1002/aet2.10305 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Hammond DA. Grit: an important characteristic in learners. Curr Pharm Teach Learn 2017;9:1–3. 10.1016/j.cptl.2016.08.048 [DOI] [PubMed] [Google Scholar]
- 32.McClafferty H, Brooks AJ, Chen M-K, et al. . Pediatric integrative medicine in residency program: relationship between lifestyle behaviors and burnout and wellbeing measures in first-year residents. Children 2018;5. 10.3390/children5040054. [Epub ahead of print: 23 04 2018]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Panagioti M, Geraghty K, Johnson J, et al. . Association between physician burnout and patient safety, professionalism, and patient satisfaction: a systematic review and meta-analysis. JAMA Intern Med 2018;178:1317–30. 10.1001/jamainternmed.2018.3713 [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 34.Baer TE, Feraco AM, Tuysuzoglu Sagalowsky S, et al. . Pediatric resident burnout and attitudes toward patients. Pediatrics 2017;139:e20162163. 10.1542/peds.2016-2163 [DOI] [PubMed] [Google Scholar]
- 35.Brown R, Dunn S, Byrnes K, et al. . Doctors' stress responses and poor communication performance in simulated bad-news consultations. Acad Med 2009;84:1595–602. 10.1097/ACM.0b013e3181baf537 [DOI] [PubMed] [Google Scholar]
- 36.Fahrenkopf AM, Sectish TC, Barger LK, et al. . Rates of medication errors among depressed and burnt out residents: prospective cohort study. BMJ 2008;336:488–91. 10.1136/bmj.39469.763218.BE [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.West CP, Dyrbye LN, Sloan JA, et al. . Single item measures of emotional exhaustion and depersonalization are useful for assessing burnout in medical professionals. J Gen Intern Med 2009;24:1318–21. 10.1007/s11606-009-1129-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.West CP, Tan AD, Habermann TM, et al. . Association of resident fatigue and distress with perceived medical errors. JAMA 2009;302:1294–300. 10.1001/jama.2009.1389 [DOI] [PubMed] [Google Scholar]
- 39.Beckman TJ, Reed DA, Shanafelt TD, et al. . Impact of resident well-being and empathy on assessments of faculty physicians. J Gen Intern Med 2010;25:52–6. 10.1007/s11606-009-1152-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Beckman TJ, Reed DA, Shanafelt TD, et al. . Resident physician well-being and assessments of their knowledge and clinical performance. J Gen Intern Med 2012;27:325–30. 10.1007/s11606-011-1891-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 2006;119:166.e7–166.e16. 10.1016/j.amjmed.2005.10.036 [DOI] [PubMed] [Google Scholar]
- 42.Beckman TJ, Cook DA, Mandrekar JN. What is the validity evidence for assessments of clinical teaching? J Gen Intern Med 2005;20:1159–64. 10.1111/j.1525-1497.2005.0258.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Connor KM, Davidson JRT. Development of a new resilience scale: the connor-davidson resilience scale (CD-RISC). Depress Anxiety 2003;18:76–82. 10.1002/da.10113 [DOI] [PubMed] [Google Scholar]
- 44.Ni MY, Li TK, Yu NX, et al. . Normative data and psychometric properties of the Connor-Davidson resilience scale (CD-RISC) and the abbreviated version (CD-RISC2) among the general population in Hong Kong. Qual Life Res 2016;25:111–6. 10.1007/s11136-015-1072-x [DOI] [PubMed] [Google Scholar]
- 45.Bezdjian S, Schneider KG, Burchett D, et al. . Resilience in the United States air force: psychometric properties of the connor-davidson resilience scale (CD-RISC). Psychol Assess 2017;29:479–85. 10.1037/pas0000370 [DOI] [PubMed] [Google Scholar]
- 46.Garibaldi RA, Trontell MC, Waxman H, et al. . The in-training examination in internal medicine. Ann Intern Med 1994;121:117–23. 10.7326/0003-4819-121-2-199407150-00008 [DOI] [PubMed] [Google Scholar]
- 47.Garibaldi RA, Subhiyah R, Moore ME, et al. . The in-training examination in internal medicine: an analysis of resident performance over time. Ann Intern Med 2002;137:505–10. 10.7326/0003-4819-137-6-200209170-00011 [DOI] [PubMed] [Google Scholar]
- 48.Reed DA, West CP, Mueller PS, et al. . Behaviors of highly professional resident physicians. JAMA 2008;300:1326–33. 10.1001/jama.300.11.1326 [DOI] [PubMed] [Google Scholar]
- 49.Cook DA, Beckman TJ, Mandrekar JN, et al. . Internal structure of mini-CEX scores for internal medicine residents: factor analysis and generalizability. Adv Health Sci Educ Theory Pract 2010;15:633–45. 10.1007/s10459-010-9224-9 [DOI] [PubMed] [Google Scholar]
- 50.Norcini JJ, Blank LL, Duffy FD, et al. . The mini-CEX: a method for assessing clinical skills. Ann Intern Med 2003;138:476–81. 10.7326/0003-4819-138-6-200303180-00012 [DOI] [PubMed] [Google Scholar]
- 51.Cook DA, Beckman TJ. Does scale length matter? A comparison of nine- versus five-point rating scales for the mini-CEX. Adv Health Sci Educ Theory Pract 2009;14:655–64. 10.1007/s10459-008-9147-x [DOI] [PubMed] [Google Scholar]
- 52.Hatala R, Ainslie M, Kassen BO, et al. . Assessing the mini-clinical evaluation exercise in comparison to a national specialty examination. Med Educ 2006;40:950–6. 10.1111/j.1365-2929.2006.02566.x [DOI] [PubMed] [Google Scholar]
- 53.Beckman TJ, Mandrekar JN, Engstler GJ, et al. . Determining reliability of clinical assessment scores in real time. Teach Learn Med 2009;21:188–94. 10.1080/10401330903014137 [DOI] [PubMed] [Google Scholar]
- 54.Post JA, Wittich CM, Thomas KG, et al. . Rating the quality of entrustable professional activities: content validation and associations with the clinical context. J Gen Intern Med 2016;31:518–23. 10.1007/s11606-016-3611-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Beckman TJ, Cook DA, Mandrekar JN. Factor instability of clinical teaching assessment scores among general internists and cardiologists. Med Educ 2006;40:1209–16. 10.1111/j.1365-2929.2006.02632.x [DOI] [PubMed] [Google Scholar]
- 56.DeVellis RF. Scale development: theory and applications. Newbury Park CA: Sage Publications, Inc, 1991. [Google Scholar]
- 57.JRT D. Connor-Davidson resilience scale (CD-RISC) manual. unpublished, 2018. Available: www.cd-risc.com
- 58.Salles A, Cohen GL, Mueller CM. The relationship between grit and resident well-being. Am J Surg 2014;207:251–4. 10.1016/j.amjsurg.2013.09.006 [DOI] [PubMed] [Google Scholar]
- 59.Miller-Matero LR, Martinez S, MacLean L, et al. . Grit: a predictor of medical student performance. Educ Health 2018;31:109–13. 10.4103/efh.EfH_152_16 [DOI] [PubMed] [Google Scholar]
- 60.Campbell-Sills L, Forde DR, Stein MB. Demographic and childhood environmental predictors of resilience in a community sample. J Psychiatr Res 2009;43:1007–12. 10.1016/j.jpsychires.2009.01.013 [DOI] [PubMed] [Google Scholar]
- 61.Li C. The SHOR the short GRIT scale: a dimension T scale: a dimensionality analysis theses and dissertations-educational, school, and counseling psychology. Kentucky: University of Kentucky, 2015. [Google Scholar]
- 62.Daniel F, Gucciardi BJ. The connor-davidson resilience scale (CD-RISC): dimensionality and age-related measurement invariance with Australian cricketers. Psychol Sport Exerc 2011;12:423–33. [Google Scholar]
- 63.Hansell MW, Ungerleider RM, Brooks CA, et al. . Temporal trends in medical student burnout. Fam Med 2019;51:399–404. 10.22454/FamMed.2019.270753 [DOI] [PubMed] [Google Scholar]
- 64.West CP, Dyrbye LN, Erwin PJ, et al. . Interventions to prevent and reduce physician burnout: a systematic review and meta-analysis. Lancet 2016;388:2272–81. 10.1016/S0140-6736(16)31279-X [DOI] [PubMed] [Google Scholar]
- 65.Panagioti M, Panagopoulou E, Bower P, et al. . Controlled interventions to reduce burnout in physicians: a systematic review and meta-analysis. JAMA Intern Med 2017;177:195–205. 10.1001/jamainternmed.2016.7674 [DOI] [PubMed] [Google Scholar]
- 66.Lotte Dyrbye N N, Sinsky CA, Cipriano PF. Burnout among health care professionals: a call to explore and address this underrecognized threat to safe, high-quality care. Washington: National Academy of Medicine, 2017. [Google Scholar]
- 67.Montgomery A. The inevitability of physician burnout: implications for interventions. Burnout Research 2014;1:50–6. 10.1016/j.burn.2014.04.002 [DOI] [Google Scholar]
- 68.Wallace JE, Lemaire JB, Ghali WA. Physician wellness: a missing quality indicator. Lancet 2009;374:1714–21. 10.1016/S0140-6736(09)61424-0 [DOI] [PubMed] [Google Scholar]
- 69.Shanafelt TD, West C, Zhao X, et al. . Relationship between increased personal well-being and enhanced empathy among internal medicine residents. J Gen Intern Med 2005;20:559–64. 10.1111/j.1525-1497.2005.0108.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Firth-Cozens J, Greenhalgh J. Doctors' perceptions of the links between stress and lowered clinical care. Soc Sci Med 1997;44:1017–22. 10.1016/S0277-9536(96)00227-4 [DOI] [PubMed] [Google Scholar]
- 71.Shanafelt TD, Bradley KA, Wipf JE, et al. . Burnout and self-reported patient care in an internal medicine residency program. Ann Intern Med 2002;136:358–67. 10.7326/0003-4819-136-5-200203050-00008 [DOI] [PubMed] [Google Scholar]
- 72.West CP, Huschka MM, Novotny PJ, et al. . Association of perceived medical errors with resident distress and empathy: a prospective longitudinal study. JAMA 2006;296:1071–8. 10.1001/jama.296.9.1071 [DOI] [PubMed] [Google Scholar]
- 73.Halliday L, Walker A, Vig S, et al. . Grit and burnout in UK doctors: a cross-sectional study across specialties and stages of training. Postgrad Med J 2017;93:389–94. 10.1136/postgradmedj-2015-133919 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.