Abstract
The Jefferson Scale of Empathy (JSE) is a broadly used instrument developed to measure empathy in the context of health professions education and patient care. Evidence in support of psychometrics of the JSE has been reported in health professions students and practitioners with the exception of osteopathic medical students. This study was designed to examine measurement properties, underlying components, and latent variable structure of the JSE in a nationwide sample of first-year matriculants at U.S. colleges of osteopathic medicine, and to develop a national norm table for the assessment of JSE scores. A web-based survey was administered at the beginning of the 2017–2018 academic year which included the JSE, a scale to detect “good impression” responses, and demographic/background information. Usable surveys were received from 6009 students enrolled in 41 college campuses (median response rate = 92%). The JSE mean score and standard deviation for the sample were 116.54 and 10.85, respectively. Item-total score correlations were positive and statistically significant (p < 0.01), and Cronbach α = 0.82. Significant gender differences were observed on the JSE scores in favor of women. Also, significant differences were found on item scores between top and bottom third scorers on the JSE. Three factors of Perspective Taking, Compassionate Care, and Walking in Patient’s Shoes emerged in an exploratory factor analysis by using half of the sample. Results of confirmatory factor analysis with another half of the sample confirmed the 3-factor model. We also developed a national norm table which is the first to assess students’ JSE scores against national data.
Keywords: Empathy, Factor analysis, Medical students, Psychometrics, National norms
Introduction
Personality in health professions education and patient care
The importance of professionalism and its assessment in physicians-in-training and in-practice (Stern 2006) has led to the acknowledgment that at least two major components are involved in medical education (Hojat et al. 2014). One component includes a set of “cognitive” abilities often reflected in academic attainment, performances on examinations of recalling factual information, declarative knowledge, and procedural skills. The other component, often described under the rubric of “personality” includes features such as personal qualities, attitudes, interests, values, and other psychosocial characteristics. In a paradigm of physician performance, both the cognitive abilities as well as personality are associated with patient outcomes, the ultimate goal of medical education (Gonnella et al. 1993).
Empathy in health professions education and patient care
Empirical research suggests that a number of personality attributes, including empathy, are among significant predictors of clinical competence of physicians-in-training (Hojat et al. 2002a, 2014) and of patient outcomes (Hojat et al. 2011; Del Canale et al. 2012). Empathy has been described as one major element of professionalism in medicine (Veloski and Hojat 2006), and the most frequently mentioned personality attribute of the humanistic physician (Linn et al. 1987). Cultivating empathy is among the goals of medical education, endorsed by professional medical organizations. For example, the Medical Schools Objectives Project of the Association of American Medical Colleges (1999) includes enrichment of empathy among the educational objectives of medical schools. Also, in a position paper, the American Board of Internal Medicine (1983) recommended that humanistic qualities should be instilled and assessed as an essential part of physician education.
Definition of empathy in health professions education and patient care
Despite consensus on the importance of empathy in patient care, there is no unanimity on the definition of empathy in the context of patient care (Matravers 2014). The historical ambiguity associated with the term and the lack of psychometrically sound instruments to measure empathy in that context contributed to a dearth of empirical research on empathy in medical education and patient care. Despite a lack of conceptual clarity, empathy has recently received considerable attention in public media, academia, national and international politics, business, arts, ethics, and particularly in health professions education and patient care (Coplan 2014).
Based on a comprehensive review of relevant literature, empathy in patient care was defined as a predominantly cognitive (rather than an affective or emotional) attribute that involves an understanding (rather than feeling) of pain and suffering of the patient, combined with a capacity to communicate this understanding, and an intention to help (Hojat 2016; Hojat et al. 2001). The four key terms in this definition are in italics to underscore their significance in the construct of empathy in patient care, and make a distinction between empathy and sympathy (which is defined as a predominantly emotional reaction). This distinction is important because empathy and sympathy have different consequences in clinical outcomes (see Hojat 2016, pp. 3–16, 71–81).
Measurement of empathy in health professions education and patient care
Prior to the development of the JSE, no psychometrically sound instrument was available for measuring empathy in the context of health professions education and patient care. Several empathy measuring instruments, including the Interpersonal Reactivity Index (IRI, Davis 1983); the Empathy Scale (Hogan 1969); and the Emotional Empathy Scale (Mehrabian and Epstein 1972) were available and used by medical education researchers.
However, these instruments were developed for administration to the general population. None is specific enough to capture the essence of empathy in the context of health professions education and patient care (Evans et al. 1993). In other words, none of these instruments has “face” and “content” validity in that context (Hojat and Gonnella 2017; Hojat 2018). There was a need for a content-specific and context-relevant empathy measuring instrument. In response to that need, the Jefferson Scale of Empathy (JSE) was developed (Hojat et al. 2001, 2002b). The JSE is a 20-item instrument specifically developed to measure empathy in the context of health professions education and patient care for administration to health professions students and practitioners. Items are answered on a 7-point Likert-type scale (1 = Strongly Disagree, 7 = Strongly Agree). Half of the items are positively worded and directly scored, and the other half are negatively worded (reverse scored).
Three versions of the JSE are available. One version is used for administration to medical students (S-Version). The second version was developed for administration to practicing health professionals including physicians, nurses, dentists, pharmacologists, clinical psychologists, and other clinicians involved with patient care (HP-Version). The third version (HPS-Version) was developed for administration to all health professions students other than medical students. All three versions are very similar in content with only minor differences in a few words to adjust the instrument for its target population. The JSE has been recognized as the most researched and widely used instrument in medical education research (Colliver et al. 2010), and has been translated into 56 languages, and used in more than 80 countries (Hojat 2016). An abundance of evidence has been reported exclusively in samples of health professional students and practitioners in support of the psychometrics of the JSE by researchers in the United States and abroad (for a review see Hojat 2016, pp. 84–128, 276–286).
Validity evidence in support of the JSE
Numerous empirical studies have been published in which associations between scores of the JSE and a number of pertinent variables have been reported. However, the litmus test for the validity of any empathy-measuring instrument in patient care is the evidence to show significant associations between scores of the instrument and indicators of positive patient outcomes for physicians-in-practice, and clinical competence in physicians-in-training. In addition, associations of the scores of the instrument with conceptually relevant personal qualities, and group differences in the expected direction can provide support for the validity of the instrument.
Patient outcomes
Significant associations between physicians’ scores on the JSE and tangible patient outcomes were confirmed in two empirical studies in the U.S. and Italy. In the first study in the U.S. (Hojat et al. 2011), electronic records of adult patients with diabetes mellitus were examined. Findings showed that patients of physicians who scored high on the JSE were significantly more likely to have good control of their disease (determined by hemoglobin A1c test result < 7.0%, and low-density lipoprotein cholesterol: LDL-C < 100) compared to patients of physicians who scored low on the JSE.
In a second large scale study in Palma, Italy (Del Canale et al. 2012) electronic records of adult patients with types 1 and 2 diabetes mellitus were examined and information on acute metabolic complications (e.g., diabetic ketoacidosis, coma, and hyperosmolar) that required hospitalization were extracted. Results showed statistically significant associations between physicians’ high scores on the JSE and lower rates of patients’ hospitalization.
Clinical competence
In a study of medical students (Hojat et al. 2002), a statistically significant association was found between the students’ JSE scores and the faculty’s global ratings of students’ clinical competence in core clerkships in family medicine, internal medicine, obstetrics and gynecology, pediatrics, psychiatry, and surgery. Also, significant associations were observed between students’ JSE scores and ratings of clinical competence given by standardized patients in 10 Objective Structured Clinical Examination (OSCE) stations (Berg et al. 2011, 2015).
In a study by LaNoue and Roter (2018) significant associations were found between self-reported JSE scores in third-year medical students, and observations of empathic communication pattern with simulated patients, measured by the Roter Interactional Analysis System (Roter and Larson 2002). In a large scale study at the Cleveland Clinic (Chaitoff et al. 2017), significant associations were observed between physicians’ JSE scores and standardized measures of patients’ communication experiences with their physicians.
Personality measures
In the first validity study of the JSE in medical students and internal medicine residents (Hojat et al. 2001), statistically significant correlations of moderate magnitude were found between JSE scores and the following variables: scores on the Empathic Concern and Perspective Taking scales of the Interpersonal Reactivity Index, personality facets of Warmth and Dutifulness on the NEO PI-R (Costa and McCrea 1992), and self-reported measures of Compassion and Sympathy (single items). In another study with internal medicine residents (Hojat et al. 2005a), significant correlations were observed between JSE scores and Perspective Taking, Empathic Concern, and Fantasy scales of the IRI, but not with the Personal Distress scale of the IRI (which is not conceptually relevant to empathy in patient care). Similar findings were reported by Costa and his colleagues (2017) with samples of medical students from five countries using different translated versions of the JSE.
In a study with medical students in the U.S. (Hojat et al. 2005b), higher scores on the JSE were associated with higher scores on Sociability. Scores of the JSE have also been linked to the “big five” personality factors such as Agreeableness, Openness to Experience, Conscientiousness, and Extraversion in medical students in Portugal (Costa et al. 2014).
Empirical evidence in studies with health professions students and practitioners showed that a number of personal quality measures that are conducive to relationship building were positively correlated with JSE scores, including emotional intelligence (Arora et al. 2010; Austin et al. 2005; Kliszcz et al. 2006); cooperativeness (Hong et al. 2011); desirable professional behavior (Brazeau et al. 2010); patient-centered care and orientation toward integrative patient care (Hojat et al. 2015a); positive social influence measured by peer nomination (Hojat et al. 2015b); and clinical and humanistic excellence measured by peer nomination (Pohl et al. 2011). Burnout resiliency measured by scores on the Personal Accomplishment of the MBI (Maslach 1993) was found to be inversely correlated with the JSE scores in medical students (Hojat et al. 2015c). The JSE scores were significantly associated with orientation toward teamwork and interprofessional collaboration in a study with allopathic medical students (Hojat et al. 2012), osteopathic medical students (Calabrese et al. 2013), nursing students (Ward et al. 2009), and pharmacy students (Van Winkel et al. 2011).
In other studies, scores of the JSE yielded negative correlations with personality attributes that are detrimental to positive interpersonal relationships, such as measures of aggression-hostility (Hasan et al. 2013; Hojat et al. 2005b) and indicators of burnout such as Depersonalization and Emotional Exhaustion (Hojat et al. 2015c; Lamothe et al. 2014; Zenasni et al. 2012). In a study with Chinese nursing students (Xia et al. 2011), an inverse relationship was found between the JSE scores and scores of the Neuroticism scale of the Eysenck Personality Questionnaire (Eysenck and Eysenck 1975).
Validity by comparing contrasted groups
A measuring instrument is valid when it can demonstrate group differences in the expected direction. The expectations are based on previous research, theories, and behavioral tendencies described in the literature.
Gender difference
Some have suggested that women’s behavioral style is generally more “empathizing” than men (Baron-Cohen 2003). Indeed, in a majority of studies, female health professions students and practicing clinicians obtained significantly higher JSE mean scores than their male counterparts (Hojat et al. 2001, 2002a, b; Alcorta-Garza et al. 2005; Fjortoft et al. 2011). In a large scale study of 11 entering classes of medical students, women’s JSE mean scores were higher than men in all classes, and the gender difference was statistically significant for 10 out of the 11 classes (Hojat and Gonnella 2015). Several plausible explanations have been given for gender differences in empathy, including social learning, genetic predisposition, evolutionary underpinnings, and other factors (for a review see Hojat 2016, pp. 169–187).
Specialty interest
In her doctoral dissertation, Bailey (2001) reported that medical students who planned to pursue a career in specialties requiring extensive and prolonged encounters with patients received significantly higher scores on empathy measured by the IRI (Davis 1983) than their counterparts who planned to pursue procedure-oriented specialties. Given the aforementioned finding, it can be hypothesized that high scorers on the JSE are more inclined to choose specialties that require continuous and prolonged encounters with patients. These specialties are described as “people-oriented” such as primary care specialties (general internal medicine, family medicine, and pediatrics) and psychiatry. Conversely, it can be predicted that low scorers on the JSE would be more interested in specialties that often require less interaction with patients and often involve diagnostic or therapeutic procedures. These specialties are described as “technology/procedure-oriented” such as hospital-based specialties (pathology, radiology, and anesthesiology), urology, surgery and surgical subspecialties.
The aforementioned hypotheses were confirmed in a number of studies. For example, physicians in the “people-oriented” specialties scored higher on the JSE compared to others in “technology-/procedure-oriented” specialties (Hojat et al. 2002b), consistent with findings reported by others in the United States and abroad (Chen et al. 2007, 2012; Kataoka et al. 2012; Voinescu et al. 2009). In a study with first-year medical students, the JSE was administered at the beginning of medical school before students were exposed to formal medical education (Hojat et al. 2005b). Findings showed a significant association between JSE scores and specialty interest in favor of those planning to pursue “people-oriented” specialties. Interestingly, the pattern of malpractice claims against physicians in different specialties has proven to be consistent with research findings on the JSE scores so that those practicing in “people-oriented” specialties were less likely charged with malpractice litigation (Taragin et al. 1994). However, such associations between specialty interest and JSE scores were not observed in osteopathic medical students (Calabrese et al. 2013) .
Study purposes
In a majority of the studies in which the JSE has been used, research participants were students from allopathic medical schools; only a few studies with osteopathic medical students are available. To fill the gap, this study was designed to examine some psychometric aspects of the JSE in a nationwide sample of osteopathic medical students and investigate associations between JSE scores and a number of selected demographic and background variables. Another goal was to develop the first national norm table for the assessment of the JSE scores in the corresponding population. The present study is unique for two reasons. First, it is the first nationwide study in which the JSE was used, and second, it is the first psychometric study of the JSE in osteopathic medical students. Medical education in osteopathic medical schools (that grant the DO degree), as compared to that in allopathic medical schools (that grant the MD degree) places more emphasis on a holistic approach to patient care, and the integration of the entire body systems. The osteopathic manipulative treatment (OMT) is a unique feature of the osteopathic medical education that involves using the hands for diagnosis and treatment of illnesses and injuries. This is part of a larger nationwide Project in Osteopathic Medical Education and Empathy (POMEE) with a broader scope to provide national norms for the JSE scores and examine associations between empathy in medical students and demographic variables, undergraduate major, specialty interest, and prior health care employment. Also, the study will explore changes in empathy as students progress through medical school (Newton 2018).
Methods
Participants
Participants included 6009 first-year students (53% men, n = 3175) from 41 (out of 44) campuses of colleges of osteopathic medicine in the U.S., representing 93% of all branch campuses of colleges of osteopathic medicine.
Measures
The web-based survey included the JSE-S Version, the “Infrequency” Scale of the Zuckerman-Kuhlman Personality Questionnaire (ZKPQ, Zuckerman 2002), and demographic and background information. The landing page of the survey depicted a photo of an elderly patient and a female clinician holding hands in an empathic manner, followed by a page with a brief description of the project and the importance of the study, and another page with a brief message signed by the dean of the student’s corresponding college to encourage their participation.
Because most items of the JSE are transparent, respondents can answer the survey in a way that they consider to be more socially acceptable. One approach to control for the confounding effect of making “good impression” responses is to measure the degree of such attempts. For that purpose, we used the “Infrequency” scale of the ZKPQ. This is a 10-item scale (True/False responses) that was developed to measure the degree of “good impression” response bias. Scores on this scale higher than 3 indicate questionable validity of the respondent’s record. This scale has previously been used with medical students to control for the tendency to make “good impression” responses (Hojat 2016; Hojat et al. 2005b).
Procedures
We developed a preliminary version of the survey instrument that went through several iterations in pilot testing. Participants of the pilot studies included some members of research teams and their colleagues at Jefferson (the headquarters of the project), and the AACOM, and volunteer students from two medical schools.
Arrangements were made to select one (and sometimes two) research coordinators from each participating college, at senior administrator or faculty level, to serve as a liaison between the college, AACOM, and Jefferson research teams. The contribution of these research coordinators proved to be of utmost importance in encouraging students to participate and increasing response rates. The study was approved by the Institutional Review Board of Thomas Jefferson University and each participating college.
Statistical analyses
Correlational analysis, exploratory and confirmatory factor analysis, t test, Chi-square test, and analysis of variance and covariance were used in statistical analyses of data. When appropriate, effect size estimates were calculated to examine the practical significance of statistically significant findings.
Results and discussion
Response rates and usable sample
Response rates for the 41 participating college campuses ranged from a low of 33% to a high of 100%, with a median of 92% and a mean of 85%. Response rates for 80% of participating colleges exceeded our 75% target goal. This pattern of high response rates in a national study using an online survey is very impressive and probably unique. Response rates in online survey administration have been reported to hover around 35% in a meta-analytic study (Cho et al. 2013). A total of 6146 students responded. However, 137 were excluded due to incomplete data; thus, complete usable data were available for 6009 students.
Demographic information
Of the 6009 students in the usable sample, 3175 (53%) were men, 2795 (47%) were women; and the rest (n = 39, < 1%) either declined to answer or indicated other choices. Gender composition in this sample is very close to that for the total population of the 2017 first-year matriculants (n=7197) in the U.S. colleges of osteopathic medicine (54.7% men, 45.3% women) (AACOM 2018). Students’ age ranged from 19 to 51 years, with a mean of 24.8, median of 24, and a standard deviation of 3.4 years. The mean age for the total 2017 matriculants in U.S. colleges of osteopathic medicine was 24 years, and age range was 19-51 (AACOM 2018). The majority of respondents were White/Caucasian (n = 3618, 60%), followed by Asian (n = 1627, 27%), Hispanic/Latino/Spanish (n = 337, 6%), and Black/African American (n = 216, 4%). Ethnic composition of our study sample was similar to that of the total population of the 2017 first-year matriculants in U.S. colleges of osteopathic medicine (59.8% White/Caucasian, 24.4% Asian, 7.5% Hispanic/Latino, 3.2% Black/African American) (AACOM 2018).
Descriptive statistics
Descriptive statistics, and Cronbach’s coefficient α for the JSE for men and women separately, and for both genders combined are reported in Table 1. The JSE mean score for the combined sample was 116.54 (SD = 10.85). The mean score for men was 114.40 (SD = 11.34, range = 26–140) and for women it was 118.78 (SD = 9.78, range = 69–140). The gender difference was statistically significant (F(1,5968) = 250.94, p < 0.0001). Results remained unchanged by using analysis of covariance, controlling for the Infrequency scores as a covariate (adjusted mean for men = 114.44, for women = 118.74; adjusted F(1,5967) = 241.72, p < 0.0001).
Table 1.
Statistics | Men (n = 3175) | Women (n = 2795) | Total (n = 5970)a |
---|---|---|---|
Mean | 114.40 | 118.78 | 116.54 |
Median | 115 | 120 | 117 |
Mode | 116 | 119 | 119 |
SD | 11.34 | 9.78 | 10.85 |
Possible range | 20–140 | 20–140 | 20–140 |
Actual range | 26–140 | 69–140 | 26–140 |
Skewness | − 0.54 | − 0.61 | − 0.60 |
Kurtosis | 1.29 | 0.58 | 1.15 |
Cronbach’s coefficient alpha | 0.83 | 0.81 | 0.82 |
aThirty-nine respondents who did not specify their gender or reported other gender categories were excluded from analysis in this table
In national and international studies, the reported JSE mean scores vary, mostly hovering around 112 (standard deviations around 12) (Hojat 2016, pp. 124, 275–331). In one large scale study of first-year students at one allopathic medical school in the U.S. (n = 2637) who completed the JSE at the beginning of medical school, a mean score of 114.3 (SD = 10.4) was reported (Hojat and Gonnella 2015). Although the difference between the JSE mean scores obtained in the present study and in the study of allopathic medical students is statistically significant in the favor of osteopathic medical students (t(8605) = 8.54, p < 0.001), the effect size estimate of the difference (d = 0.20) indicates that such a difference is not practically (clinically) important (Cohen 1987).
The skewness index for the total study sample was − 0.60. Kurtosis for the JSE score distribution was 1.15. Similar findings have been reported in a large sample of allopathic medical students in one U.S. medical school (Hojat and Gonnella 2015). Cronbach’s coefficient α was 0.82 (0.83 for men and 0.81 for women). In examining a large number of national and international studies in which the JSE was used, the alpha coefficients were mostly in the 0.70–0.80 range with an average of 0.78 (Hojat 2016, pp. 124, 275–331). The alpha coefficients ranged from 0.75 to 0.84 (average = 0.80) for 11 entering classes between 2002 and 2012 in a study with allopathic medical students (Hojat and Gonnella 2015). These findings suggest similarity in reliability coefficients of the JSE in both osteopathic and allopathic medical students.
Item statistics
Respondents used the full range of responses (1–7) for all items. Item mean scores ranged from a low of 3.52 to a high of 6.63 (median = 5.92). Item standard deviations ranged from 0.63 to 1.50 (median = 1.07). The pattern of findings is similar to that reported for a large sample of first-year students in an allopathic medical school (Hojat and Gonnella 2015).
Item-total score correlations
Pearson correlation coefficients were calculated to examine correlations between each item score and the total score of the JSE. For that purpose, we calculated the corrected item-total score correlations (by excluding the corresponding item from the total JSE score). Corrected item-total score correlations ranged from a low of 0.20 to a high of 0.61 (median = 0.46). All correlations were positive and statistically significant (p < 0.01). Summary results are reported in Table 2. The pattern of findings is similar to that reported for first-year students in an allopathic medical school (Hojat and Gonnella 2015).
Table 2.
Abbreviated JSE Itemsc | Corrected item-total score correlation | Effect size of discrimination index |
---|---|---|
Understanding emotions in patient-clinician relationship (16) | 0.61 | 1.42 |
Empathy as a therapeutic factor (20) | 0.60 | 1.37 |
Attention to patients’ personal experiences (8) | 0.54 | 1.30 |
Non-verbal cues and body language in understanding patients (13) | 0.53 | 1.29 |
Patient-physician emotional ties in medical treatment (11) | 0.53 | 1.24 |
Place of emotion in medical treatment (14) | 0.53 | 1.14 |
Understanding is therapeutic to patient (10) | 0.51 | 1.27 |
Standing in patients’ shoes (9) | 0.51 | 1.27 |
Life events in understanding physical complaints (12) | 0.49 | 1.33 |
Attention to patients’ emotions (7) | 0.47 | 1.13 |
Empathy and clinical success (15) | 0.45 | 1.18 |
Understanding makes patients feel better (2) | 0.43 | 1.02 |
Thinking like patients for better care (17) | 0.41 | 1.14 |
Understanding body language in communication (4) | 0.38 | 0.98 |
Understanding patients’ feelings influences treatment (1) | 0.38 | 1.03 |
Taking patients’ perspectives (6) | 0.26 | 0.81 |
Viewing patients’ perspectives (3) | 0.26 | 0.78 |
Enjoy literature and arts (19) | 0.25 | 0.77 |
Sense of humor and clinical outcomes (5) | 0.21 | 0.67 |
Physician influenced by patients’ personal bonds (18) | 0.20 | 0.67 |
Mean (median) | 0.43 (0.46) | 1.09 (1.14) |
aCorrelations between scores on each item and the JSE total score by excluding the corresponding item from the total score. All correlations are statistically significant (p < 0.01)
bIn calculation of the effect size estimate (Cohen’s d) of the discrimination index, the item mean score of the JSE high scorers (top 33%, n = 2096), was subtracted from the item mean score of the JSE low scorers (bottom 33%, n = 2028), divided by the pooled standard deviation of the corresponding item
cNumbers in parentheses correspond to the item numbers in the JSE
Item discrimination effect size indices
To address the discrimination power of each item, we calculated the item discrimination index. For that purpose, we divided the sample into two groups of approximately top-third high scorers on the JSE (score > 122, n = 2096) and bottom-third low scorers (JSE score < 112, n = 2028). For each item, we calculated the difference of item mean scores between the top and bottom-third scoring groups, then divided the mean difference for each item by the pooled standard deviation of the item scores to calculate the item discrimination effect size index (similar to the Cohen’s d, Cohen 1987) (item discrimination effect size index = M top-third − M bottom-third/pooled SD).
Effect size estimates of the item discrimination indices are reported in Table 2. The item discrimination effect size indices ranged from a low of 0.67 to a high of 1.42 (median = 1.14). According to operational definitions on the magnitude of effect size estimates (d), suggested by Cohen (1987), all of the item discrimination effect size estimates reported in Table 2 are considered substantial and practically important. As expected, the item-total score correlations and the effect size estimates of the item discrimination indices were highly correlated (r = 0.97, p < 0.0001). The pattern of findings is similar to that reported in a large sample of first-year students in an allopathic medical school (Hojat and Gonnella 2015).
Factor analyses
We conducted both exploratory and confirmatory factor analyses of the JSE. For that purpose, we randomly divided the sample into two groups. Data for the first group (n = 3004) were used for exploratory factor analysis to examine underlying components of the JSE. Data for the second group (n = 3005) were used for confirmatory factor analysis to confirm the latent variable structure of the JSE. As expected, no significant difference was observed between the two above-mentioned groups on age, gender, ethnicity/race, or their scores on the JSE and the Infrequency scale of the ZKPQ.
Exploratory factor analysis
In most of the factor analytic studies of the JSE, orthogonal (varimax) rotation has been used to obtain independent factors. In this study we used oblique rotation (promax) to allow correlations among the extracted factors in order to examine if factor patterns remain unchanged. We also limited the number of retained factors to three to make the findings comparable to the previous studies in allopathic medical students and physicians (Hojat 2016; Hojat et al. 2002; Hojat and LaNoue 2014; Costa et al. 2017). The scree test was used to determine the number of factors to retain before rotation and showed that the plot of eigenvalues levels off after extraction of the third factor. This supported our decision to retain three factors for rotation. The Kaiser–Meyer–Olkin measure for sampling adequacy (MSA) was used which resulted in an overall index of 0.90, supporting the adequacy of data for factor analysis. Also, the Bartlett’s test for sphericity showed that the intercorrelation matrix was factorable (χ2(133) = 924.11, p < 0.0001).
The eigenvalues for the three retained factors before rotation were 5.52, 1.66, and 1.39, accounting for 28, 8, and 7% of the total variance, respectively. The first factor, entitled “Perspective Taking” in previous studies, included 10 items with factor coefficients equal to or greater than 0.35 (Table 3). The Cronbach’s coefficient alpha for this factor was 0.80. The second factor, “Compassionate Care,” included six items with factor coefficients equal to or greater than 0.52. The Cronbach’s coefficient alpha for this factor was 0.71. The third factor, “Walking in Patient’s Shoes,” included only two items with factor coefficients of 0.77 and 0.72. The Cronbach’s coefficient alpha for this factor was 0.71. This last factor may be considered as a residual factor because according to Velicer and Fava (1998), a minimum number of three items per factor is required for a stable factor.
Table 3.
Abbreviated JSE Itemsb | Factorsa | ||
---|---|---|---|
Factor 1 | Factor 2 | Factor 3 | |
Standing in patients’ shoes (9) | 0.66 | − 0.03 | 0.00 |
Understanding is therapeutic to patient (10) | 0.62 | 0.01 | 0.01 |
Understanding emotions in patient-clinician relationship (16) | 0.61 | 0.16 | 0.00 |
Thinking like patients for better care (17) | 0.60 | − 0.08 | − 0.03 |
Non-verbal cues and body language in understanding patients (13) | 0.57 | 0.10 | 0.00 |
Empathy as a therapeutic factor (20) | 0.54 | 0.20 | 0.00 |
Understanding makes patients feel better (2) | 0.53 | 0.01 | − 0.01 |
Understanding body language in communication (4) | 0.48 | − 0.04 | 0.07 |
Empathy and clinical success (15) | 0.44 | 0.10 | 0.00 |
Sense of humor and clinical outcomes (5) | 0.35 | − 0.09 | − 0.01 |
Attention to patients’ personal experiences (8) | 0.03 | 0.65 | − 0.02 |
Patient-physician emotional ties in medical treatment (11) | 0.03 | 0.64 | − 0.01 |
Place of emotion in medical treatment (14) | 0.03 | 0.62 | 0.00 |
Understanding patients’ feelings influences treatment (1) | − 0.09 | 0.59 | − 0.08 |
Life events in understanding physical complaints (12) | 0.05 | 0.54 | 0.06 |
Attention to patients’ emotions (7) | 0.03 | 0.52 | 0.07 |
Enjoy literature and arts (19) | − 0.02 | 0.28 | 0.05 |
Physician influenced by patients’ personal bonds (18) | − 0.01 | 0.21 | 0.05 |
Taking patients’ perspectives (6) | − 0.03 | 0.05 | 0.77 |
Viewing patients’ perspectives (3) | 0.03 | − 0.01 | 0.72 |
Eigenvalues | 5.52 | 1.66 | 1.39 |
Principal component factor analysis with oblique rotation used for half of the sample (n = 3004). Confirmatory factor analysis was performed in the other half of the sample
aItems are listed by the descending order of magnitude of factor coefficients with each factor. Factor coefficients > 0.35 are shown in bold. Items were scored using a 7-point Likert-type scale. Half of the items are reverse scored
bNumbers in parentheses refer to the item number in the JSE
Two items had moderate factor coefficients (0.21 and 0.28) on the second factor (see Table 3). Both of these items showed significant item-total score correlations and substantial discrimination effect size indices, indicating that these items significantly predict the JSE total score and can make a distinction between high and low JSE scorers. Therefore, despite their lower factor coefficients, we suggest to retain them in the instrument.
The three aforementioned factors emerged in a multinational-multilanguage study by Costa and his colleagues (2017) who examined the underlying constructs of the Interpersonal Reactivity Index (IRI) and the Jefferson Scale of Empathy (JSE) in samples of medical students in five countries. The general pattern of findings in this exploratory factor analysis is similar to those in most other studies in the U.S. and abroad. For example, similarities in factor pattern are observed in studies reported for allopathic medical students (Hojat and LaNoue 2014), physicians (Hojat et al. 2002) and nurses (Ward et al. 2009) in the Unites States and for samples of physicians in Italy (DiLillo et al. 2009), medical students in Iran (Shariat and Habibi 2013), Korea (Roh et al. 2010), Japan (Kataoka et al. 2009), Mexico (Alcorta-Garza et al. 2005), South Africa (Vallabh 2011), mainland China (Wen et al. 2013), Taiwan (Hsiao et al. 2012), Brazil (Paro et al. 2012), Austria (Preusche and Wagner-Menghin 2013), and England (Tavakol et al. 2011). In particular, the two factors of “Perspective Taking” and “Compassionate Care” emerged in almost all of the factor analytic studies of the JSE.
Confirmatory factor analysis
We used confirmatory factor analysis in a structural equation modeling (SEM) framework to confirm the JSE’s latent variable structure (Arbuckle and Wothke 1999). Based on the findings from exploratory factor analysis, we specified the measurement model as follows: The 20 items comprising the JSE were modeled as resulting from one of three underlying latent variables: “Perspective Taking” (10 items), “Compassionate Care” (8 items), and “Walking in Patient’s Shoes” (2 items) (see Fig. 1). The regression coefficient for one item-to-latent variable path for each latent variable was set to 1.0 to scale the latent variable, and covariances among the latent variables were modeled. A total of 43 parameters were estimated. The model was identified with 167 degrees of freedom.
An ‘independence’ model was also estimated, where all indicators load to a single latent variable as a first step in establishing evidence for dimensional structure, for comparison to the measurement model (Model 1, null model in Table 4). Data were imputed using a person-level mean imputation for three cases, n = 3005. The data showed marked multivariate non-normality, Mardia’s multivariate kurtosis = 208.39 (critical ratio value = 192.45).
Table 4.
(Fit Reference Value) | Model 1 Null Model |
Model 2 3 Factor Model |
Model 3 2 Factor Model |
---|---|---|---|
Χ2 (p > 0.05) | 15,695.36, p < .001 | 1343.56, p = .002 (Bollen–Stine) | 1229.473, p < .001 |
χ2/df (~ <5.0) | 82.61 | 8.05 | 9.17 |
RMSEA ~ (< 0.05) | 0.165 | 0.048 | 0.052 |
CFI* | 0.0 | 0.925 | 0.922 |
TLI* | 0.0 | 0.914 | 0.911 |
*Values > 0.90 are considered good, and values > 0.95 are excellent
Estimation
We assume that the JSE is a reflexive indicator of an underlying continuous latent variable and thus conduct this analysis in a ‘normal theory’ framework. Simulation research suggests that in cases of continuous but highly non-normal data, parameter estimates using maximum likelihood (ML) estimation may be approximately correct in large samples, but that the standard errors estimated are likely too small (Curran et al. 1996). To account for the non-normality of the multivariate distribution, we report estimation results and their significances with robust standard errors and a corrected model test statistic; the Bollen–Stine bootstrapped p value for the Chi-square test for model fit. Finally, given the large sample size, we also estimated the model using an asymptotically distribution free approach (ADF) which does not require an assumption of multivariate normality. This approach is used only to provide supplementary information for a more complete picture of model fit. Parameter estimates and significances (Fig. 1) are those from the bootstrapped ML estimation.
Model fit
In SEM, it is known that the Chi-square fit statistic is often positively biased using the maximum likelihood (ML) estimator when the data are non-normal (Curran et al. 1996). We therefore report the Bollen–Stine bootstrapped p value for Chi-square obtained from AMOS as a measure of exact fit. However, it is also well known that the Chi-square statistics are sensitive to sample size and that large samples can produce significant Chi-square values (indicating misfit) even when fit is acceptable. The Bollen–Stine bootstapped p value is not immune to this issue. Thus, we also report other well accepted measures of model fit. The model Chi-square divided its degrees of freedom is a parsimony adjusted transformation of the Chi-square value to account for model complexity. The RMSEA (root-mean squared error) is also a measure of exact fit and indexes how well the model fits the population covariance matrix. A perfect fitting model would have RMSEA of 0, and therefore smaller values are desired. The comparative fit index (CFI) is an incremental measure of model fit relative to the null model and can be loosely interpreted as a measure of proportion of variance explained. Finally, we report the Tucker-Lewis Index (TLI), an additional incremental fit index related to the CFI, but that is parsimony adjusted.
The 3-factor measurement model (Model 2, Table 4) fit reasonably well with RMSEA = 0.048 and the ratio of Chi-square to df = 8.0. Both the TLI and the CFI exceeded 0.90 (0.925 and 0.914, respectively) indicating good, but not an excellent fit (Table 4). The model estimated with the asymptotically distribution free estimation method showed increased fit with respect to the RMSEA, but worse fit with the CFI and TLI.
Modification indices suggest that correlations among errors as well as correlations between error terms and latent variables are likely responsible for model misfit rather than misspecification of the measurement model overall. The only modification indices suggested that bear on the model structure were for indicator latent relationships in the WIPS factor. As previously investigated (Hojat and LaNoue 2014), a two-factor model (owing to the fact that the WIPS factor only has two indicators) was again investigated by specifying a model where the WIPS latent variable and the two items that load on it are omitted (Model 3, 2-factor model in Table 4). This model is a worse fit to the data (Table 4).
In a large scale exploratory and confirmatory factor analytic study with allopathic medical students (Stansfield et al. 2016), a 3-factor model was confirmed as an acceptable fit for the preclinical years, but a 4-factor model emerged as a better fit for the clinical years of medical school education. Similarly, the 3-factor structure was also confirmed in medical students from two Spanish medical schools (Ferreira-Valente et al. 2016), and in Turkish medical students (Bilgel and Ozcakir 2017).
In summary, data in this large scale study with osteopathic medical students supported most of the previously reported findings on underlying constructs and confirmation of the latent variable structure of the JSE (S-Version). Similarities in factor pattern of the JSE in different samples in different medical education systems, and in different countries indicate that the underlying components of the scale are relatively stable, regardless of cultural variation. The three components of “Perspective Taking”, “Compassionate Care”, and “Walking in the Patient’s Shoes” which emerged in this and some other factor analytic studies of the JSE are consistent with the components of empathy often reported in the literature.
National norm table
Prior to this study, there were no national norm tables available for the JSE or for any other empathy measuring instrument in medical students. This project provided a golden opportunity to develop the first and only national norm table of empathy scores to determine the percentile rank of any first-year student enrolled in osteopathic medical colleges in the U.S. at the beginning of the academic year, prior to being exposed to formal medical education
There was a total of 5818 first-year students (3071 men and 2747 women) with scores on the JSE after excluding those students who did not identify as “male” or “female” and whose scores were above the cutoff on the Infrequency Scale of the ZKPQ; thus, students who attempted to produce socially desirable responses were excluded from the national norm table. We calculated percentile ranks for raw scores of the JSE from the score distribution in the national sample. Results are presented in Table 5. Because gender differences in the JSE scores (in favor of women) have consistently been observed in a large number of studies (for a review see Hojat 2016, pp. 169–187) including this study, we separately calculated the percentile ranks for men and women.
Table 5.
JSE | Men (n = 3071) | Women (n = 2747) | Men and women combined (n = 5818) | ||||||
---|---|---|---|---|---|---|---|---|---|
Raw score | f | cf | Percentile rank | f | cf | Percentile rank | f | cf | Percentile rank |
≤ 80 | 19 | 19 | < 1 | 5 | 5 | < 1 | 24 | 24 | < 1 |
81–82 | 12 | 31 | 1 | 2 | 7 | < 1 | 14 | 38 | 1 |
83–84 | 7 | 38 | 1 | 1 | 8 | < 1 | 8 | 46 | 1 |
85–86 | 8 | 46 | 1 | 3 | 11 | < 1 | 11 | 57 | 1 |
87–88 | 8 | 54 | 2 | 5 | 16 | < 1 | 13 | 70 | 1 |
89–90 | 24 | 78 | 2 | 5 | 21 | 1 | 29 | 99 | 1 |
91–92 | 26 | 104 | 3 | 5 | 26 | 1 | 31 | 130 | 2 |
93–94 | 34 | 138 | 4 | 8 | 34 | 1 | 42 | 172 | 3 |
95–96 | 31 | 169 | 5 | 21 | 55 | 2 | 52 | 224 | 3 |
97–98 | 70 | 239 | 7 | 30 | 85 | 3 | 100 | 324 | 5 |
99–100 | 79 | 318 | 9 | 35 | 120 | 4 | 114 | 438 | 7 |
101–102 | 102 | 420 | 12 | 34 | 154 | 5 | 136 | 574 | 9 |
103–104 | 125 | 545 | 16 | 70 | 224 | 7 | 195 | 769 | 12 |
105–106 | 139 | 684 | 20 | 78 | 302 | 10 | 217 | 986 | 15 |
107–108 | 183 | 867 | 25 | 110 | 412 | 13 | 293 | 1279 | 19 |
109–110 | 199 | 1066 | 31 | 115 | 527 | 17 | 314 | 1593 | 25 |
111–112 | 211 | 1277 | 38 | 153 | 680 | 22 | 364 | 1957 | 31 |
113–114 | 218 | 1495 | 45 | 147 | 827 | 27 | 365 | 2322 | 37 |
115–116 | 221 | 1716 | 52 | 204 | 1031 | 34 | 425 | 2747 | 44 |
117–118 | 203 | 1919 | 59 | 207 | 1238 | 41 | 410 | 3157 | 51 |
119–120 | 208 | 2127 | 66 | 237 | 1475 | 49 | 445 | 3602 | 58 |
121–122 | 198 | 2325 | 72 | 211 | 1686 | 58 | 409 | 4011 | 65 |
123–124 | 175 | 2500 | 79 | 212 | 1898 | 65 | 387 | 4398 | 72 |
125–126 | 144 | 2644 | 84 | 203 | 2101 | 73 | 347 | 4745 | 79 |
127–128 | 119 | 2763 | 88 | 206 | 2307 | 80 | 325 | 5070 | 84 |
129–130 | 89 | 2852 | 91 | 161 | 2468 | 87 | 250 | 5320 | 89 |
131–132 | 92 | 2944 | 94 | 117 | 2585 | 92 | 209 | 5529 | 93 |
133–134 | 59 | 3003 | 97 | 82 | 2667 | 96 | 141 | 5670 | 96 |
135–136 | 37 | 3040 | 98 | 48 | 2715 | 98 | 85 | 5755 | 98 |
137–138 | 16 | 3056 | 99 | 28 | 2743 | 99 | 44 | 5799 | 99 |
139–140 | 15 | 3071 | > 99 | 4 | 2747 | > 99 | 19 | 5818 | > 99 |
Excluded were respondents who did not select “male” or “female” (< 1%), and those who did not answer all items of the Infrequency Scale of the ZKPQ (used to identify respondents who attempted to make “good impression”). Only 2.5% of respondents scored above the cutoff score of > 3 on the Infrequency Scale who were excluded from data used for this norm table
f: Frequency
cf: Cumulative frequency
National norm data reported in Table 5 can be used only for the assessment of JSE scores of new matriculants to osteopathic medical schools. We are in the process of collecting similar data from nationwide samples of students in different years of osteopathic medical schools that will be reported in due course.
Conclusion
Findings of this study with first-year students at U.S. colleges of osteopathic medicine provided additional evidence in support of credibility of the JSE. Findings reaffirmed the latent variable structure of the JSE. Results were generally similar to those reported for allopathic medical students and other health professions students and practitioners. The norm table developed in this study can assist in assessing individuals’ scores against national norms, and can potentially serve as an additional criterion for admissions decisions, or for breaking ties in applicants with similar academic qualifications.
Acknowledgements
This study is part of a nationwide Project in Osteopathic Medical Education and Empathy (POMEE) sponsored by the American Association of Colleges of Osteopathic Medicine, American Osteopathic Association, and the Cleveland Clinic. Many individuals contributed to this project, but to save space, we would like to acknowledge those who made a significant contribution to the success of this project. They are members of the AACOM team, especially Thomas Levitan who was instrumental at the onset of this project in helping to develop the survey instrument; our colleagues in the Jefferson research team including Shira Carroll, Jon Veloski, Vittorio Maio, Daniel Z. Louis, and our colleagues at the Jefferson Department of Information Services and Technology, Tracy Treadway and Luke Kedziora, who helped us in preparing the research survey for online administration. Deans and each of the research coordinators from participating college campuses made a valuable contribution to the success of this project. We would like to recognize the contribution of the following research coordinators from participating college campuses in alphabetic order: Casey Bassett, Michael Becker, Joseph Bianco, Linda Boyd, Joseph Brewer, Lisa Carroll, Mark Clark, Karen Clayton, LeAnn Jons-Cox, Glenn Davis, Robyn Dreibelbis, Marti Echols, Kyle Henderson, Ana Maria Homs, Sherri Howell, Justina Hyfantis, Britt Johnson, Jennifer Jordan, Gretchen Lovett, Susan Mackintosh, Ed Magalhaes, Patience Mason, Elizabeth McClain, Terrance Miller, Malcolm Modrzakowski, David Mokler, Bruce Newton, Loree Ratto, Sean Reeder, Tristan Reynolds, Mireille Rizall, Raquel Romanick, Miko Rose, Renay Scales, Trish Sextan, Amy Schlueter, Dana Shaffer, Robert Sorrells, Vivian Stevens, Mary Ann Taylor, Clint Whitson, and Rynn Ziller. We are also thankful to Dorissa Bolinski for her editorial assistance. Special thanks to all of the thousands of osteopathic medical students who voluntarily and willingly completed the online survey of this project.
References
- American Association of Colleges of Osteopathic Medicine (AACOM). (2018). 2017 AACOMAS applicant and matriculant profile summary report.
- Alcorta-Garza A, Gonzalez-Guerrero JF, Tavitas-Herrera SE, Rodrigues-Lara FJ, Hojat M. Validación de la escala de empatia medica de Jefferson en estudiantes de medicina Mexicanos [Validity of the Jefferson Scale of Physician Empathy among Mexican medical students] Salud Mental [Mental Health] 2005;28:57–63. [Google Scholar]
- American Board of Internal Medicine Evaluation of humanistic qualities in the internist. Annals of Internal Medicine. 1983;99:720–724. doi: 10.7326/0003-4819-99-5-720. [DOI] [PubMed] [Google Scholar]
- Arbuckle JJ, Wothke W. Amos 4.0 user’s guide. Chicago, IL: SPSS; 1999. [Google Scholar]
- Arora S, Ashrafian H, Davis R, Athanasiou T, Darzi A, Sevdalis N. Emotional intelligence in medicine: A systematic review through the context of the ACGME competencies. Medical Education. 2010;44:749–764. doi: 10.1111/j.1365-2923.2010.03709.x. [DOI] [PubMed] [Google Scholar]
- Association of American Medical Colleges Learning objectives for medical student education–Guidelines for medical schools: Report I of the medical school objectives project. Academic Medicine. 1999;74:13–18. doi: 10.1097/00001888-199901000-00010. [DOI] [PubMed] [Google Scholar]
- Austin EJ, Evans P, Goldwater R, Potter V. A preliminary study of emotional intelligence, empathy and exam performance in first year medical students. Personality and Individual Differences. 2005;39:1395–1405. doi: 10.1016/j.paid.2005.04.014. [DOI] [Google Scholar]
- Bailey BA. Empathy in medical students: Assessment and relationship to specialty choice. Dissertation Abstracts International. 2001;62(6-A):2024. [Google Scholar]
- Baron-Cohen S. The essential difference: The truth about the male and female brain. New York: Basic Books; 2003. [Google Scholar]
- Berg K, Blatt B, Lopreiato J, Jung J, Schaeffer A, Heil D, Hojat M. Standardized patient assessment of medical students empathy: Ethnicity and gender effects in a multi-institutional study. Academic Medicine. 2015;90:105–111. doi: 10.1097/ACM0000000000000529. [DOI] [PubMed] [Google Scholar]
- Berg K, Majdan JF, Berg D, Veloski J, Hojat M. A comparison of students’ self-reported empathy with simulated patients’ assessment of the students’ empathy. Medical Teacher. 2011;33:388–391. doi: 10.3109/0142159x.2010.530319. [DOI] [PubMed] [Google Scholar]
- Bilgel N, Ozcakir A. Turkish version of the Jefferson Scale of Empathy psychometric properties. European Scientific Journal. 2017 doi: 10.19044/esj.2017.v13n20p101. [DOI] [Google Scholar]
- Brazeau CMLR, Schroeder R, Rovi S, Boyd L. Relationship between medical student burnout, empathy, and professionalism climate. Academic Medicine. 2010;85:s33–s36. doi: 10.1097/ACM.0b013e3181ed4c47. [DOI] [PubMed] [Google Scholar]
- Calabrese LH, Bianco JA, Mann D, Massello D, Hojat M. Correlates and changes in empathy and attitudes toward interprofessional collaboration in osteopathic medical students. Journal of American Osteopathic Association. 2013;113:898–907. doi: 10.7556/jaoa.2013.068. [DOI] [PubMed] [Google Scholar]
- Chaitoff A, Sun B, Windover A, Bokar D, Featherall J, Rotheberg MB, Misra-Hebert AD. Associations between physician empathy, physician characteristics, and standardized measures of patient experience. Academic Medicine. 2017;92:1464–1471. doi: 10.1097/ACM.0000000000001671. [DOI] [PubMed] [Google Scholar]
- Chen DCR, Kirshenbaum DS, Yan J, Kirshenbaum E, Aseltine RH. Characterizing changes in student empathy throughout medical school. Medical Teacher. 2012;34:305–311. doi: 10.3109/0142159X.2012.644600. [DOI] [PubMed] [Google Scholar]
- Chen D, Lew R, Hershman W, Orlander J. A cross-sectional measurement of medical student empathy. Journal of General Internal Medicine. 2007;22:1434–1438. doi: 10.1007/s11606-007-0298-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cho YI, Johnson TP, VanGeest JB. Enhancing surveys of health care professionals: A meta-analysis of techniques to improve response. Evaluation and the Health Professions. 2013;36:382–407. doi: 10.1177/0163278713496425. [DOI] [PubMed] [Google Scholar]
- Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum; 1987. [Google Scholar]
- Colliver JA, Conlee MJ, Verhulst SJ, Dorsey JK. Rebuttals to critics of studies of the decline on empathy. [letter to the editor] Academic Medicine. 2010;85:1813–1814. doi: 10.1097/ACM.0b013e3181fa3576. [DOI] [PubMed] [Google Scholar]
- Coplan A. Understanding empathy: Its features and effects. In: Coplan A, Goldie P, editors. Empathy: Philosophical and psychological perspectives. New York: Oxford University Press; 2014. pp. 3–18. [Google Scholar]
- Costa P, Alves R, Neto I, Marvão P, Portela M, Costa MJ. Associations between medical student empathy and personality: A Multi-Institutional Study. PLoS ONE. 2014;9(3):e89254. doi: 10.1371/journal.pone.0089254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Costa P, de Carvelho-Filho MA, Schweller M, Thiemann P, Salguera A, Benson J, Quince T. Measuring medical students’ empathy: Exploring the underlying constructs of and associations between two widely used self-report instruments in five countries. Academic Medicine. 2017;92:860–867. doi: 10.1097/ACM.0000000000001449. [DOI] [PubMed] [Google Scholar]
- Costa PT, Jr, McCrea RB. Revised NEO Personality Inventory (NEO PI-R) and NEO Five Factor Inventory (NEO-FFI): Professional manual. Odessa, FL: Psychological Assessment Resources; 1992. [Google Scholar]
- Curran PJ, West SG, Finch JF. The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods. 1996;1:16–29. doi: 10.1037/1082-989X.1.1.16. [DOI] [Google Scholar]
- Davis MH. Measuring individual differences in empathy: Evidence for a multidimensional approach. Journal of Personality and Social Psychology. 1983;44:113–126. doi: 10.1037/0022-3514.44.1.113. [DOI] [Google Scholar]
- Del Canale S, Louis DZ, Maio V, Wang X, Rossi G, Hojat M, Gonnella JS. The relationship between physician empathy and disease complications: An empirical study of primary care physicians and their diabetic patients in Parma, Italy. Academic Medicine. 2012;87:1243–1249. doi: 10.1097/ACM.0b013e3182628fbf. [DOI] [PubMed] [Google Scholar]
- DiLillo M, Cicchetti A, Lo Scalzo A, Taroni F, Hojat M. The Jefferson Scale of Physician Empathy: Preliminary psychometrics and group comparisons in Italian physicians. Academic Medicine. 2009;84:1198–1202. doi: 10.1097/ACM.0b013e3181b17b3f. [DOI] [PubMed] [Google Scholar]
- Evans BJ, Stanley RO, Burrows GD. Measuring medical students’ empathy skills. British Journal of Medical Psychology. 1993;66:121–133. doi: 10.1111/j.2044-8341.1993.tb01735.x. [DOI] [PubMed] [Google Scholar]
- Eysenck HJ, Eysenck SBG. Manual of the Eysenck Personality Questionnaire (junior and adult) Essex: Hodder & Stoughton; 1975. [Google Scholar]
- Ferreira-Valente A, Costa P, Elorduy M, Virumbrales M, Costa MJ. BMC Medical Education. 2016;16:242. doi: 10.1186/s12909-016-0763-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fjortoft N, Van Winkle LJ, Hojat M. Measuring empathy in pharmacy students. American Journal of Pharmaceutical Education. 2011;75(6):Article 109. doi: 10.5688/ajpe756109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gonnella JS, Hojat M, Erdmann JB, Veloski JJ. What have we learned, and where do we go from here? In: Gonnella JS, Hojat M, Erdmann JB, Veloski JJ, editors. Assessment measures in medical school, residency, and practice: The connections. New York: Springer; 1993. pp. 155–173. [Google Scholar]
- Hasan S., Al-Sharqawi N., Dashti F., AbdulAziz M., Abdullah A., Shukkur M., Bouhaimed M., Thalib L. Level of Empathy among Medical Students in Kuwait University, Kuwait. Medical Principles and Practice. 2013;22(4):385–389. doi: 10.1159/000348300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hogan R. Development of an empathy scale. Journal of Consulting and Clinical Psychology. 1969;33:307–316. doi: 10.1037/h0027580. [DOI] [PubMed] [Google Scholar]
- Hojat M. Empathy in health professions education and patient care. New York: Springer International; 2016. [Google Scholar]
- Hojat M. Changes of empathy in medical school [letter to the editor] Medical Education. 2018;52:456–457. doi: 10.1111/medu.13497. [DOI] [PubMed] [Google Scholar]
- Hojat M, Bianco JA, Mann D, Massello D, Calabrese LH. Overlap between empathy, teamwork and integrative approach to patient care. Medical Teacher. 2015;37:755–758. doi: 10.3109/0142159x.2014.971722. [DOI] [PubMed] [Google Scholar]
- Hojat M, Erdmann JB, Gonnella JS. Personality assessments and outcomes in medical education and the practice of medicine (AMEE Guide 79) Dundee: Association for Medical Education in Europe (AMEE); 2014. [DOI] [PubMed] [Google Scholar]
- Hojat M, Gonnella JS. Eleven years of data on the Jefferson Scale of Empathy-medical student version (JSE-S): Proxy norm data and tentative cutoff scores. Medical Principles and Practice. 2015;24:344–350. doi: 10.1159/000381954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hojat M, Gonnella JS. What matters more about the Interpersonal Reactivity Index and the Jefferson Scale of Empathy? Their underlying constructs or their relationships with pertinent measures of clinical competence and patient outcomes? Academic Medicine. 2017;92:743–745. doi: 10.1097/ACM.0000000000001424. [DOI] [PubMed] [Google Scholar]
- Hojat M, Gonnella JS, Mangione S, Nasca TJ, Veloski JJ, Erdmann JB, Magee M. Empathy in medical students as related to academic performance, clinical competence and gender. Medical Education. 2002;36:522–527. doi: 10.1046/j.1365-2923.2002.01234.x. [DOI] [PubMed] [Google Scholar]
- Hojat M, Gonnella JS, Nasca TJ, Mangione S, Veloski JJ, Magee M. The Jefferson Scale of Physician Empathy: Further psychometric data and differences by gender and specialty at item level. Academic Medicine [Supplement] 2002;77:S58–S60. doi: 10.1097/00001888-200210001-00019. [DOI] [PubMed] [Google Scholar]
- Hojat M, Gonnella JS, Nasca TJ, Mangione S, Vergare M, Magee M. Physician empathy: Definition, components, measurement, and relationship to gender and specialty. American Journal of Psychiatry. 2002;159:1563–1569. doi: 10.1176/appi.ajp.159.9.1563. [DOI] [PubMed] [Google Scholar]
- Hojat M, LaNoue M. Exploration and confirmation of the latent variable structure of the Jefferson Scale of Empathy. International Journal of Medical Education. 2014;5:73–81. doi: 10.5116/ijme.533f.0c41. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hojat M, Louis DZ, Markham FW, Wender R, Rabinowitz C, Gonnella JS. Physicians’ empathy and clinical outcomes in diabetic patients. Academic Medicine. 2011;86:359–364. doi: 10.1097/ACM.0b013e3182086fe1. [DOI] [PubMed] [Google Scholar]
- Hojat M, Mangione S, Kane G, Gonnella JS. Relationships between scores of the Jefferson Scale of Physician Empathy (JSPE) and the Interpersonal Reactivity Index (IRI) Medical Teacher. 2005;27:625–628. doi: 10.1080/01421590500069744. [DOI] [PubMed] [Google Scholar]
- Hojat M, Mangione S, Nasca TJ, Cohen MJM, Gonnella JS, Erdmann JB, Magee M. The Jefferson Scale of Physician Empathy: Development and preliminary psychometric data. Educational and Psychological Measurement. 2001;61:349–365. doi: 10.1177/00131640121971158. [DOI] [Google Scholar]
- Hojat M, Michalec B, Veloski J, Tykocinski ML. Can empathy, other personality attributes, and level of positive social influence in medical school identify potential leaders in medicine? Academic Medicine. 2015;90:505–510. doi: 10.1097/ACM.0000000000000652. [DOI] [PubMed] [Google Scholar]
- Hojat M, Spandorfer J, Isenberg G, Vergare M, Fassihi R. Psychometrics of the scale of attitudes toward physician-pharmacist collaboration: A study with medical students. Medical Teacher. 2012;34:e833–e837. doi: 10.3109/0142159X.2012.714877. [DOI] [PubMed] [Google Scholar]
- Hojat M, Vergare M, Isenberg G, Cohen M, Spandorfer J. Underlying construct of empathy, optimism, and burnout in medical students. International Journal of Medical Education. 2015;6:12–16. doi: 10.5116/ijme.54c3.60cd. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hojat M, Zuckerman M, Gonnella JS, Mangione S, Nasca T, Vergare M, Magee M. Empathy in medical students as related to specialty interest, personality, and perception of mother and father. Personality and Individual Differences. 2005;39:1205–1215. doi: 10.1016/j.paid.2005.04.007. [DOI] [Google Scholar]
- Hong M, Bahn GH, Lee WH, Moon SJ. Empathy in Korean psychiatric residents. Asia-Pacific Psychiatry. 2011;3:83–90. doi: 10.1111/j.1758-5872.2011.00123x. [DOI] [Google Scholar]
- Hsiao CY, Tsai YF, Kao YC. Psychometric properties of a Chinese version of the Jefferson Scale of Empathy—Health Profession Students. Journal of Psychiatric and Mental Health Nursing. 2012;12:866–873. doi: 10.1111/jpm.12024. [DOI] [PubMed] [Google Scholar]
- Kataoka HU, Koide N, Hojat M, Gonnella JS. Measurement and correlates of empathy among female Japanese physicians. BMC Medical Education. 2012;12:48. doi: 10.1186/1472-6920-12-48. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kataoka H, Koide N, Ochi K, Hojat M, Gonnella JS. Measurement of empathy among Japanese medical students: Psychometrics and score differences by gender and level of medical education. Academic Medicine. 2009;84:1192–1197. doi: 10.1097/ACM.0b013e3181b180d4. [DOI] [PubMed] [Google Scholar]
- Kliszcz J, Nowicka-Sauer K, Trzeciak B, Nowak P, Sadowska A. Empathy in health care providers–validation study of the Polish version of the Jefferson Scale of Empathy. Advances in Medical Sciences. 2006;51:219–225. [PubMed] [Google Scholar]
- Lamothe M, Boujut E, Zenasni F, Sultan S. To be or not to be empathic: The combined role of empathic concern and perspective taking in understanding burnout in general practice. BMC Family Practice. 2014;15:15. doi: 10.1186/1471-2296-15-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LaNoue Marianna D., Roter Debra L. Exploring patient-centeredness: The relationship between self-reported empathy and patient-centered communication in medical trainees. Patient Education and Counseling. 2018;101(6):1143–1146. doi: 10.1016/j.pec.2018.01.016. [DOI] [PubMed] [Google Scholar]
- Linn LS, DiMatteo MR, Cope DW, Robbins A. Measuring physicians’ humanistic attitudes, values, and behaviors. Medical Care. 1987;25:504–515. doi: 10.1097/00005650-198706000-00005. [DOI] [PubMed] [Google Scholar]
- Maslach C. Burnout: A multidimensional perspective. In: Schaufeli WB, Maslach C, Marek FT, editors. Professional burnout: Recent developments in theory and research. Washington, DC: Taylor & Francis; 1993. [Google Scholar]
- Matravers D. Empathy as a route to knowledge. In: Coplan A, Goldie P, editors. Empathy: Philosophical and psychological perspectives. New York: Oxford University Press; 2014. pp. 19–30. [Google Scholar]
- Mehrabian A, Epstein NA. A measure of emotional empathy. Journal of Personality. 1972;40:525–543. doi: 10.1111/j.1467-6494.1972.tb00078.x. [DOI] [PubMed] [Google Scholar]
- Newton BW. Insights on the nationwide project in osteopathic medical education and empathy (POMEE) The Journal of the American Osteopathic Association. 2018;118:e28–e32. doi: 10.7556/jaoa.2018.076. [DOI] [PubMed] [Google Scholar]
- Paro H, Daud-Gallotti RM, Tiberio IC, Pinto RMC, Martins MA. Brazilian version of the Jefferson Scale of Empathy: Psychometric properties and factor analysis. BMC Medical Education. 2012;12:73. doi: 10.1186/1472-6920-12-73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pohl CA, Hojat M, Arnold L. Peer nominations as related to academic attainment, empathy, and specialty interest. Academic Medicine. 2011;86:747–751. doi: 10.1097/ACM.0b013e318217e464. [DOI] [PubMed] [Google Scholar]
- Preusche I, Wagner-Menghin M. Rising to the challenge: Cross-cultural adaptation and psychometric evaluation of the adapted German version of the Jefferson Scale of Physician Empathy for students (JSPE-S) Advances in Health Science Education: Theory and Practice. 2013;18:573–587. doi: 10.1007/s10459-012-9393-9. [DOI] [PubMed] [Google Scholar]
- Roh MS, Hahm BJ, Lee DH, Suh DH. Evaluation of empathy among Korean medical students: A cross-sectional study using Korean version of the Jefferson Scale of Physician Empathy. Teaching and Learning in Medicine: An International Journal. 2010;22:167–171. doi: 10.1080/10401334.2010.488191. [DOI] [PubMed] [Google Scholar]
- Roter D, Larson S. The Roter interaction analysis system (RIAS): Utility and flexibility for analysis of medical interactions. Patient Education and Counseling. 2002;46:243–251. doi: 10.1016/S0738-3991(02)00012-5. [DOI] [PubMed] [Google Scholar]
- Shariat SV, Habibi M. Empathy in Iranian medical students: Measurement model of the Jefferson Scale of Empathy. Medical Teacher. 2013;35:e913–e918. doi: 10.3109/0142159x.2012.714881. [DOI] [PubMed] [Google Scholar]
- Stansfield RB, Schwartz A, O’Brien CL, Dekhtyar M, Dunham L, Quirk M. Development of a metacognitive effort construct of empathy during clinical training: A longitudinal study of the factor structure of the Jefferson Scale of Empathy. Advances in Health Science Education. 2016;21:5–17. doi: 10.1007/s10459-015-9605-1. [DOI] [PubMed] [Google Scholar]
- Stern DT, editor. Measuring medical professionalism. Oxford: Oxford University Press; 2006. [Google Scholar]
- Taragin MI, Sonnenberg FA, Karns ME, Trout R, Shapiro S, Carson JL. Does physician performance explain interspecialty differences in malpractice claim rates? Medical Care. 1994;32:661–667. doi: 10.1097/00005650-199407000-00001. [DOI] [PubMed] [Google Scholar]
- Tavakol S, Dennick R, Tavakol M. Psychometric properties and confirmatory factor analysis of the Jefferson Scale of Physician Empathy. BMC Medical Education. 2011;11:54. doi: 10.1186/1472-6920-11-54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vallabh K. Psychometrics of the student version of the Jefferson Scale of Physician Empathy (JSPE-S) in final-year medical students in Johannesburg in 2008. South African Journal of Bioethics and Law. 2011;4:63–68. [Google Scholar]
- Van Winkel LJ, Fjortoft N, Hojat M. Validation of an instrument to measure pharmacy and medical students’ attitudes toward physician-pharmacist collaboration. American Journal of Pharmaceutical Education. 2011;75(9):Article 178. doi: 10.5688/ajpe759178. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Velicer WF, Fava JL. Effects of variable and subject sampling on factor pattern recovery. Psychological Methods. 1998;3:231–251. doi: 10.1037/1082-989X.3.2.231. [DOI] [Google Scholar]
- Veloski J, Hojat M. Measuring specific elements of professionalism: Empathy, teamwork, and lifelong learning. In: Stern DT, editor. Measuring medical professionalism. Oxford: Oxford University Press; 2006. pp. 117–145. [Google Scholar]
- Voinescu BI, Szentagotai A, Coogan A. Residents’ clinical empathy: Gender and specialty comparisons—A Romanian study. Acta Medica Academica. 2009;38:11–15. doi: 10.5644/ama.v38i1.50. [DOI] [Google Scholar]
- Ward J, Schaal M, Sullivan J, Bowen ME, Erdmann JB, Hojat M. Reliability and validity of the Jefferson Scale of Empathy in undergraduate nursing students. Journal of Nursing Measurement. 2009;17:73–88. doi: 10.1891/1061-3749.17.1.73. [DOI] [PubMed] [Google Scholar]
- Wen D, Ma X, Li H, Liu Z, Xian B, Liu Y. Empathy in Chinese medical students: Psychometric characteristics and differences by gender and year of medical education. BMC Medical Education. 2013;13:130. doi: 10.1186/1472-6920-13-130. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xia L, Hongyu S, Xinwei F. Study on correlation between empathy ability and personality characteristics of undergraduate nursing students. Chinese Nursing Research. 2011;32:2933–2935. [Google Scholar]
- Zenasni F, Boujut E, de Vaure CB, Catu-Pinault A, Tavani JL, Rigal L, Sultan S. Development of a French-language version of the Jefferson Scale of Physician Empathy and association with practice characteristics and burnout in a sample of general practitioners. The International Journal of Person Centered Medicine. 2012;2:759–766. [Google Scholar]
- Zuckerman M. Zuckerman-Kuhlman Personality Questionnaire (ZKPQ): An alternative five-factor model. In: DeRaad B, Perugini M, editors. Big five assessment. Seattle, WA: Hogrefe & Huber; 2002. pp. 377–396. [Google Scholar]