Abstract
Part One of this two-article series reviews assessment tools to measure burnout and other negative states. Physician well-being goes beyond merely the absence of burnout. Transient episodes of burnout are to be expected. Measuring burnout alone is shortsighted. Well-being includes being challenged, thriving, and achieving success in various aspects of personal and professional life. In this second part of the series, we identify and describe assessment tools related to wellness, quality of life, resilience, coping skills, and other positive states.
INTRODUCTION
In 2009, Shanafelt and colleagues proposed that “wellness goes beyond merely the absence of distress and includes being challenged, thriving, and achieving success in various aspects of personal and professional life.”1 Siedsma and Emle defined it as “the complex and multifaceted nature of physicians’ physical, mental and emotional health, and well-being.”2 The American College of Emergency Physicians (ACEP) proposed a multidimensional wellness model in 2016, the components of which are the following: occupational, emotional, physical, financial, spiritual, social, and intellectual. When viewing this model, it is clear how these areas are interconnected and critical in a person’s everyday life and that any approach to well-being must offer a holistic approach incorporating the different psychosocial aspects affecting the physician.3,4 Despite these and other frameworks, no clear consensus definition of well-being exists in the academic medical literature.5 Well-being is comprised of multiple variables including work-life balance, quality of life, resilience, mindfulness, coping strategies, and mood. In this review we explore the tools that assess the positive states of physician well-being.
The importance of physician well-being has now been universally recognized, with calls to action made by virtually every major medical society, including the American Medical Association, the Association of American Medical Colleges, and the Accreditation Council for Graduate Medical Education and in emergency medicine (EM) by the Council of Residency Directors (CORD), ACEP, and the Society for Academic Emergency Medicine. Whether wellness and well-being can be taught remains to be determined, and there is no standard for assessment or improvement. Numerous studies have looked at various aspects, but either due to small or specific sample size or confounding factors that lacked consideration, interpretation of and extrapolation of the results of these interventions should be done with caution.6
Summary
Well-being is a complex and multifactorial topic. Accurate measurement is key to conducting needs assessments, developing appropriate interventions, and ongoing monitoring.7 There are numerous tools available for assessment. The goal of the Assessment Tools Workgroup, a sub-committee of the CORD Resilience Committee, was to research and summarize the various assessment tools available on burnout, well-being, resilience, and related factors and compile them as a collated resource. This is the second resource available in this series; it focuses on assessment tools to measure well-being, resilience, and other positive states. For assessment tools related to burnout and negative states, please refer to “The Assessment of Physician Well-being, Part One: Burnout and Other Negative States.”
METHODS
The instruments included in this article are the result of a scoping review of English-language publications with abstracts indexed in PubMed, Web of Science, and MedEd Portal within the past 10 years. Searches were based on the main Medical Library Subject Heading (MeSH) terms “resilience,” “mindfulness,” “mood,” “personality,” “well-being,” “quality of life,” and “stress.” In addition to the search on the main term, subheadings included the following: measurement, assessment, evaluation, diagnosis, education, etiology, trends, derivation, validation, tool, instrument, scale, measure, survey, or questionnaire AND resident, residency, intern, internship, medical student, clerk, attending, physician and clinician. A complete listing of search terms can be found in Appendix 1. This search was augmented by reviewing article reference lists and performing further citation searches. We did not include instruments cited only in abstracts or as reports of meetings.
Abstractors performed a comprehensive review of the identified assessment tools. Details of all scales and where they can be found are presented in Table and Appendix 2. The tools identified as most relevant, accessible, and practical in evaluating emergency physician (EP) well-being were included for further review. The tools were selected by multiple abstractors. Abstractors worked in groups of two or three and focused on one subject (e.g., mindfulness or quality of life). Discrepancies between abstractors were reviewed by either the first, second, or last author on the manuscript. Consensus between at least two reviewers was required for an instrument to be included in this paper.
Table.
Name of instrument | Brief description | Number of items | Time to complete | Cost | Where to find it | Notes | Pros | Cons |
---|---|---|---|---|---|---|---|---|
Well-being and quality of life | ||||||||
Physician Wellness Inventory | It has three scales: career purpose, cognitive flexibility and distress. | 14 items | Two minutes | free | www.promoteyourwellness.com/PWI.docx | There are only two published studies using this instrument | Free Developed for physicians |
Limited studies, need more data on reliability and validity |
Physician Well Being Index (PWBI) | Used to: 1) stratify physician well-being in several important dimensions; and 2) identify physicians whose degree of distress may negatively impact their practice. |
Seven Items | < Five minutes | Free for individuals Organizations: $10k license and $5k yearly fee |
https://www.mededwebs.com/employee-well-being-index | Designed to measure burnout, provide valuable resources when people them the most, and track progress over time to promote self-awareness. | Short Externally validated Can be used for self-screening Provides self-directed learning resources |
Costly More useful for screening than detailed testing |
Quality of Life Linear Analog Scale Assessment (LASA) | LASA includes five simple items, each of which targets a specific domain of quality of life. | Five items | < Five minutes | Free | http://www.jpsmjournal.com/article/S0885-3924(07)00463-0/pdf | Specific domains include physical well-being (i.e., fatigue, activity level), emotional well-being (i.e., depression, anxiety, stress), spiritual well-being (i.e., sense of meaning, relationship with God), and intellectual well-being (i.e., ability to think clearly, concentrate). | Short Accessible Validated in multiple physician populations |
Multiple forms exist |
Professional Quality of Life Scale (ProQOL) | Self-report measure that asks the respondent to reflect on his or her experiences at work as a human service provider, both positive and negative, in the past 30 days. | 30 items | 5–10 minutes | Free, must credit the author | http://www.proqol.org/Home_Page.php | The ProQOL consists of three separate subscales: Compassion Satisfaction, Burnout, and Secondary Traumatic Stress. Standardized scores exist for all three (< 23 = low, 23–41 = average, > 41 = high). No composite score is available. It is recommended to complete the measure in its entirety rather than separate the questions into separate tests divided by subscale. | Free Validated Good reliability |
Indirect measure of “wellness” |
Epworth Sleepiness Scale (ESS) | Self-reported measure of how easily a person can fall asleep in different situations | Eight items | One minute | Free for individual use (Need a license for corporate use) |
http://epworthsleepinessscale.com/about-the-ess/ | The ESS specifically distinguishes reports of dozing behavior from feelings of fatigue and drowsiness/sleepiness | Free Quick and easy to use |
Subjective Risk for bias |
Resilience and mindfulness | ||||||||
Connor Davidson Resilience Scale (CD-RISC) | Used for clinical practice as a measure of stress and adaptability. Also used to evaluate response to clinical interventions. | 25 items | 5–10 minutes | Need agreement from authors with small fee Cost is dependent on type and extent of use |
http://www.connordavidson-resiliencescale.com/index.php | The scale has been developed and tested as a measure of degree of resilience. The scale also has promise as a method to screen people for high, intermediate or low resilience. | Well validated | Small fee. Initial intent to use on patients with mental illness. Limit use in physicians. |
Perceived Stress Scale (PSS) | Used to measure the perception of stress; measure of the degree to which situations in one’s life are appraised as stressful; items are designed to tap how unpredictable, uncontrollable and overloaded respondents find their lives; direct queries of current experienced stress | 14 items | 10–15 minutes | Free | http://www.psy.cmu.edu/~scohen/scales.html | A psychometrically sound global measure of perceived stress that could provide valuable information about the relationship between stress and pathology (correlations between high perceived stress and burnout). | Free Short Easy to use |
Not validated in health care providers |
Coping Inventory for Stressful Situations (CISS) | The CISS measures three types of coping styles: task-oriented coping, emotion-oriented coping, and avoidance-oriented coping. It helps you determine the preferred coping style. | 48 items | 10 minutes | CISS Manual = $57 Quik Score Form (25/pkg)=$60 |
http://www.mhs.com | Offers precision in predicting preferred coping styles, and contributes to understanding the differential relationships between coping styles and other personality variables. | Reliable and valid Tests the interaction of stress, anxiety, and coping |
Cost Not validated in a physician population |
Ways of Coping Scale (WAYS) | The Ways of Coping Questionnaire is a 66-item instrument containing a wide range of thoughts and acts that people use to deal with the internal and/or external demands of specific stressful encounters. | 66 items | 10 minutes | $50 for the manual $2.50/license (50 surveys minimum) |
http://www.mindgarden.com/158-ways-of-coping-questionnaire | An assessment of coping in relation to a specific stressful encounter. Not designed to be used as an assessment of coping styles or traits. | Well validated | Cost Length of instrument Not validated in a physician population. |
The COPE Inventory (brief) | The COPE Inventory is a multidimensional coping inventory to assess the different ways in which people respond to stress. | 28 items | 15 minutes | Free | www.psy.miami.edu/faculty/ccarver/sclBrCOPE.html | Five scales (of four items each) measure conceptually distinct aspects of problem-focused coping (active coping, planning, suppression of competing activities, restraint coping, seeking of instrumental social support) Provides individual’s insight into their typical coping response leading to increased mindfulness |
Free Easy to use |
Not validated in a physician population. Intended use is to provide insight into a typical coping response not a coping style. |
Mood and personality | ||||||||
Myers-Briggs Type Indicator (MBTI) | Introspective self-assessment tool that identifies psychological preferences in how people interact with their environments and make decisions. | 93 items | 15 minutes | $49.95 per user | https://www.cpp.com/products/mbti/index.aspx | Provides insight into an individual’s personality traits, can help us identify weaknesses and be better communicators and decision makers | Widely used and highly regarded Validated Good reliability |
Cost |
Profile of Mood States (POMS 2) | Self-report psychological rating scale use to assess transient, distinct mood states. Measures multiple dimensions of mood over a distinct period of time which include: Anger-Hostility, Confusion-Bewilderment, Depression-Dejection, Fatigue-Inertia, Tension-Anxiety, Vigor-Activity and Friendliness. | Full version: 65 items Short version: 35 items |
Full version: 10 minutes Short version: five minutes |
Manual $92, and Single full or short form $3.50 |
https://ecom.mhs.com(S(4sbwc3qmfsjjpo454qllycuj))/inventory.aspx?gr=cli&prod=poms2&id=pricing&RptGrpID=pmr | Provides insight into an individual’s current mood state and how that may affect their performance at work and interaction with others. | Allows for real-time assessment of risks for burnout, second victim syndrome, etc. | Cost Not well validate in physician population |
Thomas-Kilmann Conflict Mode Instrument (TKI) | Self-assessment tool that identifies individual conflict-handling styles, which are categorized into 5 “modes”: competing, collaborating, compromising, avoiding, and accommodating | 30 item | 15 minutes | $18.95 each, $179 pack of 10 | https://www.cpp.com/en/tkiitems.aspx?ic=4813 | Provides a pragmatic, situational approach to conflict resolution, change management, leadership development, and communication | Relevant Validated in physician populations |
Cost |
The primary inclusion criteria was use of the tool in a physician population in the medical literature. Exclusion criteria included tools that were not used in a physician population or were not cited in the medical literature relating to physicians more than two to three times. Tools that did not meet these two criteria are referenced in Appendix 2. The figure illustrates the search algorithm and tool selection process. The articles reviewed were organized by subcategory of the tool (e.g., mindfulness tools), then by individual tool, and finally, by the populations the tool had been used in.
A summary of the scale’s purpose, structure, and evidence of its psychometric properties were derived from the original source references. Due to the varied psychometric properties of each tool, abstractors relied on the reported validity and reliability from the source manuscripts. Where available, published cutoff scores are provided for guidance, although their validity or utility in other clinical or research contexts should not be assumed. Where psychometric properties were not explicitly described in the primary sources, potential users may need to check for any subsequent information pertaining to reliability and validity.
The following comments and discussions should be read in conjunction with the details reported in Table and Appendix 2, as well as with the recommendations provided at the end of the review.
RESULTS
Well-being Factors and Quality of Life Tools
While the definition of job burnout is relatively clear,8 well-being has been viewed through various domains9 and used interchangeably with quality of life (QOL).10 Higher perception of work-life imbalance negatively impacts work satisfaction and effect of work on QOL.11 Several authors investigating well-being in physicians used instruments initially intended for the general population or patients,10,12 while others derived instruments that specifically address the physician population.13
Physician Wellness Inventory
The Physician Wellness Inventory (PWI) is a measure of how happy and satisfied physicians are with their work. The PWI was piloted to assess attendings, residents and fellows from three academic centers in Michigan in 2010. The first and only study that used the PWI was performed in randomly selected full-time physician members of the American Academy of Family Physicians to assess the relationship between burnout and happiness. They found that career purpose was the strongest predictor of happiness.14 No other studies have evaluated the reliability and validity of this instrument. The major advantage of the PWI is that it was developed for physicians, taking into consideration their work settings and relationship to patients.
Physician Well-being Index
The authors at the Mayo Clinic School of Medicine developed the Physician Well-Being Index (PWBI) specifically for medical professionals, including resident and medical student versions.13,15,16 The purpose of the index is to stratify physician well-being in several important dimensions and to identify physicians whose degree of distress may negatively impact their practice (career satisfaction, intent to leave current position, medical errors). The seven-item survey includes domains of burnout, depression, stress, fatigue, and mental and physical QOL.
Quality of Life Linear Analog Self-assessment
The Quality of Life Linear Analog Self-Assessment (QOL LASA) scales have repeatedly been used in the literature to evaluate QOL in the cognitive, physical, emotional, social, or spiritual domains.17 In medical oncologists, high QOL LASA scores were associated with higher work satisfaction.18 One study employed the QOL LASA to measure the outcomes of a well-being initiative in a group of 40 internal medicine (IM) physicians who subsequently demonstrated a significant increase in QOL LASA scores post-intervention group.60 QOL LASA scores have been shown to be negatively correlated with self-perceived error reporting in several studies.19–21
Professional Quality of Life Scale
The Professional Quality of Life Scale (ProQOL) is the current iteration of several previously developed scales related to compassion fatigue including the Compassion Fatigue Scale, the Compassion Fatigue Self-Test, and the Compassion Satisfaction and Compassion Fatigue Test. ProQOL is a well-validated, 30-item scale that consists of three separate subscales: compassion satisfaction; burnout; and secondary traumatic stress. There are over 650 citations related to ProQOL, and its previous iterations in the medical literature. Key literature can be found here: http://www.proqol.org/uploads/ProQOL_Concise_2ndEd_12-2010.pdf. The ProQOL scale allows for monitoring of both the negative consequences (e.g., burnout and secondary traumatic stress) and protective qualities (e.g., compassion and satisfaction) of being in a caring profession.
Epworth Sleepiness Scale
Fatigue has long been linked to well-being and QOL. Sleep loss and fatigue have a significant negative impact on resident quality of life and perception of well-being.22 The Epworth Sleepiness Scale (ESS) is the most widely used tool to evaluate daytime sleepiness in a variety of populations and cultures. In multiple medical student studies, there were high rates of daytime sleepiness, higher levels of burnout, and academic performance.23–28 Increased sleepiness has been shown to be related to an increase in motor vehicle accidents among IM residents,29 with higher levels of stress and fatigue being independently associated with self-perceived medical errors.30
In a study with EM residents, sleep deprivation was found to significantly impact resident lives both personally and professionally with many social activities and meaningful personal pleasures being deferred or postponed during residency.31 Additionally, residents in that study reported that sleep loss and fatigue had a major impact on their ability to perform their work. While baseline characteristics have not been established and cross-specialty studies have not been done, one study of IM residents found that 23% had an abnormal ESS score.32
Coping Tools: Resilience and Mindfulness
EPs are subjected to high-stress situations on a regular basis. Stress is not burnout but a natural response defined as a state of mental or emotional strain or tension resulting from adverse or very demanding circumstances. Reaction to stressors is highly individualized, and numerous emotional and physical disorders have been linked to stress. Understanding the response to stress can provide insight into specific behavioral modifications that can be used to cope with stress in more positive ways.
There are numerous types of coping mechanisms, some positive and associated with increased mindfulness and resilience, and some negative, which worsen symptoms of burnout. Resilience, too, is a unique and central component of well-being, identified as “the ability of an individual to respond to stress in a healthy, adaptive way such that personal goals are achieved at minimal psychological and physical cost.”33 It is increasingly recognized as a strategy that may reduce physician stress, particularly burnout, anxiety, and depression. In one study conducting semi-structured interviews with a variety of physicians, self-awareness, self-monitoring, and mindfulness-based, stress-reduction techniques were determined to be as effective as techniques to reduce the negative feelings of emotional distress and consequent rumination while enhancing a physician’s capacity for empathy.34 This notion of self-awareness and self-care is thought to be teachable and can be enhanced, as demonstrated by one pilot study involving family medicine residents.35
Connor Davidson Resilience Scale
The Connor Davidson Resilience Scale (CD-RISC) was developed for clinical practice for patients with mental health concerns, particularly post-traumatic stress disorder and anxiety, as a measure of stress and adaptability. The initial paper also states three potential uses: to explore the biologic aspects of resilience; to use in clinical practice in an effort to recognize resilient characteristics and evaluate responses to interventions; and as a screening tool for high-risk, high-stress activities or occupations.36 The initial intent was to use the scale with patients suffering from mental illness. The CD-RISC targets five factors: personal competence; trust/tolerance/strengthening effects of stress; acceptance of change and secure relationships; control; and spiritual influences. The tool has been shown to have convergent and discriminant validity and to be reliable in multiple nationalities and populations.37,38
While it is one of the most widely used instruments for resilience, the CD-RISC may have some limitations, specifically a “ceiling effect.” In other words, the scale’s lack of items to detect higher levels of resilience characteristics as variables and of its capacity to measure higher levels of resilience limits its usefulness in analyzing certain professions known for higher levels of resilience, and thus may be deficient.39
Perceived Stress Scale
The Perceived Stress Scale (PSS) measures the degree to which situations in one’s life are viewed as stressful. This tool was designed with the intent of creating a psychometrically sound global measure of perceived stress that could provide information on the relationship between stress and pathology.40 The PSS has been widely used across the globe and most frequently with university students and those attempting to stop smoking. There are multiple studies on resident physicians who have used the PSS as an assessment of their well-being. In several of these studies, perceived overall stress was strongly related to work hours and was found to affect physicians more than other healthcare professionals (e.g., nurses).41 Resident physicians who screen positive for burnout also have higher perceived levels of stress, a pattern similarly shown in faculty physicians.42,43 Resident physicians have also been noted to have higher perceived levels of stress than matched controls in the general population.43 In several studies with nurses and faculty physicians, implementation of a resiliency program has shown improvement in scores on the PSS.44–46
The PSS is a highly reliable and valid measure of stress in adults across multiple ethnicities. It provides individuals insight into their typical stress-response state. This awareness, in turn, may potentially increase mindfulness and be used to target relaxation behaviors to relieve stress. A potential limitation of the PSS is that the initial intent of the tool was to link stress to pathologic behavior, particularly tobacco abuse. However, many studies in the medical literature have used the PSS to assess patients pre- and post-intervention for multiple disease processes. If one considers burnout symptoms pathological insofar as they have been linked to issues such as substance abuse, medical error, and poor patient satisfaction, then this limitation is of debatable significance.
Coping Inventory to Stressful Situations
The Coping Inventory to Stressful Situations (CISS) measures three types of coping styles when one encounters a stressful or challenging situation: emotion-oriented; task-oriented; and avoidance-oriented coping. It also measures distraction and social diversion. The tool is aimed at determining an individual’s preferred coping style to provide a better understanding of the relationship between that individual’s coping style and his or her personality. The results can be used to help intervention planning for individuals in stressful situations. There is also a modified 21-item tool for specific social situations or interpersonal conflicts (CISS: Situation-Specific Coping Measure [CISS:SSCM]).
The CISS and CISS:SSCM are reliable measures of coping styles, demonstrating internal consistency, test-retest reliability, and item-remainder correlation. The CISS scales also have demonstrated construct validity as assessed by factor analysis in adults, undergraduates, and adolescents.47 Data from the study of medical students and physicians in practice have shown that task-oriented coping plays a role in reducing burnout symptoms, while emotion-oriented and avoidance-oriented coping may do the opposite. Therefore, the CISS may be a valuable tool in identifying individuals who may require additional training in specific coping strategies to improve their resilience and/or reduce their risk of burnout.48
In a study of 616 emergency department (ED) personnel, increased levels of burnout were associated with emotion-oriented coping while decreased levels were observed in those with task-oriented coping.49 This was also demonstrated in a study of 50 IM physicians.50 The CISS has also been used to study medical students, demonstrating a correlation of task-oriented coping with higher levels of emotional intelligence.51 Emotional intelligence – the ability to perceive, process, and regulate emotions effectively – is thought to be a strong predictor of resident well-being.52 Two other studies of medical students found that avoidance-oriented coping was associated with increased measure of fatigue and depressive symptoms.53,54
The Ways of Coping Checklist, the Ways of Coping (Revised), the Ways of Coping Scale
The Ways of Coping Scales (WCCL, CAPS, WAYS) identify two distinct, general types of coping: problem-focused and emotion-focused. Problem-focused coping is aimed at problem solving or doing something to alter the source of stress. Emotion-focused coping is aimed at reducing or managing the emotional distress that is associated with or cued by the situation. While most stressors will elicit both types of coping, problem-focused coping tends to predominate when the individual feels as if something constructive can be done, leading to engagement of the problem, and emotion-focused coping predominates when the individual believes the stressor is something that must be endured, leading to problem avoidance and disengagement.55,56 The Ways of Coping measures are not designed to assess coping traits and/or style. Each administration of the tool is aimed at understanding the coping processes an individual engages in a particular stressful encounter rather than attempting to define their coping style or traits.
The CAPS measure has potential benefit in prospectively identifying individuals with more emotion-focused coping strategies who may be at risk of burnout. Its main limitation is that this tool is situation-specific and does not reflect the complexity of the situations in medical practice nor encompass the entirety of an individual coping skillset. Its strength lies in making an individual aware of how he or she copes with different, specific, stressful situations and providing language around coping responses that may be more mindful, healthful, and productive for them, their team, and their patients.
Coping Orientation to Problems Experienced
The Coping Orientation to Problems Experienced (COPE) Inventory and, more recently, the Brief COPE were designed to assess the different ways in which people respond to stress. This tool looks at many dimensions of coping, including both functional and dysfunctional responses. These dimensions include the following: active coping; planning; suppression of competing activities; restraint coping; seeking social support for instrumental reasons; seeking social support for emotional reasons; focusing on and venting emotions; behavioral disengagement; positive reinterpretation and growth; denial, acceptance; and turning to religion.59,60
The COPE Inventory was validated in a population of almost 1,000 undergraduate students in its final iteration. The authors state there is no such thing as an “overall” score on this measure and do not recommend a particular way of generating a dominant coping style for a given person. Instead, they advocate looking at each scale separately to see how it relates to the other variables. Thus, this tool may help with insight into coping response and personal reflection.
The Brief COPE has been used in studies involving IM and EM residents. In the study with IM residents, those residents who employed the strategies of acceptance, active coping, and positive reframing had lower emotional exhaustion and depersonalization, suggesting that residents who place a high priority on healthful relationships, engage in spiritual activities, and practice humility may have important coping mechanisms that mitigate burnout.56,58,59 Residents who employed denial, disengagement, self-blame, and humor were found to have higher emotional exhaustion and depersonalization. Disengagement and venting were found to be negatively correlated with personal accomplishment.
These tools are relatively short, free, and easy to use. They provide individuals with insight into their typical coping responses, thereby increasing mindfulness. Although used in physician populations, they have not been validated specifically in physician populations.
Mood and Personality Tools
Personality typing is a psychological concept popularized in the 1940s. Conceptually, it is founded on the notion that individuals favor certain psychological preferences and that personality traits affect how they perceive and interact with their environments. The ED is a unique medical environment where there is great emphasis on leadership, communication, and teamwork. The application of personality and mood assessment instruments may provide useful information about individual ED providers and create a more dynamic, efficient, and sound working environment.
Myers-Briggs Type Indicator
The Myers-Briggs Type Indicator (MBTI) is the most widely used of the personality assessment tools. This introspective, self-assessment tool separates people into four dichotomies that each focus on a particular aspect of information processing: extraversion/introversion; sensing/intuition; thinking/feeling; and judging/perceiving. In the medical community, the MBTI has been studied in medical students, dental students, and resident and attending physician populations, primarily among surgeons and anesthesiologists. Many researchers have applied the MBTI to assess for personality patterns among different specialties and identify personalities at increased risk for burnout.61–64 While the MBTI is the oldest and most well-studied in the physician population, it has yet to be shown how MBTI results can be implemented to benefit individual practitioners and the work environment.
Profile of Mood States
The Profile of Mood States (POMS) is a self-report, psychological rating scale that assesses multiple dimensions of mood over a distinct period of time. Such mood states include the following: anger-hostility, confusion-bewilderment, depression-dejection, fatigue-inertia, tension-anxiety, vigor-activity, and friendliness. The dynamic nature of the assessment may allow for real-time evaluation for risks of burnout and second-victim syndrome following an unforeseen or unfavorable outcome.
While the tool has been used in several physician populations,65–71 it is not well validated in the medical field.72–76 The enthusiasm of IM interns was found to give way to sustained depression, anger, and fatigue at the end of internship.67 A study of early-career physicians showed that acute sleep deprivation secondary to long call hours negatively affected mood.65 In one study of IM residents, mood disturbances were identified as common, and the decline in empathic concern was specifically found to persist throughout training unlike other mood disturbances that were no longer present by the end of residency.67
Thomas-Kilmann Conflict Mode Instrument
The Thomas-Kilmann Conflict Mode Instrument (TKI) is a self-assessment tool that identifies individual conflict-handling styles, which are categorized into five “modes:” competing, collaborating, compromising, avoiding, and accommodating. Conflict is inevitable in any team-based field due to personality and work-style differences. EPs manage the expectations and reactions of patients in crisis. Patient-centered care requires collaboration between the clinicians, patients, family, and other providers, which may lead to another source of conflict.
The TKI has been validated in the medical population including nurses, residents, board-certified physicians, hospital administrators, and program directors, although not specifically among emergency clinicians.77–80 In studies of resident physicians, there is a tendency for higher levels of accountability and successful execution of administrative tasks in individuals with collaborating or competing conflict modes.78,79 Identifying individual conflict-management styles, the TKI can help provide insight to EPs regarding their strengths and potential weakness in dealing with conflict, which may ultimately help them become better leaders in the department and better team players.
LIMITATIONS
There are an overwhelming number of assessment tools available in the literature that can be used to measure the different components of physician well-being. While our literature search was methodical and broad, we acknowledge that we may have missed some key assessment tools. At times, a single author determined the inclusion eligibility of the tools identified in our literature search strategy. However, consensus between at least two reviewers was required for an instrument to be included in this paper.
Assessment tools must be suitable for and validated in the population of interest. A majority of the tools we found have been used in a physician population but have never been validated in this population. Many of the tools have been designed for and validated in special populations; however, their applicability, reliability, and validity in a physician population is not clearly demonstrated in the medical literature. In the absence of independent validation, the results of these tools should be interpreted with caution.
Physician well-being is multifactorial, and it is difficult to purely divide these components by topic or sub-category as they have a complex interplay with one another. We have reviewed the tools based on the well-being topics that were most commonly found in the medical literature and that were of highest potential value. Very few tools exist that were either designed for use in a physician population or have been validated in physicians. We have highlighted the tools from each topic that are most relevant for use in assessing an EP population.
CONCLUSION
Physician well-being is a complicated topic, and there is no standardized approach for assessing it. We provide a framework of the assessment tools that can be used to evaluate the positive states of physician well-being. The assessment tools reviewed vary in the topic assessed, cost, length, and applicability to a physician population. This manuscript is intended to provide the reader with several available options for evaluating different components of physician well-being. It is at the discretion of the reader to determine which tool would be most appropriate for the outcome he or she is trying to measure. There is great opportunity for the development of new tools and validation of those that are already in use.
There is clearly much to be done in the development of resources to mitigate burnout, foster resilience, and improve well-being. When undertaking an assessment of physician well-being, it is of critical importance to understand what you want to assess and to ensure you have selected the best tool to assess it. We hope this manuscript gives emergency physicians a starting point to evaluate their own well-being and the well-being of their peers, trainees, and students.
Supplementary Material
Footnotes
Section Editor: Jeffrey Druck, MD
Full text available through open access at http://escholarship.org/uc/uciem_westjem
Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.
REFERENCES
- 1.Myers MF. The well-being of physician relationships. West J Med. 2001;174(1):30–3. doi: 10.1136/ewjm.174.1.30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Siedsma M, Emlet L. Physician burnout: can we make a difference together? Crit Care. 2015;19:273. doi: 10.1186/s13054-015-0990-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kaplan JA, Manfredi RA. Emergency Medicine Wellness Week 2016 to focus on self-care for emergency physicians. [Accessed January 14, 2016]. Available at: http://www.acepnow.com/article/emergency-medicine-wellness-week-2016-to-focus-on-self-care-for-emergency-physicians/
- 4.Eckleberry-Hunt J, Van Dyke A, Lick D, et al. Changing the conversation from burnout to wellness: physician well-being in residency training Pprograms. J Grad Med Educ. 2009;1(2):225–30. doi: 10.4300/JGME-D-09-00026.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Eckleberry-Hunt J, Lick D, Boura J, et al. An exploratory study of resident burnout and wellness. Acad Med. 2009;84(2):269–77. doi: 10.1097/ACM.0b013e3181938a45. [DOI] [PubMed] [Google Scholar]
- 6.Williams D, Tricomi J, Gupta J, et al. Efficacy of burnout interventions in the medical education pipeline. Acad Psychiatry. 2015;39(1):47–54. doi: 10.1007/s40596-014-0197-5. [DOI] [PubMed] [Google Scholar]
- 7.Dyrbye LN, Trockel M, Frank E, et al. Development of a research agenda to identify evidence-based strategies to improve physician wellness and reduce burnout. Ann Intern Med. 2017;166(10):743–4. doi: 10.7326/M16-2956. [DOI] [PubMed] [Google Scholar]
- 8.Maslach C, Schaufeli WB, Leiter MP. Job burnout. Annu Rev Psychol. 2001;52:397–422. doi: 10.1146/annurev.psych.52.1.397. [DOI] [PubMed] [Google Scholar]
- 9.Kiefer RA. An integrative review of the concept of well-being. Holist Nurs Pract. 2008;22(5):244–52. doi: 10.1097/01.HNP.0000334915.16186.b2. [DOI] [PubMed] [Google Scholar]
- 10.West CP, Shanafelt TD, Cook DA. Lack of association between resident doctors’ well-being and medical knowledge. Med Educ. 2010;44(12):1224–31. doi: 10.1111/j.1365-2923.2010.03803.x. [DOI] [PubMed] [Google Scholar]
- 11.Mahmood S, Jackson R, Zhao YD, et al. Assessment of work-life balance of resident physicians. Am J Med Sci. 2015;350(6):519–20. doi: 10.1097/MAJ.0000000000000508. [DOI] [PubMed] [Google Scholar]
- 12.Kassam A, Horton J, Shoimer I, et al. Predictors of well-being in resident physicians: a descriptive and psychometric study. J Grad Med Educ. 2015;7(1):70–4. doi: 10.4300/JGME-D-14-00022.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Dyrbye LN, Satele D, Sloan J, Shanafelt TD. Ability of the physician well-being index to identify residents in distress. J Grad Med Educ. 2014;6(1):78–84. doi: 10.4300/JGME-D-13-00117.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Eckleberry-Hunt J, Kirkpatrick H, Taku K, et al. Relation between physicians’ work lives and happiness. South Med J. 2016;109(4):207–12. doi: 10.14423/SMJ.0000000000000437. [DOI] [PubMed] [Google Scholar]
- 15.Dyrbye LN, Satele D, Sloan J, et al. Utility of a brief screening tool to identify physicians in distress. J Gen Intern Med. 2013;28(3):421–7. doi: 10.1007/s11606-012-2252-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Dyrbye LN, Szydlo DW, Downing SM, et al. Development and preliminary psychometric properties of a well-being index for medical students. BMC Med Educ. 2010;10:8. doi: 10.1186/1472-6920-10-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Priestman TJ, Baum M. Evaluation of quality of life in patients receiving treatment for advanced breast cancer. Lancet. 1976;1(7965):899–900. doi: 10.1016/s0140-6736(76)92112-7. [DOI] [PubMed] [Google Scholar]
- 18.Shanafelt TD, Novotny P, Johnson ME, et al. The well-being and personal wellness promotion strategies of medical oncologists in the North Central Cancer Treatment Group. Oncology. 2005;68(1):23–32. doi: 10.1159/000084519. [DOI] [PubMed] [Google Scholar]
- 19.West CP, Tan AD, Habermann TM, et al. Association of resident fatigue and distress with perceived medical errors. JAMA. 2009;302(12):1294–300. doi: 10.1001/jama.2009.1389. [DOI] [PubMed] [Google Scholar]
- 20.West CP, Huschka MM, Novotny PJ, et al. Association of perceived medical errors with resident distress and empathy: a prospective longitudinal study. JAMA. 2006;296(9):1071–8. doi: 10.1001/jama.296.9.1071. [DOI] [PubMed] [Google Scholar]
- 21.Kang EK, Lihm HS, Kong EH. Association of intern and resident burnout with self-reported medical errors. Korean J Fam Med. 2013;34(1):36–42. doi: 10.4082/kjfm.2013.34.1.36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Min AA, Sbarra DA, Keim SM. Sleep disturbances predict prospective declines in residents’ psychological well-being. Med Educ Online. 2015;20:28530. doi: 10.3402/meo.v20.28530. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Pagnin D, de Queiroz V, Carvalho YT, et al. The relation between burnout and sleep disorders in medical students. Acad Psychiatry. 2014;38(4):438–44. doi: 10.1007/s40596-014-0093-z. [DOI] [PubMed] [Google Scholar]
- 24.Machado-Duque ME, Echeverri Chabur JE, Machado-Alba JE. Excessive daytime sleepiness, poor quality sleep, and low academic performance in medical students. Rev Colomb Psiquiatr. 2015;44(3):137–42. doi: 10.1016/j.rcp.2015.04.002. [DOI] [PubMed] [Google Scholar]
- 25.Bahammam AS, Alaseem AM, Alzakri AA, et al. The relationship between sleep and wake habits and academic performance in medical students: a cross-sectional study. BMC Med Educ. 2012;12:61. doi: 10.1186/1472-6920-12-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Rodrigues RN, Viegas CA, Abreu E, Silva AA, et al. Daytime sleepiness and academic performance in medical students. Arq Neuropsiquiatr. 2002;60(1):6–11. doi: 10.1590/s0004-282x2002000100002. [DOI] [PubMed] [Google Scholar]
- 27.Abdulghani HM, Alrowais NA, Bin-Saad NS, et al. Sleep disorder among medical students: relationship to their academic performance. Med Teach. 2012;34(Suppl 1):S37–41. doi: 10.3109/0142159X.2012.656749. [DOI] [PubMed] [Google Scholar]
- 28.Pikovsky O, Oron M, Shiyovich A, et al. The impact of sleep deprivation on sleepiness, risk factors and professional performance in medical residents. Isr Med Assoc J. 2013;15(12):739–44. [PubMed] [Google Scholar]
- 29.Fruchtman Y, Moser AM, Perry ZH. Fatigue in medical residents--lessons to be learned. Med Lav. 2011;102(5):455–63. [PubMed] [Google Scholar]
- 30.West CP, Tan AD, Habermann TM, et al. Association of resident fatigue and distress with perceived medical errors. JAMA. 2009;302(12):1294–300. doi: 10.1001/jama.2009.1389. [DOI] [PubMed] [Google Scholar]
- 31.Papp KK, Stoller EP, Sage P, et al. The effects of sleep loss and fatigue on resident-physicians: a multi-institutional, mixed-method study. Acad Med. 2004;79(5):394–406. doi: 10.1097/00001888-200405000-00007. [DOI] [PubMed] [Google Scholar]
- 32.Chen I, Vorona R, Chiu R, Ware JC. A survey of subjective sleepiness and consequences in attending physicians. Behav Sleep Med. 2008;6(1):1–15. doi: 10.1080/15402000701796023. [DOI] [PubMed] [Google Scholar]
- 33.Epstein RM, Krasner MS. Physician resilience: what is means, why it matters, and how to promote it. Acad Med. 2013;88(3):301–3. doi: 10.1097/ACM.0b013e318280cff0. [DOI] [PubMed] [Google Scholar]
- 34.Zwack J, Schweitzer J. If every fifth physician is affected by burnout, what about the other four? Resilience strategies of experienced physicians. Acad Med. 2013;88(3):383–9. doi: 10.1097/ACM.0b013e318281696b. [DOI] [PubMed] [Google Scholar]
- 35.Brennan J, McGrady A. Designing and implementing a resiliency program for family medicine residents. Int J Psychiatry Med. 2015;50(1):104–14. doi: 10.1177/0091217415592369. [DOI] [PubMed] [Google Scholar]
- 36.Connor KM, Davidson JR. Development of a new resilience scale: the Connor-Davidson Resilience Scale (CD-RISC) Depress Anxiety. 2003;18(2):76–82. doi: 10.1002/da.10113. [DOI] [PubMed] [Google Scholar]
- 37.Campbell-Sills L, Stein MB. Psychometric analysis and refinement of the Connor–Davidson Resilience Scale (CD-RISC): validation of a 10-item measure of resilience. J Trauma Stress. 2007;20(6):1019–28. doi: 10.1002/jts.20271. [DOI] [PubMed] [Google Scholar]
- 38.Campbell-Sills L, Forde DR, Stein MB. Demographic and childhood environmental predictors of resilience in a community sample. J Psychiatr Res. 2009;43(12):1007–12. doi: 10.1016/j.jpsychires.2009.01.013. [DOI] [PubMed] [Google Scholar]
- 39.Arias Gonzalez VB, Crespo Sierra MT, Arias Martinez B, et al. An in-depth psychometric analysis of the Connor-Davidson Resilience Scale: calibration with Rasch-Andrich model. Health Qual Life Outcomes. 2015;13:154. doi: 10.1186/s12955-015-0345-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–96. [PubMed] [Google Scholar]
- 41.Chaukos D, Chad-Friedman E, Mehta DH, et al. Risk and resilience factors associated with resident burnout. Acad Psychiatry. 2017;41(2):189–94. doi: 10.1007/s40596-016-0628-6. [DOI] [PubMed] [Google Scholar]
- 42.Swami MK, Mathur DM, Pushp BK. Emotional intelligence, perceived stress and burnout among resident doctors: an assessment of the relationship. Natl Med J India. 2013;26(4):210–3. [PubMed] [Google Scholar]
- 43.Hutchison TA, Haase S, French S, et al. Stress, burnout, and coping among emergency physicians at a major hospital in Kingston, Jamaica. West Indian Med J. 2014;63(3):262–6. doi: 10.7727/wimj.2013.330. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Waldman SV, Diez JC, Arazi HC, et al. Burnout, perceived stress, and depression among cardiology residents in Argentina. Acad Psychiatry. 2009;33(4):296–301. doi: 10.1176/appi.ap.33.4.296. [DOI] [PubMed] [Google Scholar]
- 45.Deible S, Fiorvanti M, Tarantino B, et al. Implementation of an integrative coping and resiliency program for nurses. Global Adv Health Med. 2015;4(1):28–33. doi: 10.7453/gahmj.2014.057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Sood A, Prasad K, Schroeder D, et al. Stress management and resilience training among Department of Medicine faculty: a pilot randomized clinical trial. J Gen Intern Med. 2011;26(8):858–61. doi: 10.1007/s11606-011-1640-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Endler N, Parker JDA. Coping Inventory for Stressful Situations. [Accessed Sept 27, 2017]. Available at: https://www.mhs.com/MHS-Assessment?prodname=ciss.
- 48.Endler NS, Parker JD, Butcher JN. A factor analytic study of coping styles and the MMPI-2 content scales. J Clin Psychol. 1993;49(4):523–7. doi: 10.1002/1097-4679(199307)49:4<523::aid-jclp2270490409>3.0.co;2-m. [DOI] [PubMed] [Google Scholar]
- 49.Howlett M, Doody K, Murray J, et al. Burnout in emergency department healthcare professionals is associated with coping style: a cross-sectional survey. Emerg Med J. 2015;32(9):722–7. doi: 10.1136/emermed-2014-203750. [DOI] [PubMed] [Google Scholar]
- 50.Kwarta P, Pietrzak J, Miśkowiec D, et al. Personality traits and styles of coping with stress in physicians. Pol Merkur Lekarski. 2016;40(239):301–7. [PubMed] [Google Scholar]
- 51.Wons A, Bargiel-Matusiewicz K. The emotional intelligence and coping with stress among medical students. Wiad Lek. 2011;64(3):181–7. [PubMed] [Google Scholar]
- 52.Lin DT, Liebert CA, Tran J, et al. Emotional intelligence as a predictor of resident well-being. J Am Coll Surg. 2016;223(2):352–8. doi: 10.1016/j.jamcollsurg.2016.04.044. [DOI] [PubMed] [Google Scholar]
- 53.Tanaka M, Fukada S, Mizuno K, et al. Stress and coping styles are associated with severe fatigue in medical students. Behav Med. 2009;35(3):87–92. doi: 10.1080/08964280903231979. [DOI] [PubMed] [Google Scholar]
- 54.Thompson G, McBride RB, Hosford CC, et al. Resilience among medical students: the role of coping style and social support. Teach Learn Med. 2016;28(2):174–82. doi: 10.1080/10401334.2016.1146611. [DOI] [PubMed] [Google Scholar]
- 55.Folkman S, Lazarus RS, Dunkel-Schetter C, et al. Dynamics of a stressful encounter: cognitive appraisal, coping, and encounter outcomes. J Pers Soc Psychol. 1986;50(5):992–1003. doi: 10.1037//0022-3514.50.5.992. [DOI] [PubMed] [Google Scholar]
- 56.Folkman S, Lazarus RS. If it changes it must be a process: study of emotion and coping during three stages of a college examination. J Pers Soc Psychol. 1985;48(1):150–70. doi: 10.1037//0022-3514.48.1.150. [DOI] [PubMed] [Google Scholar]
- 57.Howlett M, Doody K, Murray J, et al. Burnout in emergency department healthcare professionals is associated with coping style: a cross-sectional survey. Emerg Med J. 2015;32(9):722–7. doi: 10.1136/emermed-2014-203750. [DOI] [PubMed] [Google Scholar]
- 58.Popa F, Arafat R, Purcărea VL, et al. Occupational burnout levels in emergency medicine--a stage 2 nationwide study and analysis. J Med Life. 2010;3(4):449–53. [PMC free article] [PubMed] [Google Scholar]
- 59.Carver CS, Scheier MF, Weintraub JK. Assessing coping strategies: a theoretically based approach. J Pers Soc Psychol. 1989;56(2):267–83. doi: 10.1037//0022-3514.56.2.267. [DOI] [PubMed] [Google Scholar]
- 60.Carver CS. You want to measure coping but your protocol’s too long: consider the brief COPE. Int J Behav Med. 1997;4(1):92–100. doi: 10.1207/s15327558ijbm0401_6. [DOI] [PubMed] [Google Scholar]
- 61.Boyd R, Brown T. Pilot study of Myers Briggs Type Indicator personality profiling in emergency department senior medical staff. Emerg Med Australas. 2005;17(3):200–3. doi: 10.1111/j.1742-6723.2005.00723.x. [DOI] [PubMed] [Google Scholar]
- 62.Eicke FJ, Blake G, Replogle W. A comparative view of the Myers-Briggs Type Indicator. Fam Med. 1993;25(3):186–90. [PubMed] [Google Scholar]
- 63.Lemkau JP, Purdy RR, Rafferty JP, et al. Correlates of burnout among family practice residents. J Med Educ. 1988;63(9):682–91. doi: 10.1097/00001888-198809000-00003. [DOI] [PubMed] [Google Scholar]
- 64.Swanson JA, Antonoff MB, D’Cunha J, et al. Personality profiling of the modern surgical trainee: insights into generation X. J Surg Educ. 2010;67(6):417–20. doi: 10.1016/j.jsurg.2010.07.017. [DOI] [PubMed] [Google Scholar]
- 65.Wali SO, Qutah K, Abushanab L, et al. Effect of on-call-related sleep deprivation on physicians’ mood and alertness. Ann Thorac Med. 2013;8(1):22–7. doi: 10.4103/1817-1737.105715. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Smith-Coggins R, Howard SK, Mac DT, et al. Improving alertness and performance in emergency department physicians and nurses: the use of planned naps. Ann Emerg Med. 2006;48(5):596–604. doi: 10.1016/j.annemergmed.2006.02.005. [DOI] [PubMed] [Google Scholar]
- 67.Bellini LM, Shea JA. Mood change and empathy decline persist during three years of internal medicine training. Acad Med. 2005;80(2):164–7. doi: 10.1097/00001888-200502000-00013. [DOI] [PubMed] [Google Scholar]
- 68.Bellini LM, Baime M, Shea JA. Variation of mood and empathy during internship. JAMA. 2002;287(23):3143–6. doi: 10.1001/jama.287.23.3143. [DOI] [PubMed] [Google Scholar]
- 69.Hainer BL, Palesch Y. Symptoms of depression in residents: a South Carolina Family Practice Research Consortium study. Acad Med. 1998;73(12):1305–10. doi: 10.1097/00001888-199812000-00023. [DOI] [PubMed] [Google Scholar]
- 70.Wright SW, Lawrence LM, Wrenn KD, et al. Randomized clinical trial of melatonin after night-shift work: efficacy and neuropsychologic effects. Ann Emerg Med. 1998;32(3 Pt 1):334–40. doi: 10.1016/s0196-0644(98)70010-1. [DOI] [PubMed] [Google Scholar]
- 71.Uliana RL, Hubbell FA, Wyle FA, et al. Mood changes during the internship. J Med Educ. 1984;59(2):118–23. doi: 10.1097/00001888-198402000-00008. [DOI] [PubMed] [Google Scholar]
- 72.Pollock V, Cho DW, Reker D, et al. Profile of Mood States: the factors and their physiological correlates. J Nerv Ment Dis. 1979;167(10):612–4. doi: 10.1097/00005053-197910000-00004. [DOI] [PubMed] [Google Scholar]
- 73.Berger BG, Motl RW. Exercise and mood: A selective review and synthesis of research employing the Profile of Mood States. J Appl Sport Psychol. 2008;12(1):69–92. [Google Scholar]
- 74.Nyenhuis DL, Yamamoto C, Luchetta T, et al. Adult and geriatric normative data and validation of the Profile of Mood States. J Clin Psychol. 1999;55(1):79–86. doi: 10.1002/(sici)1097-4679(199901)55:1<79::aid-jclp8>3.0.co;2-7. [DOI] [PubMed] [Google Scholar]
- 75.Spielberger CD. Review of Profile of Mood States. Prof Psychol. 1972;3(4):387–8. [Google Scholar]
- 76.Boyl GJ. A cross-validation of the factor structure of the Profile of Mood States: Were the factors correctly identified in the first instance? Psychol Rep. 1987;60(2):343–54. [Google Scholar]
- 77.Ogunyemi D, Tangchitnob E, Mahler Y, et al. Conflict styles in a cohort of graduate medical education administrators, residents, and board-certified physicians. J Grad Med Educ. 2011;3(2):176–81. doi: 10.4300/JGME-D-10-00184.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Ogunyemi D, Eno M, Rad S, et al. Evaluating professionalism, practice-based learning and improvement, and systems-based practice: utilization of a compliance form and correlation with conflict styles. J Grad Med Educ. 2010;2(3):423–9. doi: 10.4300/JGME-D-10-00048.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Ogunyemi D, Fong S, Elmore G, et al. The associations between residents’ behavior and the Thomas-Kilmann Conflict MODE Instrument. J Grad Med Educ. 2010;2(1):118–25. doi: 10.4300/JGME-D-09-00048.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Sportsman S, Hamilton P. Conflict management styles in the health professions. J Prof Nurs. 2007;23(3):157–66. doi: 10.1016/j.profnurs.2007.01.010. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.