Abstract
Inter-professional collaboration, empathy and lifelong learning, components of medical professionalism, have been associated with occupational well-being in physicians. However, it is not clear whether this role persists in adverse working conditions. This study was performed to assess whether this is the case. These three abilities, and the self-perception of somatization, exhaustion and work alienation, were measured in a sample of 60 physicians working in a hospital declared to be in an institutional emergency. A multiple regression model explained 40% of the variability of exhaustion, with a large effect size (Cohen’s-f2 = 0.64), based on a linear relationship with teamwork (p = 0.01), and more dedication to academic (p < 0.001) and management activities (p < 0.003). Neither somatization nor alienation were predicted by empathy or lifelong learning abilities. Somatization, exhaustion, or alienation scores either explained empathy, inter-professional collaboration or lifelong learning scores. These findings indicate that, in adverse working environments, physicians with a greater sense of inter-professional collaboration or performing multi-task activities are more exposed to suffering exhaustion.
Keywords: inter-professional collaboration, occupational stress, patient care team, physicians, professionalism, workplace
1. Introduction
Professionalism refers to the set of skills and values that, in the case of medicine, characterize the essence of humanism in professional work. Although technical knowledge and clinical skills are foundational to medical professionalism, values are central to the definition of professionalism and distinguish it from the concept of a mere clinical competence. In fact, there are three competencies recognized as specific elements of medical professionalism: inter-professional collaboration, empathy and lifelong learning abilities. Based on this premise, David Stern [1] defined medical professionalism as “a foundation of clinical competence, communication skills, and ethical and legal understanding, upon which the aspiration to professionalism and wise application of its principles are built: excellence, humanism, accountability, and altruism”. Recipients of the benefits of this professionalism on health and welfare are not only patients, but also practitioners and, ultimately, society as a whole. In the specific case of inter-professional collaborative abilities, research suggests that interdisciplinary healthcare teamwork reduces patient death rates, improves clinical care and patient satisfaction, and reduces costs [1].
The effort–reward imbalance (ERI) model is a theoretical model of a psychosocial work environment with adverse effects on health and well-being that focuses on a mismatch between high efforts spent and low rewards gained at work [2]. In the frame of the ERI model, medical professionalism is supported on a contract of social reciprocity, where the rewards can be provided not only in economic terms, but also in personal acknowledgement or professional recognition. In contrast, professionalism can be threatened by multiple factors such as work instability, the absence of perspectives of promotion, personal acknowledgements, or a lack of working improvement opportunities [3]. Furthermore, when harsh working environments are accompanied by scarce or inadequately distributed resources, keeping professionalism uncorrupted can become a daily odyssey [4]. Some authors have described these environments as “adverse working conditions” [5]. In healthcare settings, these environments usually combine three aspects: (a) lack of resources (insufficient, poorly managed, or misused); (b) lack of recognition (or support) from institutions, supervisors, or co-workers; and (c) prevalence of an organizational culture that places institutional benefits above patients. Considering that medicine is, by definition, an altruistic profession, the personal conflict that practitioners have to deal with becomes greater when it is accompanied with unsatisfied social demands [6]. It is possible that this situation is more stressful for those physicians who have stronger ethical values and professional abilities [7].
A notable disparity in the access to healthcare persists in Latin America, even after the recent efforts dedicated to trying to reduce it [8]. Such a difference is greater when comparing public and private institutions, or when treatments are paid from patients’ pockets [9]. Bolivia is one of the most visible cases of such inequalities [10]. Even though important efforts have been developed to restructure Bolivian public healthcare institutions [9], scarce available data indicate that the system as a whole maintains some of the lowest indicators in the region regarding healthcare quality and safety [11,12]. This situation acquired special resonance in 2016, when the National Ombudsman declared the main and the oldest public hospital of the capital city of La Paz, named “Hospital de Clínicas”, in institutional emergency [13]. This public announcement appeared after the publication of a dramatic report, carried by the representation of the Ombudsman of La Paz, warning of the terrible working conditions in this healthcare institution. Some of the deficiencies reported were that 50% of the equipment in the nineteen medical and surgical departments was obsolete; beds and mattresses were old; there was a lack of hygiene in rooms, restrooms and corridors; roofs leaked and walls were worn; a presence of mice; and a reduced number of healthcare workers to attend patients [14]. Based on these facts, the Ombudsman stated in a press conference that, “Given such a depressing and precarious situation, the hospital should not be considered a third level healthcare institution. It is obsolete and does not adapt to the needs of the population” [13]. This announcement arrived after several claims from workers and patients. The abovementioned situation acquires especial relevance taking into consideration that this institution was in charge of the health coverage of the poorest communities and was used as a teaching institution for physicians-in-training and medical students. Finally, in 2018, the government announced a USD two million investment to renovate obsolete public hospitals. However, the Bolivian healthcare professionals’ claims regarding the need to improve their training and working conditions are still pending [15]. In 2021 and in the middle of the COVID-19 pandemic, a more recent report signed by the new Ombudsman, Ms. Nadia Cruz Tarifa, highlighted that important renovations in this hospital are still a pending task [16].
Based on the aforementioned situation, an observational study was performed in “Hospital de Clínicas” of La Paz before the COVID-19 pandemic started. The following hypothesis was tested and confirmed: in adverse working conditions, physicians with higher indicators of professionalism (measured by empathy, inter-professional collaboration and lifelong learning abilities) are more exposed to suffer stress in their workplace.
2. Methods
Participants were 60 practitioners (75% of medical staff) of “Hospital de Clínicas” in La Paz, who participated anonymously and voluntarily. The study design, approved by an independent ethical committee (Ref. CEICLAR-PI-199), was authorized by the hospital’s administration. Only medical staff were included in the study. Medical students, physicians-in-training, other healthcare professionals, and physicians working for tertiary parties were excluded.
Self-perception of somatization, exhaustion and work alienation were used as main measures. The Scale of Collateral Effects (SCE) of the Questionnaire of General Labour Well-being was administered as a measuring instrument. The SCE is composed of three mini-scales: the scale of somatization (SS), with 5 items; the scale of exhaustion (SE), with 4 items; and the scale of work alienation (SA), with 4 items [17]. Each item of the abovementioned mini-scales starts with the following statement: “Currently, because of my work, I feel:” followed by one specific symptom. The SS measures the following symptoms: digestive disorder, back pain, insomnia, headache, and muscle tension. Symptoms included in the SE are work overload, emotional exhaustion, physical exhaustion, and mental saturation. Finally, the SA assesses bad mood, low personal fulfilment, depersonalized treatment, and frustration. The perception of each symptom is answered following a 7-point Likert-type scale, reflecting a daily frequency in the last week from 1 (never) to 7 (always).
In addition, inter-professional collaborative work between physicians and nurses (JSAPNC), the Jefferson Scales of Empathy (JSE), and physician’s lifelong learning (JeffSPLL), were used as multi-score measures of medical professionalism. The JSAPNC (15 items) is answered in a 4-point Likert scale from 1 (strongly disagree) to 4 (strongly agree) [18]. The JSE (20 items) is answered in a 7-point Likert scale from 1 (strongly disagree) to 7 (strongly agree) [19]. The JeffSPLL (14 items) is answered in a 4-point Likert scale from 1 (strongly disagree) to 4 (strongly agree) [20]. In the aforementioned scales, higher scores are associated with greater development of the elements measured. Finally, information on age, gender, specialty, professional experience (years), salary range, and weekly dedication (hours) to clinical, academic and management activities, were also collected in a socio-demographic form.
Following international recommendations [21], only psychometric measures with alpha coefficients equal to or higher than 0.70 were included in the analyses. Scales of somatization, exhaustion and work alienation were used as dependent variables. After normality was assessed, using Pearson’s chi-squared and Lilliefors–Kolmogorov–Smirnov tests, comparative analyses using non-parametric Mann–Whitney U tests were performed to determine differences on the abovementioned scales according to all variables collected. Effect size (r) was calculated following the formula described by Fritz, Morris and Richler [22] and Tomczak and Tomczak [23] for non-parametric tests. Following the recommendation of other authors [24], an r-value equal to 0.50 was considered as a large effect size with a crucial practical importance; equal to 0.30 was a medium effect size, with a moderate practical importance; and equal to 0.10 was a small effect size, with a negligible practical importance.
Regarding age and global scores on empathy, teamwork and lifelong learning, Spearman’s correlation analyses were performed in order to determine statistical associations between them and scores on somatization, exhaustion and work alienation. All variables showing statistical significance in comparative and correlation analyses were included in a multiple linear regression analysis as potential predictors of dependent variables. A regression model was accepted only if conditions of statistical inference (normality, zero mean, constant variance and uncorrelatedness of the residuals, in addition to linearity and absence of multi-collinearity) were met. In order to quantify the degree of practical significance of a model obtained, the effect size (Cohen’s-f2) was calculated: a value equal to or greater than 0.02 and smaller than 0.15 was interpreted as a small effect, equal to or greater than 0.15 and smaller than 0.35 was a medium effect, and equal to or greater than 0.35 was a large effect, following the interpretation criteria proposed by Cohen [25].
All analyses were performed using R statistical software, version 3.6.2, for Windows. The statistical analyses of the data also included multilevel [26], rstatix [27], lsr [28], and nortest [29] packages.
3. Results
The average age of participants in the sample was 45 (SD = 9) years old, with a range between 26 and 71 years old. By gender, 41 (68%) physicians were male. By specialties, 41 (68%) worked in medical and 19 (32%) in surgical departments. By salary, 18 (30%) had a monthly salary higher than USD 2000. By experience, 17 (30%) had more than 10 years of professional experience. By working dedication, 13 (22%) physicians indicated that they dedicated more than half of their 40 weekly working hours to clinics, 7 (12%) to academic activities (i.e., teaching and mentoring), and 8 (13%) to management.
All scales showed excellent psychometric properties (Table 1). On the one hand, correlation analyses showed a positive association between exhaustion and inter-professional collaboration (ρ = 0.29; p = 0.03). In contrast, neither exhaustion, alienation nor somatization showed a correlation with empathy, lifelong learning and age. A summary of these analyses is shown in Table 2. On the other hand, comparative analyses showed differences in somatization and exhaustion scores, but not in work alienation, by specialty, salary, or working dedication. No differences were observed in any of the three measures by gender or professional experience. A summary of these analyses is shown in Table 3.
Table 1.
Statistics | JSE | JSAPNC | JeffSPLL | SS | SE | SA |
---|---|---|---|---|---|---|
Range possible | 20–140 | 15–60 | 14–56 | 5–35 | 4–28 | 4–28 |
Range observed | 81–134 | 32–60 | 31–56 | 5–33 | 4–28 | 4–24 |
Mean | 101 | 47 | 47 | 13 | 12 | 9 |
Standard deviation (SD) | 15 | 7 | 6 | 8 | 7 | 5 |
Quartile | ||||||
1st | 88 | 42 | 44 | 8 | 6 | 5 |
2nd (Median) | 94 | 47 | 48 | 10 | 10 | 7 |
3rd | 114 | 51 | 51 | 18 | 16 | 13 |
Reliability | 0.82 | 0.84 | 0.87 | 0.90 | 0.92 | 0.87 |
JSE, Jefferson Scale of Empathy; JSAPNC, Jefferson Scale of Attitudes toward Physician-Nurse Collaboration; JeffSPLL, Jefferson Scale of Physician Lifelong Learning; SS, scale of somatization; SE, scale of exhaustion; SA, scale of work alienation.
Table 2.
JSE | JSAPNC | JeffSPLL | SS | SE | SA | Age | |
---|---|---|---|---|---|---|---|
JSE | 1 | ||||||
JSAPNC | +0.32 * | 1 | |||||
JeffSPLL | +0.48 *** | +0.45 *** | 1 | ||||
SS | +0.19 | +0.24 | +0.19 | 1 | |||
SE | +0.13 | +0.29 * | +0.21 | +0.83 *** | 1 | ||
SA | +0.00 | +0.21 | +0.03 | +0.54 *** | +0.65 *** | 1 | |
Age | −0.19 | +0.07 | +0.11 | −0.13 | −0.19 | −0.07 | 1 |
JSE, Jefferson Scale of Empathy; JSAPNC, Jefferson Scale of Attitudes toward Physician-Nurse Collaboration; JeffSPLL, Jefferson Scale of Physician Lifelong Learning; SS, scale of somatization; SE, scale of exhaustion; SA, scale of work alienation. * p < 0.05; *** p < 0.001.
Table 3.
Study Groups | n | Somatization (SS) | Exhaustion (SE) | ||||||
---|---|---|---|---|---|---|---|---|---|
Mdn | M (SD) | p | r | Mdn | M (SD) | p | r | ||
Gender | |||||||||
Male group | 41 | 12 | 13 (7) | 0.85 | -- | 8 | 11 (7) | 0.50 | -- |
Female group | 19 | 9 | 13 (8) | 10 | 12 (7) | ||||
Specialty | |||||||||
Medical branch | 41 | 14 | 15 (8) | 0.03 | 0.29 | 12 | 13 (7) | 0.009 | 0.34 |
Surgical branch | 19 | 9 | 10 (4) | 7 | 8 (4) | ||||
Salary | |||||||||
Less than USD 2000 | 42 | 9.5 | 12 (6) | 0.03 | 0.27 | 7 | 10 (6) | 0.01 | 0.33 |
USD 2000 or more | 18 | 16 | 17 (9) | 13.5 | 16 (8) | ||||
Dedication to clinics | |||||||||
Less than 20 weekly hours | 47 | 10 | 12 (7) | 0.02 | 0.31 | 7 | 11 (7) | 0.03 | 0.28 |
20 weekly hours or more | 13 | 19 | 19 (9) | 14 | 15 (7) | ||||
Dedication to academics | |||||||||
Less than 20 weekly hours | 53 | 10 | 12 (7) | 0.004 | 0.37 | 8 | 10 (6) | 0.002 | 0.40 |
20 weekly hours or more | 7 | 25 | 23 (10) | 24 | 21 (7) | ||||
Dedication to management | |||||||||
Less than 20 weekly hours | 52 | 10 | 13 (7) | 0.10 | -- | 8 | 11 (6) | 0.02 | 0.30 |
20 weekly hours or more | 8 | 17 | 18 (10) | 22.5 | 18 (9) | ||||
Professional experience | |||||||||
Less than 10 years | 43 | 10 | 14 (8) | 0.62 | 0.06 | 10 | 11 (6) | 0.92 | -- |
10 years or more | 17 | 10 | 13 (8) | 9 | 12 (8) |
SS, scale of somatization; SE, scale of exhaustion; n, sample size; Mdn, median; M, mean; SD, standard deviation; p, probability; r, effect size.
Based on these preliminary findings, multivariate analyses were performed to determine interactions among the variables assessed. A one-way ANOVA confirmed a greater somatization only in physicians with more academic dedication (p < 0.001), with a large effect size (ηp2 = 0.20). A three-way ANOVA confirmed something similar for exhaustion in physicians with more dedication to teaching (p < 0.001), with a large effect size (ηp2 = 0.19); and in physicians working in medical departments (p = 0.02), and those with more management dedication (p = 0.01), both with a moderate effect size (ηp2 < 0.14) (Table 4). Finally, two separate multiple linear regression analyses were performed for somatization and exhaustion, but only one fulfilled all necessary conditions for statistical inference. This model explained the 39% variance in exhaustion (R2-adjusted=0.36; F(3,56) = 11.92; p < 0.001), with a large effect size (Cohen-f2 = 0.65). Inter-professional collaboration (p = 0.01), and more dedication to academic (p < 0.001) and management (p = 0.003) responsibilities appeared as predictors (Figure 1).
Table 4.
Source of Variation | Somatization | |||
---|---|---|---|---|
F (1,58) | η 2 | ηp 2 | p | |
Academic dedication (<20 weekly hours vs. >20) | 14.52 | 0.20 | 0.20 | <0.001 |
Source of variation | Exhaustion | |||
F (1,56) | η 2 | ηp 2 | p | |
Specialty (surgery vs. medicine) | 5.58 | 0.06 | 0.09 | 0.02 |
Academic dedication (<20 weekly hours vs. >20) | 13.28 | 0.15 | 0.19 | <0.001 |
Management dedication (<20 weekly hours vs. >20) | 6.73 | 0.07 | 0.11 | 0.01 |
F(df), F-value (degrees of freedom); η2, eta-squared; ηp2, partial eta-squared; p, probability.
4. Discussion
In comparison with studies in Spain and other Latin American institutions, the three competences associated with medical professionalism measured in the Bolivian group were lower [18,19,20,30]. These findings could be caused by the negative influence that adverse working environments have on physicians’ professional performance and conduct, previously suggested in the literature [3,6], but also for some social and cultural characteristics that are dominant in Bolivian society. For example, in the case of empathy, findings observed are consistent with a progressive process of dehumanization reported in public Bolivian healthcare institutions [16,31], but also with some important gaps in physician–patient relationships associated with language barriers and cultural beliefs. These gaps are more evident in clinical encounters with patients from indigenous cultural backgrounds. The strong influence of a social stereotype supporting a vision of medicine above nursing can explain the low scores in inter-professional collaborative abilities in the entire sample. This vision is still predominant in the majority of Latin American institutions [6,32], where a paternalistic approach of medicine is also socially accepted. Regarding lifelong learning abilities, the poor development of these abilities correlates with findings reported in other studies, where healthcare professional with harsh working conditions and a lack of job support tend to suffer a lack of motivation towards excellence and professional accountability [33].
However, the most important finding of this study is the confirmation of the emotional and physical costs which those physicians with a greater sense of professionalism pay in adverse working environments. Unfortunately, the findings observed confirmed that having a higher development of professionalism increases the risk of suffering greater exhaustion. This finding is the opposite to those reported in other institutions, where in acceptable working conditions (even in those with some deficiencies), professionalism reduces work distress [6]. Moreover, collaborative physicians are able to encourage and motivate their co-workers in interdisciplinary teams. However, based on these findings, being more collaborative in adverse working conditions could play the opposite effect. It is reasonable to expect that more collaborative physicians are assuming more responsibilities than unmotivated ones. However, the reason why this effect is associated only to inter-professional collaboration but not to empathy or lifelong learning abilities can perhaps be explained by the retribution that these other abilities offer to the physicians which inter-professional collaborative abilities do not. For example, it is possible that more empathetic physicians handle the relationship with their patients better and receive moral support by the recognition and gratitude from the patients treated by them. This recognition could bring a meaning to their dedication that compensates, at least in part, the physical and emotional efforts in their daily work. In a similar sense, having a greater development of lifelong learning abilities usually derives from the improvements in clinical and technical competencies. It is plausible that physicians who are more skillful can receive better recognition from supervisors, co-workers, trainees and patients. In contrast, and in correlation with the ERI model [2], findings of this study indicate that more collaborative physicians with more dedication to academic or management activities do not perceive a benefit, neither moral nor professional, proportional to their efforts. Furthermore, the greater physical and emotional exhaustion observed in these physicians suggests the lack of an adequate balance between efforts dedicated and the reward received. These findings also coincide with what is proposed in the Job–Demand–Control–Support work model (JDCS model) regarding the negative effects derived from the lack of collaboration and social support from supervisors and colleagues in a work environment with high job demands [34]. According to the JDCS model, stress at work occurs when job demands exceed the ability to overcome those demands either through job control or job support, which, in normal conditions, act as moderators. When job stress, which is not directly measured by the JDCS model but is more of a latent variable thought to occur through the combination of job demands with job control and support, persists over a period of time, workers can experience the negative outcomes associated with stress, such as decreased physical health and exhaustion in their workplace, as these findings show.
5. Conclusions
In conclusion, in adverse working environments, for physicians with a high sense of responsibility or with a positive approach to inter-professional collaboration, work overload is not rewarded. For these physicians, the greater development of this ability poses the risk of taking them to assume not only their own responsibilities, but also those of their work team. The case reported in Bolivia poses a very serious and alarming problem, not only due to the risk for the health and welfare of physicians, but also due to the negative effects that not attending to this problem poses to other institutions associated with healthcare systems.
These findings suggest an urgent need to introduce important changes in the hospital where this study was performed, which not only affect facilities, but also the organizational culture of the institution. It is evident that there are important structural issues that should urgently be resolved. However, in the meantime, other aspects related to job support and working culture should be addressed in order to reduce the detrimental effect that this situation has in the health and wellbeing of physicians with greater sense of professionalism.
Acknowledgments
The authors would like to acknowledge the support of Jorge Juaniquina, Medical Director of the Hospital de Clínicas of La Paz, Bolivia. We also would like to acknowledge the contribution of Josep María Blanch, from the Autonomous University of Barcelona, in Spain.
Author Contributions
Conceptualization, L.V.; methods: L.V.; data collection: J.V.-S.; statistical analysis: L.V. and M.S.-M.; Writing—review and editing: R.C.D.B. and L.V. All authors have read and agreed to the published version of the manuscript.
Funding
This research and the APC were funded by Fundación Rioja Salud, reference funds PBIO.
Institutional Review Board Statement
The study design was approved by the Comité Ético de Investigación Clínica de La Rioja (CEICLAR), in Logroño, Spain (Reference number: CEICLAR-PI-199), and it was authorized by the Administration of Hospital Clínicas of La Paz and the Department of Health of La Paz, Bolivia.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
Data are available upon request.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Stern D.T. What is medical professionalism? In: Stern D.T., editor. Measuring Medical Professionalism. Oxford University Press; New York, NY, USA: 2006. pp. 15–38. [Google Scholar]
- 2.Siegrist J. Effort-Reward Imbalance Model. In: Fink G., editor. Stress: Concepts, Cognition, Emotion, and Behavior. Elsevier; Amsterdam, The Netherlands: 2016. pp. 81–86. [Google Scholar]
- 3.West C.P., Shanafelt T.D. Physician well-being and professionalism. Minn. Med. 2007;90:44–46. [PubMed] [Google Scholar]
- 4.Cole T.R., Carlin N. The suffering of physicians. Lancet. 2009;374:1414–1415. doi: 10.1016/S0140-6736(09)61851-1. [DOI] [PubMed] [Google Scholar]
- 5.Karasek R.A., Theorell T. Healthy Work: Stress Productivity and the Reconstruction of Working Life. Basic Books; New York, NY, USA: 1992. [Google Scholar]
- 6.San-Martín M., Delgado-Bolton R., Vivanco L. Professionalism and occupational well-being: Similarities and differences among latin american health professionals. Front. Psychol. 2017;8:1–10. doi: 10.3389/fpsyg.2017.00063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Grau Martín A., Flichtentrei D., Suñer R., Prats M., Braga F. Influence of personal, professional and cross-national factors in burnout syndrome in Hispanic Americans and Spanish health workers (2007) Rev. Esp. Salud Publica. 2009;83:215–230. doi: 10.1590/s1135-57272009000200006. [DOI] [PubMed] [Google Scholar]
- 8.Atun R., De Andrade L.O.M., Almeida G., Cotlear D., Dmytraczenko T., Frenz P., Garcia P., Gómez-Dantés O., Knaul F.M., Muntaner C., et al. Health-system reform and universal health coverage in Latin America. Lancet. 2015;385:1230–1247. doi: 10.1016/S0140-6736(14)61646-9. [DOI] [PubMed] [Google Scholar]
- 9.Dal Poz M.R., Sepulveda H.R., Costa Couto M.H., Godue C., Padilla M., Cameron R., Vidaurre Franco T.D.A. Assessment of human resources for health programme implementation in 15 Latin American and Caribbean countries. Hum. Resour. Health. 2015;13:24. doi: 10.1186/s12960-015-0016-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Vian T. Review of corruption in the health sector: Theory, methods and interventions. Health Policy Plan. 2008;23:83–94. doi: 10.1093/heapol/czm048. [DOI] [PubMed] [Google Scholar]
- 11.Pastrana T., Torres-Vigil I., De Lima L. Palliative care development in Latin America: An analysis using macro indicators. Palliat. Med. 2014;28:1231–1238. doi: 10.1177/0269216314538893. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Alvarez F.N., Leys M., Mérida H.E.R., Guzmán G.E. Primary health care research in Bolivia: Systematic review and analysis. Health Policy Plan. 2016;31:114–128. doi: 10.1093/heapol/czv013. [DOI] [PubMed] [Google Scholar]
- 13.Zapana V. El Defensor denuncia “pésimo estado” del Hospital de Clínicas. Diario Página Siete. [(accessed on 8 September 2021)]. Available online: https://www.paginasiete.bo/sociedad/2016/3/11/defensor-denuncia-pesimo-estado-hospital-clinicas-89454.html.
- 14.Villena-Villegas R. Informe de la gestión del Defensor del Pueblo (2010–2016) Defensoría del Pueblo; La Paz, Bolivia: 2016. [Google Scholar]
- 15.Bendezu-Quispe G., León F., Moreno J., Inga-Berrospi F. Characteristics of compulsory service programs for medical professionals in the Andean states. Medwave. 2020;20:e7848. doi: 10.5867/medwave.2020.02.7848. [DOI] [PubMed] [Google Scholar]
- 16.Cruz Tarifa N. Informe Defensorial: Salud, Derechos Humanos y COVID-19 en Bolivia. Defensoria del Pueblo; La Paz, Bolivia: 2021. [Google Scholar]
- 17.Blanch J.M., Sahagun M., Cantera L., Cervantes G. Cuestionario de Bienestar Laboral General: Estructura y Propiedades Psicométricas. Rev. Psicol. Trab. Organ. 2010;26:157–170. doi: 10.5093/tr2010v26n2a7. [DOI] [Google Scholar]
- 18.Hojat M., Fields S.K., Veloski J.J., Griffiths M., Cohen M.J.M., Plumb J.D. Psychometric Properties of an Attitude Scale Measuring Physician-Nurse Collaboration. Eval. Health Prof. 1999;22:208–220. doi: 10.1177/01632789922034275. [DOI] [PubMed] [Google Scholar]
- 19.Alcorta-Garza A., San-Martín M., Delgado-Bolton R., Soler-González J., Roig H., Vivanco L. Cross-Validation of the Spanish HP-Version of the Jefferson Scale of Empathy Confirmed with Some Cross-Cultural Differences. Front. Psychol. 2016;7:1002. doi: 10.3389/fpsyg.2016.01002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hojat M., Veloski J.J., Gonnella J.S. Measurement and correlates of physicians’ lifelong learning. Acad. Med. 2009;84:1066–1074. doi: 10.1097/ACM.0b013e3181acf25f. [DOI] [PubMed] [Google Scholar]
- 21.Frost M.H., Reeve B.B., Liepa A.M., Stauffer J.W., Hays R.D., Sloan J.A. What is sufficient evidence for the reliability and validity of patient-reported outcome measures? Value Health. 2007;10:94–105. doi: 10.1111/j.1524-4733.2007.00272.x. [DOI] [PubMed] [Google Scholar]
- 22.Fritz C.O., Morris P.E., Richler J.J. Effect size estimates: Current use, calculations, and interpretation. J. Exp. Psychol. Gen. 2012;141:2–18. doi: 10.1037/a0024338. [DOI] [PubMed] [Google Scholar]
- 23.Tomczak M., Tomczak E. The need to report effect size estimates revisited. An overview of some recommended measures of effect size. Trends Sport Sci. 2014;1:19–25. [Google Scholar]
- 24.Hojat M., Xu G. A visitor’s guide to effect sizes: Statistical significance versus practical (clinical) importance of research findings. Adv. Health Sci. Educ. Theory Pract. 2004;9:241–249. doi: 10.1023/B:AHSE.0000038173.00909.f6. [DOI] [PubMed] [Google Scholar]
- 25.Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Lawrence Erlbaum Associates Publishers; New York, NY, USA: 1988. [Google Scholar]
- 26.Bliese P. Multilevel: Multilevel Functions. [(accessed on 8 September 2021)]. Available online: https://cran.r-project.org/web/packages/multilevel/index.html.
- 27.Kassambara A. Rstatix: Pipe-Friendly Framework for Basic Statistical Tests. [(accessed on 8 September 2021)]. Available online: https://cran.r-project.org/web/packages/rstatix/index.html.
- 28.Navarro D. lsr: Companion to “Learning Statistics with R”. [(accessed on 8 September 2021)]. Available online: https://cran.r-project.org/web/packages/lsr/
- 29.Gross J. nortest: Tests for Normality. [(accessed on 22 January 2021)]. Available online: https://cran.r-project.org/web/packages/nortest/index.html.
- 30.San-Martín M., Roig-Carrera H., Villalonga-Vadell R.M., Benito-Sevillano C., Torres-Salinas M., Claret-Teruel G., Robles B., Sans-Boix A., Alcorta-Garza A., Vivanco L. Empathy, inter-professional collaboration, and lifelong medical learning in Spanish and Latin-American physicians-in-training who start their postgraduate training in hospitals in Spain. Preliminary outcomes. Aten. Primaria. 2017;49:6–12. doi: 10.1016/j.aprim.2016.02.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Zapana V. Galenos y Víctimas de Negligencia Intercambian Insultos en Marchas. Diario Página Siete. [(accessed on 8 September 2021)]. Available online: https://www.paginasiete.bo/sociedad/2016/7/21/galenos-victimas-negligencia-intercambian-insultos-marchas-103508.html.
- 32.Berduzco-Torres N., Choquenaira-Callañaupa B., Medina P., Chihuantito-Abal L.A., Caballero S., Gallegos E., San-Martín M., Delgado Bolton R.C., Vivanco L. Factors Related to the Differential Development of Inter-Professional Collaboration Abilities in Medicine and Nursing Students. Front. Psychol. 2020;11:432. doi: 10.3389/fpsyg.2020.00432. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Muliira J.K., Etyang C., Muliira R.S., Kizza I.B. Nurses’ orientation toward lifelong learning: A case study of Uganda’s national hospital. J. Contin. Educ. Nurs. 2012;43:90–96. doi: 10.3928/00220124-20111003-03. [DOI] [PubMed] [Google Scholar]
- 34.Pisanti R., Van der Doef M., Maes S., Meier L.L., Lazzari D., Violani C. How Changes in Psychosocial Job Characteristics Impact Burnout in Nurses: A Longitudinal Analysis. Front. Psychol. 2016;7:1082. doi: 10.3389/fpsyg.2016.01082. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data are available upon request.