Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Jul 20;16(7):e0254336. doi: 10.1371/journal.pone.0254336

Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: Change is necessary!

Cédric Lanier 1,*,#, Virginie Muller-Juge 1,#, Melissa Dominicé Dao 2, Jean-Michel Gaspoz 3, Noëlle Junod Perron 4, Marie-Claude Audétat 1,4,#
Editor: Ritesh G Menezes5
PMCID: PMC8291751  PMID: 34283854

Abstract

Aims of the study

Residents in difficulty are a major cause for concern in medical education, with a prevalence of 7–15%. They are often detected late in their training and cannot make use of remediation plans. Nowadays, most training hospitals in Switzerland do not have a specific program to identify and manage residents in difficulty. The aim of the study was to explore the challenges perceived by physicians regarding the process of identifying, diagnosing, and supporting residents in difficulty in a structured and programmatic way. We explored perceptions of physicians at different hierarchical levels (residents (R), Chief residents (CR), attending physicians (A), Chief Physician (CP)) in order to better understand these challenges.

Methods

We conducted an exploratory qualitative study between December 2015 and July 2016. We asked volunteers from the Primary Care Division of the Geneva University Hospitals to partake to three focus groups (with CR, A, R) and one interview with the division’s CP. We transcribed, coded, and qualitatively analyzed the three focus groups and the interview, using a content thematic approach and Fishbein’s conceptual framework.

Results

We identified similarities and differences in the challenges of the management of residents in difficulty on a programmatic way amongst physicians of different hierarchical levels.

Our main findings:

  • Supervisors (CR, A, CP) have good identification skills of residents in difficulty, but they did not put in place systematic remediation strategies.

  • Supervisors (CR, A) were concerned about managing residents in difficulty. They were aware of the possible adverse effects on patient care, but “feared to harm” resident’s career by documenting a poor institutional assessment.

  • Residents “feared to share” their own difficulties with their supervisors. They thought that it would impact their career negatively.

  • The four physician’s hierarchical level reported environmental constraints (lack of funding, time constraint, lack of time and resources…).

Conclusion

Our results add two perspectives to specialized recommendations regarding the implementation of remediation programs for residents in difficulty. The first revolves around the need to identify and fully understand not only the beliefs but also the implicit norms and the feeling of self-efficacy that are shared by teachers and that are likely to motivate them to engage in the management of residents in difficulty. The second emphasizes the importance of analyzing these elements that constitute the context for a change and of identifying, in close contact with the heads of the institutions, which factors may favor or hinder it. This research action process has fostered awareness and discussions at different levels. Since then, various actions and processes have been put in place at the Faculty of Medicine in Geneva.

Introduction

A resident in difficulty is defined as a resident who “does not meet the expectations of the training program because of a significant problem with knowledge, attitudes or skills” [1]. These residents are a major cause for concern in medical education and are often detected too late in their training [24]. Residents in difficulty are a common issue with a prevalence of 7–15% [5, 6]. If we refer to the widely applied Vaughn’s conceptual framework [7], they may experience four types of difficulties: 1) Cognitive (i.e. lack of knowledge, clinical reasoning difficulties); 2) Affective (i.e. low self-esteem, anxiety…); 3) Structural (i.e. disorganization, poor time management…); 4) Interpersonal (i.e. lack of professionalism, inappropriate behavior towards patients and colleagues…). Several types of difficulties are often present simultaneously [8, 9].

Recommendations to manage residents in difficulty include implementing a remediation program [8, 10]. Remediation programs rely on an organizational structure, supported by local authorities, which allows early identification of residents in difficulty through a programmatic (step by step) approach or procedure. The different steps of this procedure include: documenting the resident’s difficulties, formulating a pedagogical diagnosis, and elaborating a targeted and individualized and targeted learning plan. This program must define specific objectives, and consequences in case of failure of remediation [1116]. Remediation programs appear to have good results with 75–90% of successful remediation [9, 17, 18].

Most of the remediation programs studied were conducted in North American countries, where postgraduate training programs are very well structured and include formal assessment programs. Such programs can be either traditional, with module-test building blocks at the end of each rotation, or programmatic. Programmatic assessment involves continual collection and analysis of routine information about the learner’s competence and progress and may be supplemented by purposively collected additional assessment information. This approach offers a maximal amount of information both for the learners and their supervisors, and justifies the high-stakes decisions made at the end of a training phase [19]. Both systems require the achievement of different rotations in order to pass the certification exam [10, 17, 20]. In other countries, postgraduate training programs are less structured and include looser assessment programs. For example, in Switzerland where postgraduate training lasts 5 to 6 years according to the medical discipline, the requirements for obtaining a board certification of specialist are the following: 1) a yearly certificate established by the head of the postgraduate training center, acknowledging that the candidate demonstrates the expected skills; 2) four yearly workplace-based assessments that take the form of mini CEX or DOPS [21]; 3) a logbook documenting the necessary technical procedures for each discipline; 4) a final written and knowledge/problem-solving based exam using multiple choice questions [21]. According to our experience, the percentage of residents in difficulty in Switzerland are quite similar to those mentioned in published studies. However, heads of divisions rarely establish yearly certificates reporting candidates’ insufficient skills. Furthermore, there are no national requirements for remediation processes regarding residents in difficulty. Hence, clinical educators may feel at loss regarding the management of residents in difficulties [15, 16, 22, 23].

In this context, our research aimed to obtain an overview of the state of practices in the largest Swiss training center in ambulatory general internal medicine and to understand how these practices are perceived. We also explored the feasibility of implementing a remediation program for residents in difficulty in such as a Swiss division.

Materials and methods

Design

We conducted a participation action research [24] in the Primary Care Division of the Geneva University Hospitals. This research methodology is recommended when implementing changes [25, 26], and aims to actively involve and include participants in the process of change. In this perspective, we conducted our study through focus groups, as well as one-to-one semi structured interview [27].

As several hierarchical levels are usually involved in the supervision of the residents, we chose to deepen our analysis with a cross sectional approach to identify potential differences between the different stakeholders in regard to their attitudes or normative beliefs. We believed that this would help to identify specific implementation actions for each hierarchical level, in order to offer a coherent approach of residents in difficulty. Other studies in medical education have used this multi-level approach to understand different levels’ perceptions of specific issues [28].

We used two different conceptual frameworks. The first framework developed by Fishbein [29, 30], is a predictive model of behavior that allows to understand the different factors influencing the intention of performing (or not) a specific behavior (in our case, the follow up of struggling residents) [31, 32]. As illustrated in Fig 1, Fishbein’s framework postulates that a specific behavior depends on the individual’s skills, on environmental constraints and on the individual’s intention to act. The latter depends on the individual’s beliefs, norms and feelings of self-efficacy regarding this behavior [29].

Fig 1. Fishbein’s integrative model of behavior prediction (adapted from [29]).

Fig 1

The second framework assessed local practices and their relative strengths, weaknesses, opportunities, and threats (SWOT analysis) before designing a concrete plan for implementing a remediation program for residents in difficulty [33].

Context and participants

We conducted our study in the Division of Primary Care Medicine of the Department of Community Medicine, Primary Care and Emergency Medicine at the University Hospitals of Geneva, in Switzerland.

The mission of the Division of Primary Care Medicine is to deliver medical care, to provide pre- and post-graduate training, and to conduct research in community-based clinics in Geneva, a province of 450’000 inhabitants. It provides 38’000 planned medical consultations each year in addition to 23’000 emergency consultations at the medical and surgical walk-in clinics every year. Its patient population includes residents of the Geneva region, with a high percentage of vulnerable populations, such as asylum seekers, undocumented migrants, patients without insurance coverage, prisoners, frail elderly people bound to their homes or patients with substance abuse. At the time of our study, the division trained 60 residents (R) in ambulatory care, directly supervised by 33 Chief residents (CR), depending on the organization of the different units of the Division. (Chiefs residents have completed their postgraduate training, and are in charge of the clinical consultations and daily supervision in the Division) [34]. The 33 Chief residents were under the responsibility of 12 attending physicians (A). In this article, we will use the term supervisors for direct supervisors, regardless of, if they are Chief residents (CR) or attending physicians (A). Residents (R) spend 12 to 24 months training in the Primary Care Division at the end of a five-year general internal medicine residency training.

Ethics statement

The study was approved by the ethics committee of the State of Geneva Institutional Review Board. Participation was voluntary and participants signed an informed consent form.

Data collection

We conducted three focus groups (range 80–83 minutes) between December 2015 and April 2016, with respectively residents (not identified as in difficulty), Chief residents, attending physicians and one interview with the Chief physician (division chief) (41 minutes). Distinguishing between these different levels seemed important to us to facilitate communication between participants and researchers [27], but also to take into account previous research results having underlined that students are mainly influenced during supervision by residents and chiefs residents (70%) rather than by experienced physicians [34].

We used a purposeful sampling strategy for the recruitment. Following the action research’s principles, our aim was to involve participants interested in becoming partners in the research process. In this perspective, we wanted a representative sample of supervisors (attending physicians, Chief residents) involved in direct supervision of residents. Potential participants were informed by e-mail of the nature and objectives of the study and assured of confidentiality.

We chose residents that were not in difficulty, as it would have been too stigmatizing to interview residents in difficulty. We also interviewed the Chief physician to obtain the perception of the top of the hierarchy; Chief physician was interviewed separately to allow other participants to freely express their thoughts and potential difficulties encountered [27]. This also allowed the Chief physician to talk openly about his issues in relation to other departments or hospital requests. The focus groups and the interview were conducted by members of the study, external to the Division team (CL, VMJ, MCA,), respectively physician, research assistant and professor, specialist in medical education). The focus groups and the interview had nine questions to explore the five main themes described by Fishbein (attitude beliefs, normative beliefs, self-efficacy beliefs, skills, environmental constraints) relative to the management of residents in difficulty [29] (See Supplementary material). Before each focus group session, the facilitator repeated the information and obtained written consent. A pilot study was done to test out our semi-structured interview guide and to ensure that our questions would be sufficiently precise and understandable.

Data were anonymized during transcription. All the data were stored outside the division in a locked office.

Data analysis

Preliminary analysis was conducted by the three main researchers (CL, VMJ, MCA), using the conceptual frameworks described above [29, 35], and following a theory-driven variant of immersion–crystallization [36]. Theory-driven immersion—crystallization not only recognizes that data interpretation cannot be entirely free from the researchers’ perspectives, but argues that inductive (data-driven) and deductive (theory-driven) processes should be brought together to enrich interpretation [36]. Disagreements were resolved by consensus and allowed further refinement of the coding scheme.

First, two researchers (CL, VMJ) independently identified, coded, and classified the content of the transcripts using the ATLAS.ti software. They then compared and discussed their coding; disagreements were resolved by consensus and allowed further refinement of the coding scheme. The third researcher (MCA) cross-checked the coding.

The coding researchers then sought to corroborate their findings by providing their co-authors, who were members of the Primary care Division, with the results of their analysis and asking them whether the findings were consistent with their experience within the Division [37].

Results

Sociodemographic characteristics

Three focus groups were conducted with respectively 6 residents (R), 7 Chief residents (CR), and 7 attending physicians (A). One individual interview took place with the Chief Physician (CP). The sociodemographic characteristics of the participants are described in Table 1.

Table 1. Socio-demographic characteristics of the participants.

Participants Gender (n; %) Age (mean;) Supervision experience (yrs) (mean;) Training skills yes (n; %)
FG 1 6 R Male: 3 (50) 34 NA NA
Female: 3 (50)
FG 2 7 CR Male: 2 (28,6) 36.7 1.4 6 (85,7)
Female: 5(71.4)
FG 3 7 A Male: 5 (71.4) 47,1 11.6 4 (57.1)
Female: 2 (28.6)
ITW 1 CP Male 63 30 No

FG = Focus Group; ITW = Interview; R = Resident; CR = Chief Resident; A = Attending Physicians; CP = ChiefPhysician; Training skills = completed supervision workshops or a Certificate of advanced studies in medical education.

The following results are organized according to the different topics of Fishbein’s conceptual framework. We first provided a definition of the category, followed by findings and quotes from our data regarding this category. We also classified our results according to their favorable or unfavorable potentialities, in order to take into account a SWOT analysis (Strengths, Weaknesses, Opportunities, Threats), regarding future implementation of a remediation program for residents in difficulty [33].

Attitude and behavioral beliefs toward the management of residents in difficulty: Willing supervisors undermined by resistant residents

This category is related to the individual’s attitudes and beliefs about the management of residents in difficulty. These beliefs can influence the intention to support or not residents in difficulty (i.e does the supervisors think that remediation programs are effective and useful?).

We observed a general favorable attitude of supervisors towards residents in difficulty, as well as a genuine desire to help them.

CR2 (FG2, line 834): “I have the impression that there’s a real awareness of this problem and a strong desire to take care of this problem, to detect them earlier”.

Participants also expressed a feeling of social responsibility to train competent physicians. They were aware of the future risk for patients if incompetent physicians were allowed to practice without supervision after achieving their post-graduate training.

CP (ITW, line 79): “In an earlier position as an attending physician (…) I encountered residents in difficulty and often Chief residents wanted to get rid of them. (…) My boss at the time said: “it’s very dangerous to do this because these people will eventually set up private practices and so we will be putting these dangerous people “on the market”.

Supervisors were aware of the importance of a programmatic approach to manage residents in difficulty and mentioned several aspects in line with the international recommendations [14]. These included the necessity to define clear requirements towards residents, to separate evaluation and supervision roles and to work in teams to supervise, share and manage residents in difficulty. Finally, supervisors raised the issue that managing residents in difficulty was time consuming, but they were aware of the need to be trained to become a competent supervisor.

Despite these favorable attitudes, supervisors held the belief that the success of a remediation program depended on the resident’s attitude and his willingness to engage in the process. They mentioned how some residents contested a negative evaluation or their supervisor’s advice, making the supervisor feel powerless to handle the situation.

CR 6 (FG2, line 674): “As my colleagues mentioned, I believe that the efficacy [of the remediation] depends on how receptive the resident is. It can be very efficient if the resident accepts it, but if there is a denial, the efficacy could be very bad”.

These beliefs were shared by all supervisors, whatever their hierarchical position.

The supervisors’ favorable attitude and beliefs about the management of residents in difficulty collide with a number of perceived norms and normative beliefs mentioned below.

Norm and normative beliefs: Lack of formal structure and fear of stigmatization

This category is related to normative beliefs, which supervisors will refer to regarding the management of residents in difficulty. In this perspective, supervisors will behave based on what others would do and which behaviors are expected of them, i.e. in line with the norm and implicit normative beliefs present within their workplace.

Supervisors mentioned that there was no defined process to manage residents in difficulty within the division regarding the evaluation, supervision and remediation process. Furthermore, there was no consensus on formal requirements towards residents inside the division.

CR7 (FG2, line 323):” I think that (…) [it’s necessary] to standardize requirements … If there are division requirements (..), that [it’s clear that] this is what we are supposed to do and that it is required for everybody, it’s maybe easier to bring it on”.

In addition, there was no clear distribution of the different tasks between supervisors regarding the management of residents in difficulty. Thus, the level of involvement of the different supervisors (Chief residents, attending physicians) varied depending on the person and the situation. Some Chief residents expressed a need to be supported by the attending physician when managing residents in difficulty. Some administrative aspects of the evaluation process were also challenging. For instance, the Chief physician had to justify himself before the central committee of the Swiss postgraduate body in case he did not validate a resident’s rotation. This discouraged supervisors not to validate a rotation for a resident in difficulty, in line with the resistance coming from the hierarchy and the division of human resources.

Specific inhibiting normative beliefs were found at each level of hierarchy.

The residents reported a taboo when it came to expressing that they were in difficulty. For them, it meant weakness and they were afraid of being stigmatized. This made them reluctant to talk to their colleagues or supervisors about it.

R5 (FG1, line 312): “With colleagues, it’s like, it’s more difficult to talk about it. I think that it is a bit taboo. It would in fact be like revealing that we are weak”.

Residents also trivialized their difficulties and felt that all residents encountered some level of difficulties. They related these difficulties to excessive workload and were not aware that colleagues could have cognitive or other types of difficulties.

Chief residents and attending physicians conceptualized supervision as mostly a process of supporting residents rather than a process that included evaluation and remediation. They were particularly concerned not to be judgmental of the resident and were afraid to harm residents in difficulty and their career by providing them with a poor evaluation.

CR4 (FG2, line 229): “Again, for the final evaluation, often we recognize the resident’s difficulties, but at the end of the year, we often have a hard time writing things as they truly are”.

The Chief physician mentioned a strong financial performance norm. Indeed, the institution asks all divisions to obtain a positive financial performance. A resident, if identified as being in difficulty, would benefit from a reduced clinical activity and would need more supervision time, thus impacting negatively on the financial performance of the division and causing potential tensions between the chief physician and the institution’s top management.

CP (ITW, line 408): “They put considerable pressure… every three months I have a reporting session with the hospital direction. I can tell you that they look at the numbers… every three months, I have to justify these statistics in front of the direction of the hospital”.

This interview, as well as the different focus groups, emphasized the absence of a remediation culture inside the larger institution. There was no institutional incentive or formal policy prescribed by the training hospital to manage residents in difficulty.

CP (ITW, line 292): “What must be said is that the idea of managing these residents in difficulty is, well it doesn’t exist in this hospital, so we are pioneers with this idea”.

These inhibiting norms and normative beliefs probably caused uncertainty for the supervisors’ and impacted their sense of self-efficacy as described in the next paragraph.

Self-efficacy and efficacy beliefs: Supervisors in difficulty!

This category relates to how the supervisors perceive their own skills and efficacy in managing residents in difficulty (i.e does the supervisor feel competent to manage residents in difficulty?) All supervisors reported a good sense of self-efficacy when identifying residents in difficulty. However, their identification process was mostly intuitive. Supervisors mentioned having difficulties to further evaluate residents in difficulty more rigorously and to establish a pedagogical diagnosis. They needed validation from their peers and wanted specific tools to help them assess and confront residents, especially when performance was considered weak.

CR7 (FG2, line 417): “So, I have the impression that in the end, when there is a difficulty, for me to endorse the poor evaluation, I need the support of my peers, their validation”.

Supervisors also mentioned conflicting roles when managing residents in difficulty. They reported feeling uneasy and divided in situations where they had to endorse multiples roles simultaneously: i.e. the roles of caregiver, supervisor, and evaluator to the resident in difficulty. They felt the need to act as caregiver for residents perceived as distressed but recognized that it was in contradiction with their role as supervisors who must give a negative evaluation regarding the same resident’s lower performance. Indeed, helping the resident to improve and, at the same time, being the evaluator who will decide if the resident passes or fails his rotation was perceived as discordant.

A5 (FG3, line 552): … “We believe that our asset is to be a doctor, so we don’t stay in our role of team manager, but we become the treating physician of our resident, because we know how to do it, although we should not do it”.

CR3 (FG2, line 544): “And we have this double role: on one hand we are the kind supervisor who checks out how the resident is doing, and then at some point we have a hierarchical role and we must say « This is how it is ». And sometimes, it’s just, I find it difficult to balance”.

In summary, the supervisor’s lack of confidence in their self-efficacy when faced with a resident in difficulty resulted in the supervisor himself feeling in difficulty, through a mirroring effect. Furthermore, some supervisors were not convinced of the efficacy of remediation process for residents in difficulty.

CR4 (FG2, line 431): “And then, somehow, the resident sends back to us an image of us being a lousy supervisor, in the sense that we question our competence. We tell ourselves: „It’s me who can’t do it. Is it my fault maybe if the resident isn’t progressing”?

This was more often mentioned by supervisors directly in contact with residents (attending physicians, Chief residents), but also expressed by attending physicians not supervising residents directly.

This feeling of uncertainty regarding their self-efficacy seemed to be related to the insufficient pedagogical skills held by supervisors, as described below.

Supervisors’ awareness of their patchy skills to manage residents in difficulty

This category is related to the necessary skills required of the supervisor for the management of residents in difficulty. The skills mentioned were not necessarily mastered by supervisors but were mentioned as useful.

They felt able to detect symptoms and signs of residents in difficulty. Some supervisors had also received feedback training and were aware of how these skills helped them to manage residents in difficulty.

A2 (FG3, line 75): “We observe how they (residents) manage their patients. So, we can analyze that … there might be some shortcomings in the diagnostic approach, in the approach to treatment, and well, that’s more or less it”.

However, Chief residents and attending physicians expressed their lack of specific pedagogical skills in regard to the implementation of a support plan, monitoring progress, according to defined pedagogical objectives. They also mentioned that they needed pedagogical tools to manage residents in difficulty (i.e assessment tools).

A2 (FG3, line 545): “I would add the, in the range of competencies, pedagogical competencies, meaning how to formulate one or several objectives, because at some point we must lay down individualized learning objectives for these people. (…) And exactly that: how to set an objective, how to evaluate it afterwards. That is, I think, it entails how we give the feedback in the follow up in fact”.

Finally, as proposed by Fishbein’s conceptual framework, we analyzed constraints of the local setting that could influence the implementation of a remediation program for residents in difficulty.

Environmental constraints: Time constraint and funding undermine remediation

This category relates to external aspects that will impact on how the individual can follow through with the intended behavior.

In continuum of the inhibiting institutional norms previously mentioned, the attending physicians observed that the institution did not allocate any specific resources (people and time) to manage residents in difficulty. This resulted in a lack of continuity in the supervision process.

A5 (FG3, line 976): “I realize that, in my team, these past two years, even if we wanted to do it, there we times during the year when I wasn’t capable of doing it because we did not have the resources to do so”.

Moreover, the Chief physician underlined that the training hospital was not under any pressure from the Swiss postgraduate medical training bodies to focus on the management of residents in difficulty. Rather, the hospital was involved and giving priority to other major projects.

CP (ITW, line 604): “The problem is that it’s a project that, well, we will have to advertise it as a project, but the general direction of the hospital is not under any external constraint that will impose it upon them, for the time being”.

The Fig 2 summarizes our results and organizes them according to their favorable or unfavorable impact on possible implementation of a remediation program for residents in difficulty.

Fig 2. Summary of results integrated in the Fishbein’s conceptual framework and classified by their favorable or unfavorable potentialities regarding a future implementation of a remediation program for residents in difficulty.

Fig 2

Discussion

Summary of the results

The aim of this research was to shed some light on the local perceptions and practices about the management of residents in difficulty, and to study the feasibility of implementing a remediation program for residents in difficulty in a Swiss division of ambulatory general internal medicine.

Most of our results were similar with those observed in literature. According to Fishbein’s categories, we observed a positive and willingness from supervisors to manage residents in difficulty, with a strong feeling of social responsibility to train competent physicians [23]. But we also identified many barriers that could interfere with the future implementation of a remediation program for residents in difficulty. We observed several inhibiting normative beliefs, i.e the fear to harm the resident and the fear of conflict [23, 31]. Supervisors felt able to identify residents in difficulty but had poor feelings of self-efficacy to evaluate and manage them [23, 38, 39]. All hierarchical levels (Chief Physician, attending physicians, Chief residents, residents) reported a lack of resources and time, leading to a lack of continuity in the supervision processes [8, 23, 31, 40].

We observed a similar narrative at each hierarchical levels of physicians (Chief Physician, attending physicians, Chief residents, and residents), except for aspects related to supervisors’ experience and responsibilities. For example, Chief residents felt more uncertain than the attending physicians regarding their self-efficacy, and the Chief Physician and attending physicians were more concerned by institutional and organizational aspects.

Our results are in line with specialized literature in medical education regarding these issues, but our in-depth analysis allowed us to fully understand challenges in place with a perspective of a change their practice.

Already used in medical education for research on similar topics [31], the Fishbein’s integrative model of behavioural prediction allowed us to underpin our data collection and analysis.

Bringing forward two paradoxes

The synthesis of our results through the Fishbein conceptual framework [29] revealed two main paradoxes that hinder potential changes.

1. Supervisor as caregiver or teacher?

The first paradox relates to the tension between a relational approach versus a pedagogical approach for supervisors managing residents in difficulty. The medical norm of “do no harm” results mainly in supervisors being kind and understanding with their residents in difficulty. This aspect, combined with the lack of specific pedagogical skills, inhibit supervisors to efficiently tackle the residents’ difficulties. Attending physicians and Chief residents were ill at ease handling this double role of supervisor/evaluator and caregiver, and assuming these potentially conflicting responsibilities when faced with a resident in difficulty. As observed by Earle-Foley et al., the assessment “could be viewed as uncaring behavior” and be in tension with the care for others related to the profession [41].

Supervisors viewed the remediation process as depending strongly on the residents in difficulty’s favorable attitudes. Specific training for supervisors could help them to feel more pro-active and more confident with the measures they implement for a resident in difficulty [10]. Furthermore, changing the Swiss postgraduate curriculum to base evaluation on outcomes rather than time spent in clinical rotations would be beneficial. To date, this change has already been made in the undergraduate curriculum [42]. A better alignment between the evaluation methods and the outcomes would make the pedagogical approach more explicit and legitimate, and less dependent on residents’ and supervisors’ attitudes [43, 44]. This change would also be in line with the evolution of medical education towards a learner-centered approach, as it is progressively implemented in a wide number of training institutions.

2. Supervisor as teacher or institutional employee?

We observed a second paradox between the residents’ training needs versus the institutional performance needs. Although institutions need to employ well-trained physicians, they also need to treat a minimal number of patients with the allocated financial resources. Thus, supervisors’ motivation to manage residents in difficulty is in tension with the financial and “clinical volume” requirements imposed by the institution. This underlines the strong influence of institutions’ professional needs over the postgraduate training of residents in Switzerland, where residents are expected to run the institutions. Post graduate training is not under the responsibility of the University, and hospitals do not have the same priorities as the University. For instance, hospitals may not have as a priority to develop a remediation culture and to implement systematic processes for the management of residents in difficulty. In Switzerland, supervisors’ written evaluations are the only direct link between the hospitals and the Swiss Institute for Advanced Medical Training and Education (SIWF) that validate the postgraduate training [45]. This autonomic institute is linked to the Swiss Medical Association (FMH) [46] and has the duty to organize postgraduate training and to validate postgraduate titles [45]. This is in contrast with most studied remediation programs for residents in difficulty, where the University has the social responsibility to train competent physicians [10, 14, 17].

In summary, our results suggest that all stakeholders involved the resident evaluation process did not feel legitimate to formally evaluate residents in difficulty for various reasons: residents were reluctant to acknowledge their difficulties; chief residents felt isolated and powerless in evaluating struggling resident and would not report poor performance to protect the residents; attending physicians could not rely on institutional systematic process to start a remediation program; the division chief did not have additional financial resources to manage a resident in difficulty.

It is likely that as long as not only the supervisors, but also the institution remains muddled between these two paradoxes, implementation of a remediation program cannot be successful.

Since supervisors are aware of their inconsistent skills to manage residents in difficulty, developing their pedagogical skills may allow them to feel more empowered. This should go together with the development of their professional identity [47]: what it means to become a teacher and how new explicit and implicit norms are acquired and put into action. Furthermore, because of the two paradoxes we discussed above, we believe that training supervisors in teaching skills alone is not a strong enough strategy to change the management practices of learners in difficulty within an institution.

Many recommendations have been published in the literature in recent years regarding the strategies to develop and maintain an institutional remediation program [14]. Lacasse et al published a BEME review providing a repertoire of literature-based interventions for helping learners experiencing academic difficulties [48]; Cleland et al. highlighted the importance for institutions to support learners in an educational alliance, and point to the need to consider how best to provide a supportive environment for all learners from a range of educational and social backgrounds to progress towards the required outcomes [49].

Our results are in line with these recommendations but add two perspectives that are also important to consider: the first in regard to the need to identify and fully understand not only the beliefs and the implicit norms, but also the feeling of self-efficacy that are shared by teachers and that are likely to motivate them to engage (or not) in the management of students in difficulty. The second emphasizes the importance of analyzing these elements in the perspective of a change in practices and of identifying which factors may favor or hinder the change. This can only be done by analyzing the context, in close contact with the heads of the institutions concerned.

Strengths and limitations

One of the major limitations of the study is the limited number of focus groups (FG). But the choice of our methodology remains consistent with the principles of action research, which is to involve people from the field who are interested in reflecting on a given issue with a view to improving processes. Another limitation is the monocentric approach to the study which may limit the generalization of the results; indeed the focus made in the context of Switzerland does come with own cultural, but also organizational differences. For example, our local context and the local norms rather reflect a culture of benevolence in supervision, but this questioning may nevertheless be generalized if we think of the issues relating to the best way to give a feedback in the literature [50].

Moreover, the faculty of medicine is not the governing body of the physicians once they have graduated as they are under another governing body which is the Swiss Institute for Advanced Medical Training and Education (SIWF). Keeping that in mind, the concerns raised by this study regarding the management of residents in difficulty in a Swiss general internal medicine outpatient clinic, is one that concerns most hospitals. Furthermore, the process of changing practices that we wanted to initiate through our chosen conceptual frameworks may also be relevant in other contexts.

Our methodological qualitative approach added value in that it facilitated a rich exploration of perceptions and beliefs. One major strength of our study is to have been able to "take the pulse" of a large department, and to have been able to create conditions which made it possible to make explicit the issues relating to the supervision of interns in difficulty as well as the difficulties encountered by their various supervisors, in order to then be able to initiate changes.

Conclusion and perspectives

Participatory action research is a collaborative development process carried out by a group of people interested in changing existing practices in their context. The participants are then involved in a research process that looks at their current practices from a practical perspective [24].

According to Baum et al. [51], this action research process is carried out through a cycle of reflection, in which participants also become partners in the research process, including in deciding what action should stem from the research findings. Their opinion is particularly valuable given that they are involved in the study environment and that their common goal is the improvement of their activities.

This research process has fostered awareness and discussions at different levels. Results were shared, not only within the Primary Care Division, but also at a faculty management level. Since then, various actions and processes have been put in place at the Faculty of Medicine in Geneva. Amongst the most important is the appointment of a task force to develop and implement an institutional remediation program for the entire medical faculty at the pre-graduate level [52]. This makes it possible, particularly to identify learners in difficulty earlier in the course of their training. Discussions are underway for the post-graduate level. In addition, a training course consisting of several workshops and coaching over 2 years has been set up for all Chief residents. Some of the Primary care Division’s Chief residents and attending physicians are involved in this training process. After having started in 2015 in five departments, it will be extended in 2021 to all the departments of the Geneva University Hospitals receiving interns [53]. This training will also benefit students, since it is the same Chief residents who supervise them.

Acknowledgments

We would like to warmly thank all the doctors who participated in the study. We also would like to thank Mrs. Julia Sader, a native English speaker and doctoral student at UDREM (Unit of Development and Research in Medical Education), for her careful proofreading and contribution to the manuscript.

Data Availability

There are ethical restrictions on sharing the data publicly, as it contains sensitive information from doctors and could facilitate participant identification. Certain topics are sensitive on an institutional level and can only be accessed upon request through the University of Geneva's Yareta repository (https://doi.org/10.26037/yareta:d5unipemxjahvno53oyla4flqu). Alternatively, data access requests may be sent to the ethics committee IRB of the University of Geneva - UNIGE and the IRB of the university hospitals - HUG - CCER (Sophie.Desjacques@unige.ch).

Funding Statement

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. This project was supported by institutional Funding Elie SAFRA from the Faculty of Medicine, University of Geneva.

References

  • 1.Steinert Y. The ‘‘problem” learner: Whose problem is it? AMEE Guide No. 76. Medical Teacher. 2013;35:e1035–e45. doi: 10.3109/0142159X.2013.774082 [DOI] [PubMed] [Google Scholar]
  • 2.Hauer K, Teherani A, Kerr K, O’Sullivan P, Irby D. Student Performance Problems in Medical School Clinical Skills Assessments. Acad. Med. 2007;82(10):S69–S72. doi: 10.1097/ACM.0b013e31814003e8 [DOI] [PubMed] [Google Scholar]
  • 3.Hicks PJ, Cox SM, Espey EL, Goepfert AR, Bienstock JL, Erickson SS, et al. To the point: Medical education reviews-Dealing with student difficulties in the clinical setting. American Journal of Obstetrics and Gynecology. 2005;193(6):1915–22. doi: 10.1016/j.ajog.2005.08.012 [DOI] [PubMed] [Google Scholar]
  • 4.Frellsen SL, Baker EA, Papp KK, Durning SJ. Medical school policies regarding struggling medical students during the internal medicine clerkships: results of a national survey. Acad Med. 2008;83(9):876–81. doi: 10.1097/ACM.0b013e318181da98 [DOI] [PubMed] [Google Scholar]
  • 5.Yao D, Scott W. National survey of internal medicine residency program directors regarding problem residents. JAMA. 2000;284(9):1099–104. doi: 10.1001/jama.284.9.1099 [DOI] [PubMed] [Google Scholar]
  • 6.Dupras D, Edson R, Halvorsen A, Hopkins JR, McDonald F. Problem Residents’: Prevalence, Problems and Remediation in the Era of Core Competencies. Am J Med. 2012;125(4):421–5. doi: 10.1016/j.amjmed.2011.12.008 [DOI] [PubMed] [Google Scholar]
  • 7.Vaughn L, Baker R, T: DW. The problem learner. Teaching and Learning in Medicine. 1998;10(4):217–22. [Google Scholar]
  • 8.Guerrasio J, Aagaard E. Methods and Outcomes for the Remediation of Clinical Reasoning. J Gen Intern Med. 2014;29(12):1607–14. doi: 10.1007/s11606-014-2955-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Audétat MC, Voirol C, Béland N, Fernandez N, Sanche G. Remediation plans in family medicine residency. Can Fam Physician. 2015;61(9):e425–34. [Google Scholar]
  • 10.Cleland J, Leggett H, Sandars J, Costa MJ, Patel R, Moffat M. The remediation challenge: theoretical and methodological insights from a systematic review. Med. Educ. 2013;47:242–51. doi: 10.1111/medu.12052 [DOI] [PubMed] [Google Scholar]
  • 11.Sanche G, Béland N, Audétat MC. Creation and implementation of a remediation tool in a family medicine residency program. Can Fam Physician. 2011;57(12):e468–72. [PMC free article] [PubMed] [Google Scholar]
  • 12.Smith C, Stevens N, Servis M. A general framework for approaching residents in difficulty. Fam Med 2007;39:331–6. [PubMed] [Google Scholar]
  • 13.Katz ED, Dahms R, Sadosty AT, Stahmer SA, Goyal D. Guiding Principles for Resident Remediation:Recommendations of the CORD RemediationTask Force. Acad. Med Emerg. 2010;17:S95–S103. doi: 10.1111/j.1553-2712.2010.00881.x [DOI] [PubMed] [Google Scholar]
  • 14.Kalet A, Guerrasio J, Chou CL. Twelve tips for developing and maintaining a remediation program in medical education. Medical Teacher,. 2016;38(8):787–92. doi: 10.3109/0142159X.2016.1150983 [DOI] [PubMed] [Google Scholar]
  • 15.Audétat M-C, Laurin S, Dory V, Charlin B, Nendaz M. Diagnosis and management of clinical reasoning difficulties: Part I. Clinical reasoning supervision and educational diagnosis. Medical Teacher. 2017;39(8):792–96. doi: 10.1080/0142159X.2017.1331033 [DOI] [PubMed] [Google Scholar]
  • 16.Audétat M-C, Laurin S, Dory V, Charlin B, Nendaz M. Diagnosis and management of clinical reasoning difficulties: Part II. Clinical reasoning difficulties: Management and remediation strategies. Medical Teacher. 2017;39(8):797–801. doi: 10.1080/0142159X.2017.1331034 [DOI] [PubMed] [Google Scholar]
  • 17.Hauer K, Ciccone A, Henzel T, Katsufrakis P, Miller S, Norcross W, et al. Remediation of the Deficiencies of Physicians Across the Continuum From Medical School to Practice: A Thematic Review of the Literature. Acad Med 2009;84:1822–32. doi: 10.1097/ACM.0b013e3181bf3170 [DOI] [PubMed] [Google Scholar]
  • 18.Zbieranowski I, Glover Takahashi S, Verma S, Spadafora SM. Remediation of Residents in Difficulty: A Retrospective 10-Year Review of the Experience of a Postgraduate Board of Examiners. Academic Medicine. 2013;88(1):111–6. doi: 10.1097/ACM.0b013e3182764cb6 [DOI] [PubMed] [Google Scholar]
  • 19.Schuwirth L, van der Vleuten C, Durning S. What programmatic assessment in medical education can learn from healthcare. Perspect Med Educ. 2017;6(4):211–5. doi: 10.1007/s40037-017-0345-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Sanfey H, Williams R, Dunnington GL. Recognizing residents with a deficiency in operative performance as a step closer to effective remediation. J Am Coll Surg. 2013;216(1):114–22. doi: 10.1016/j.jamcollsurg.2012.09.008 [DOI] [PubMed] [Google Scholar]
  • 21.Swiss Institute for Advanced Medical Training and Education (SIWF) Evaluation en milieu de travail. Available from: https://www.siwf.ch/fr/formation-postgraduee/evaluation-milieu-travail.cfm. [cited 2020 24 may 2020].
  • 22.Boileau E, St-Onge C, Audétat M. Is there a way for clinical teachers to assist struggling learners? A synthetic review of the literature. Advances in Medical Education and Practice. 2017;8:89–97. doi: 10.2147/AMEP.S123410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Yepes-Rios M, Dudek N, Duboyce R, Curtis J, Allard RJ, Varpio L. The failure to fail underperforming trainees in health professions education: A BEME systematic review: BEME Guide No. 42. Medical Teacher. 2016;38(11):1092–9. doi: 10.1080/0142159X.2016.1215414 [DOI] [PubMed] [Google Scholar]
  • 24.Kemmis S, Mc Taggart R. Participatory action research. in: The Sage handbook of Qualitative Research. Thousand Oaks: Sage Publications Ldt; 2005. [Google Scholar]
  • 25.Kotter J. Leading change: why transformation efforts fail. Harvard Bus Rev 1995;73:59–67. [Google Scholar]
  • 26.Gale R, Grant J. Managing Change in a Medical Education Context: Guidelines for Action, Guide AMEE 10. Medical Teacher 1997;19:239–49. [Google Scholar]
  • 27.Krueger R, Casey M. Focus Groups: A Practical Guide for Applied Research. 3 ed. Thousand Oaks (CA): Sage Publication Ldt; 2000. [Google Scholar]
  • 28.Doja A, Bould M, Clarkin C, Eady K, Sutherland Writer H. The hidden and informal curriculum across the continuum of training: A cross-sectional qualitative study. Med Teach 2016;38(4):410–8. [DOI] [PubMed] [Google Scholar]
  • 29.Fishbein M. The role of theory in HIV prevention. AIDS CARE. 2000;12(3):273–8. doi: 10.1080/09540120050042918 [DOI] [PubMed] [Google Scholar]
  • 30.Fishbein M, Ajzen I. Predicting and Changing Behavior. New York: Psychology Press; 2009. 538 p. [Google Scholar]
  • 31.Cleland J, Knight L, Rees C, Tracey S, Bond C. Is it me or is it them? Factors that influence the passing of underperforming students. Medical education. 2008;42:800–09. doi: 10.1111/j.1365-2923.2008.03113.x [DOI] [PubMed] [Google Scholar]
  • 32.Dory V, Audétat M-C. “They’re downright incurable”: how the metaphors clinical supervisors use reveal their unease at dealing with the clinical reasoning difficulties of their residents. Pédagogie Médicale. 2013;14 (2):(2):83–97. [Google Scholar]
  • 33.Dyson R. Strategic development and SWOT analysis at the University of Warwick. Eur J Oper Res. 2004;152(3):631–40. [Google Scholar]
  • 34.Nendaz MR, Junod AF, Vu NV, Bordage G. Eliciting and displaying diagnostic reasoning during educational rounds in internal medicine: who learns from whom? Acad Med. 1998;73(10 Suppl):S54–6. doi: 10.1097/00001888-199810000-00044 [DOI] [PubMed] [Google Scholar]
  • 35.Saldana J. The coding manual for qualitative researchers. Los Angeles: Sage Publication Ldt; 2011. [Google Scholar]
  • 36.Borkan J. "Immersion/crystallization, In: Doing qualitative research. 2nd ed. Thousand Oaks (CA)USA: B. F. Crabtree & W. L. Miller, Sage Publications Ldt; 1999. [Google Scholar]
  • 37.Crabtree BF, Miller WL. Doing Qualitative Research. 2nd ed. Thousand Oaks, CA, USA: Sage Publications Ldt; 1999, 406 p. [Google Scholar]
  • 38.Bush HM, Schreiber RS, Oliver SJ. Failing to fail: clinicians’ experience of assessing underperforming dental students. Eur J Dent Educ. 2013;17(4):198–207. doi: 10.1111/eje.12036 [DOI] [PubMed] [Google Scholar]
  • 39.Guerrasio J, Furfari KA, Rosenthal LD, Nogar CL, Wray KW, Aagaard EM. Failure to fail: the institutional perspective. Med Teach. 2014;36(9):799–803. doi: 10.3109/0142159X.2014.910295 [DOI] [PubMed] [Google Scholar]
  • 40.Krzyzaniak SM, Wolf SJ, Byyny R, Barker L, Kaplan B, Wall S, et al. A qualitative study of medical educators’ perspectives on remediation: Adopting a holistic approach to struggling residents. Medical Teacher. 2017:1–8. doi: 10.1080/0142159X.2017.1332362 [DOI] [PubMed] [Google Scholar]
  • 41.Earle-Foley V, Myrick F, Luhanga F, Yonge O. Preceptorship: using an ethical lens to reflect on the unsafe student. J Prof Nurs. 2012;28(1):27–33. doi: 10.1016/j.profnurs.2011.06.005 [DOI] [PubMed] [Google Scholar]
  • 42.Michaud P, Jucker-Kupper P, et a. PROFILES; Principal Objectives and Framework for Integrated Learning and Education in Switzerland. Bern: Joint Commission of the Swiss Medical Schools, 2017. [Google Scholar]
  • 43.Hodges B. Medical education and the maintenance of incompetence. Medical Teacher. 2006;28(8):690–6. doi: 10.1080/01421590601102964 [DOI] [PubMed] [Google Scholar]
  • 44.Audetat M-C, Dory V, Nendaz M, Vanpee D, Pestiaux D, Junod Perron N, et al. What is so difficult about managing clinical reasoning difficulties? Medical education. 2012;46(2):216–27. doi: 10.1111/j.1365-2923.2011.04151.x [DOI] [PubMed] [Google Scholar]
  • 45.Swiss Institute for Advanced Medical Training and Education (SIWF) [24th May 2020]. Available from: https://www.siwf.ch/fr/isfm-en-bref/organisation.cfm. [24 may 2020].
  • 46.Swiss Medical Association (FMH) [24th May 2020]. Available from: https://www.fmh.ch/fr/index.cfm#.
  • 47.Higgs J, Mc Allister L. Being a Clinical Educator. Adv Health Sci Educ 2007;12(2):187–200. [DOI] [PubMed] [Google Scholar]
  • 48.Lacasse M, Audétat M-C, Boileau E, Caire Fon N, Dufour M-H, Laferrière M-C, et al. Interventions for undergraduate and postgraduate medical learners with academic difficulties: A BEME systematic review: BEME guide no. 56. Medical Teacher,. 2019. doi: 10.1080/0142159X.2019.1596239 [DOI] [PubMed] [Google Scholar]
  • 49.Cleland J, Cilliers F, van Schalkwyk S. The learning environment in remediation: a review. The clinical teacher. 2018;15:13–8. doi: 10.1111/tct.12739 [DOI] [PubMed] [Google Scholar]
  • 50.Cantillon P, Sargeant J. Giving feedback in clinical settings. BMJ. 2008;337:1292–94. doi: 10.1136/bmj.a1961 [DOI] [PubMed] [Google Scholar]
  • 51.Baum F, MacDougall C, Smith D. Participatory action research. J Epidemiol Community Health 2006;60:854–7. doi: 10.1136/jech.2004.028662 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Groupe de soutien et de suivi de la Faculté de médecine de l’Université de Genève_available at https://www.unige.ch/medecine/fr/enseignement1/groupe-de-suivi/.
  • 53.Institute of primary care medicine, available at: https://www.hug.ch/en/institut-medecine-premier-recours/teaching-and-research.

Decision Letter 0

Ritesh G Menezes

26 Oct 2020

PONE-D-20-15571

Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: changes are needed!

PLOS ONE

Dear Dr. Cédric,

Thank you for submitting your manuscript to PLOS ONE. Sincere apologies for the delay in completing the initial round of the peer-review process. Twelve potential reviewers declined to review the manuscript citing various reasons. Finally, two reviewers have now submitted their comments.

After careful consideration, we feel that your manuscript has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Dec 10 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Ritesh G. Menezes, M.B.B.S., M.D., Diplomate N.B.

Academic Editor

PLOS ONE

Additional Comments by the assigned Academic Editor and Dr. Carmen Melatti, Associate Editor:

The manuscript reports qualitative research conducted in 2016. Are the results still relevant in 2020? Revise the manuscript accordingly.

The Swiss system would have adopted new measures for the management of residents in difficulty in the intervening time.

However, we also note that the qualitative methods uncovered findings that could be generalized to other settings (such as in general, the attitudes of mentors towards their residents, and their understanding of their role; and the resident's perceptions of failure), and that could be worthy of publication.

Discuss the findings in the setting of 2020: explaining what changes have been performed in the years since the interviews were carried out, and how their results can be generalized and used in the present setting.

Besides, address the comments/suggestions made by the reviewers.

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. When reporting the results of qualitative research, we suggest consulting the COREQ guidelines: http://intqhc.oxfordjournals.org/content/19/6/349. In this case, please consider including more information on the number of interviewers, their training and characteristics; how participants were selected; if a pilot study was tested; how data was coded; if bias issues were considered.Moreover, please consider providing the interview guide as a supplementary material.

3. We suggest you thoroughly copyedit your manuscript for language usage, spelling, and grammar. If you do not know anyone who can help you do this, you may wish to consider employing a professional scientific editing service.  

Whilst you may use any professional scientific editing service of your choice, PLOS has partnered with both American Journal Experts (AJE) and Editage to provide discounted services to PLOS authors. Both organizations have experience helping authors meet PLOS guidelines and can provide language editing, translation, manuscript formatting, and figure formatting to ensure your manuscript meets our submission guidelines. To take advantage of our partnership with AJE, visit the AJE website (http://learn.aje.com/plos/) for a 15% discount off AJE services. To take advantage of our partnership with Editage, visit the Editage website (www.editage.com) and enter referral code PLOSEDIT for a 15% discount off Editage services.  If the PLOS editorial team finds any language issues in text that either AJE or Editage has edited, the service provider will re-edit the text for free.

Upon resubmission, please provide the following:

  • The name of the colleague or the details of the professional service that edited your manuscript

  • A copy of your manuscript showing your changes by either highlighting them or using track changes (uploaded as a *supporting information* file)

  • A clean copy of the edited manuscript (uploaded as the new *manuscript* file)

4. Thank you for stating the following in the Financial Disclosure Section of your manuscript:

"This project was supported by institutional Funding Elie SAFRA from the Faculty of Medicine,

University of Geneva."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

"The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. Thank you for stating the following in the Competing Interests section:

"The authors have declared that no competing interests exist."

We note that one or more of the authors are employed by a commercial company: Hirslanden Clinique des Grangettes.

5.1. Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement.

“The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement.

5.2. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc.  

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf.

6. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

7. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I read the manuscript with great interest as this is a problem faced by many residency programs and there is a need to identify and establish a clear process for residents in difficulty. The manuscript is well-presented; however, a few issues need the attention of the authors.

1. Clarify what is meant by senior resident and how they are different from residents. Also please elaborate on their responsibilities regarding the supervision of residents.

2. Elaborate on how the current system identifies residents in difficulty, as it is mentioned that heads of divisions rarely establish the insufficient skills of residents.

3. In many of the categories, the supervisors’ views and opinions were well-presented; however, the resident’s views were limited. Particularly what residents thought of their supervisors’ abilities and skills in managing residents in difficulty.

4. The units for the information in Table 1 are not clear (e.g. supervision experience and clinical experience). Clarify what is meant by postgraduate title.

5. The overall structure and organization of the manuscript should be revised to make reading easier. For example, the part of ethical consideration should be moved.

6. There are issues with formatting that need revision. The legends for figures are found within the body of the manuscript (not the figures themselves). The information written in Box1 can be included in the body of the manuscript and not as a box.

7. The manuscript would benefit from editing the grammar and punctuation.

Reviewer #2: This is an interesting article about an very actual topic in postgraduate medical education. Using the Fishbein's framework authors describe the different influencing (facilitating and inhibiting) factors involved in the supervision and management of residents in difficulty.

The article is well written and easy readable.

The article offert a good framework to setup concrete actions.

I have some experience in qualitative research but not at all with the design of Participation (or participatory?) action research nor with the immersion /crystallisation data analysis, so the following comments my be not entirely appropriate. The authors may consider to adress my suggestions or not.

Concerning the study design:

The purpose of Participatory action research is to enable action. According to Baum et al. "Action is achieved through a reflective cycle, whereby participants collect and analyse data, then determine what action should follow. The resultant action is then further researched and an iterative reflective cycle perpetuates data collection, reflection, and action as in a corkscrew action......The researched cease to be objects and become partners in the whole research process: including selecting the research topic, data collection, and analysis and deciding what action should happen as a result of the research findings." (Journal of Epidemiology & Community Health 2006;60:854-857 http://dx.doi.org/10.1136/jech.2004.028662).

In the actual study the iterative reflection cycle and the involvement of the researched objectives (supervisors of residents in difficulty) is not described. --> could you comment on it?

Data collection:

one of the major limitation of the study is the limited number of focus groups (FG) and the single center context of the stydy that may limit generalization of results --> add a praragraph about limitations

It may not be clear for the reader why the Chief physician was not involved in FG with attending physicians. What was the aim and the added value to interview separately the Chief physician. Do questions to him differ from other groups?

FG was runned with 6 or 7 participants, which is good. It could be interesting to know how many physicians from the primary care division were eligible to participate to the FG and how the recruitment was performed (do they have volunteered to participate or or a subset of them was recruited?) How many refused to participate or were not invited?

CAVE: about the number of participants to FG the text say 6 residents bur the table 1 state 7 residents--> please correct

FG last about 80 minutes and in these 80 min 7 participants were exposed to 9 questions: hence each participant had a mean of 1.5 minutes to answer, discuss and deepen, counter opinions for other participants for each point, which seem ambitous to an in depth discussion --> could you comment on this ?

Results:

Presentation and organisation of results are adequate and figure 2 resume well grahically the main results

Discussion:

At the end of the first paragraph "Summary of results" you say that your results are in line with specialized literature, without specifing what parts of your results are similar and to which articles you refer. Do you mean other aticles using the Fishbein's framework or also studies that used other framework to investigate the problem?

It would be interesting to put results more in perspective with the existing literature and the results of other studies. Are there elements that are different from what other groups found?

The local context and the small number of FG raise the question about the generalisability of results outside western Switzerland. How do your results about Attitude and behavioural beliefs, normsand normative belief and self-efficacy and efficacy belief relate to other studies. They are probably related to the local context ans culture --> please comment on it

The study has some limitations (e.g. number of participants, number of FG, monocentric design) that limit the generalisability of results. I suggest Limitations to be adressed in a specific paragraph.

Specific comments:

In result section correct the different number of participants in residents FG between text and tsable 1

End of the first paragraphe of Discussion: change "but our in depth analyze permits..." to "but our analysis allows..."

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jul 20;16(7):e0254336. doi: 10.1371/journal.pone.0254336.r002

Author response to Decision Letter 0


14 May 2021

Dear Dr. Ritesh G. Menezes,

Academic Editor PLOS ONE

Thank you for giving us the opportunity to submit a revised version of our manuscript “Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: changes are needed!” (ref.no. PONE-D-20-15571) to “PLOS ONE”. We appreciate the time and effort that you and the Reviewers have dedicated to providing your valuable feedback on our manuscript, and we are grateful for your comments on our paper. All suggestions have been incorporated. Here is an itemized, point-by point response to each comment and concern.

Attachment

Submitted filename: response to reviewers def.docx

Decision Letter 1

Ritesh G Menezes

16 Jun 2021

PONE-D-20-15571R1

Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: changes are needed!

PLOS ONE

Dear Dr. Cédric,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by 22-June-2021. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Prof. Ritesh G. Menezes, M.B.B.S., M.D., Diplomate N.B.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Academic Editor Comments:

- Some errors of English grammar and use still persist in the revised manuscript.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for your response. I enjoyed reading the revised manuscript and I see you addressed the majority of the issues that were raised previously.

There are still minor issues with punctuation and some word choices (e.g. beneficiate line 16) that would benefit from revision.

Reviewer #2: Authors have answered in a satisfactory way to all comments. The articulation of sentences and concepts is more fluid. I have no additional comments

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jul 20;16(7):e0254336. doi: 10.1371/journal.pone.0254336.r004

Author response to Decision Letter 1


21 Jun 2021

Reviewer 1

Minor concerns:

Thank you for your response. I enjoyed reading the revised manuscript and I see you addressed the majority of the issues that were raised previously.

There are still minor issues with punctuation and some word choices (e.g. beneficiate line 16) that would benefit from revision. Thank you for your feedback, we are delighted that the revised manuscript addressed most of the issues you raised.

Answer: We have decided to ask an English native to proofread our manuscript and made quite a few changes. We thank you for the suggestion and believe that the changes will clear this minor issue and that is has strengthened the clarity and fluidity of our manuscript. Please see manuscript for a detailed look at the changes made.

Reviewer 2

Authors have answered in a satisfactory way to all comments. The articulation of sentences and concepts is more fluid. I have no additional comments

Answer: Thank you for your feedback, it is nice to hear that you are satisfied with our responses. Please see manuscript for a detailed look at the changes made.

Additional Academic Editor Comments:

Some errors of English grammar and use still persist in the revised manuscript.

Answer: Thank you for your general comment, as mentioned before we have addressed these concerns and ask an English native speaker to proofread our manuscript.

Thank you for the opportunity to publish in your journal and we hope that these last changes strengthened our manuscript and that you will be as happy with its content as we are now. Please see manuscript for a detailed look at the changes made.

Attachment

Submitted filename: response reviewers submission 3 PLOS ONE.docx

Decision Letter 2

Ritesh G Menezes

28 Jun 2021

Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: change is necessary!

PONE-D-20-15571R2

Dear Dr. Cédric,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Prof. Ritesh G. Menezes, M.B.B.S., M.D., Diplomate N.B.

Academic Editor

PLOS ONE

Acceptance letter

Ritesh G Menezes

7 Jul 2021

PONE-D-20-15571R2

Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: change is necessary!

Dear Dr. Lanier:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof. Dr. Ritesh G. Menezes

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: response to reviewers def.docx

    Attachment

    Submitted filename: response reviewers submission 3 PLOS ONE.docx

    Data Availability Statement

    There are ethical restrictions on sharing the data publicly, as it contains sensitive information from doctors and could facilitate participant identification. Certain topics are sensitive on an institutional level and can only be accessed upon request through the University of Geneva's Yareta repository (https://doi.org/10.26037/yareta:d5unipemxjahvno53oyla4flqu). Alternatively, data access requests may be sent to the ethics committee IRB of the University of Geneva - UNIGE and the IRB of the university hospitals - HUG - CCER (Sophie.Desjacques@unige.ch).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES