Abstract
In light of the rapid changes in healthcare delivery due to COVID-19, this study explored kidney healthcare professionals’ (HCPs) perspectives on the impact of these changes on care quality and staff well-being. Fifty-nine HCPs from eight NHS Trusts across England completed an online survey and eight took part in complementary semi-structured interviews between August 2020 and January 2021. Free-text survey responses and interviews were analysed using inductive thematic analysis. Themes described the rapid adaptations, concerns about care quality, benefits from innovations, high work pressure, anxiety and mental exhaustion in staff and the team as a well-being resource. Long-term retention and integration of changes and innovations can improve healthcare access and efficiency, but specification of conditions for its use is warranted. The impact of prolonged stress on renal HCPs also needs to be accounted for in quality planning. Results are further interpreted into a theoretical socio-technical framework.
Keywords: COVID-19, telemedicine, healthcare professionals, care quality, kidney service
1. Introduction
Since March 2020, the COVID-19 pandemic has resulted in a prolonged overload of the National Health System (NHS) in the UK, which has had to treat patients at excessive numbers during the peaks of the pandemic, whilst reconfiguring existing service provision to ensure patient and staff safety. Rapid adaptations took place in healthcare delivery, including staff redeployment to manage the influx of patients, and services done remotely or ceased for infection control and prevention [1,2,3].
Healthcare Professionals (HCPs) have faced numerous occupational stressors during the pandemic including increased workloads, changes in roles, and concerns about patient care. These have been exacerbated by a lack of knowledge and information, rapidly changing procedures, and concerns about lack of personal protective equipment, staff shortages, and risk of infection for themselves and their families [1,4,5,6,7]. Consistent with evidence on the negative psychological impact of previous epidemics on HCPs [8], there have been reports of mental distress and mental exhaustion among staff [1,9] with a high prevalence of anxiety, depression and insomnia among HCPs during COVID-19 [10].
One study with kidney HCPs during and soon after the first global lockdown, highlighted that staff experienced multifaceted work-related stress [11] and although many showed resilience and felt supported by their department, they were at risk of emotional exhaustion [12]. A key protective factor minimizing the impact of work-related stress in HCPs is perceived organizational support [13]. Healthcare organizations that have supportive structures in place where HCPs feel cared for can foster individual wellbeing and resilience [14]. In turn, HCPs play a vital role in organizational resilience—an organization’s capacity to adapt, recover, and transform from sudden disruptions [15]. Resilient organizations have good systems and processes in place to monitor care quality and safety as well as supporting staff. HCPs’ poor mental health and exhaustion has been linked to poorer outcomes in quality of care for patients [16,17] and patient satisfaction particularly when staff perceive they have not been supported by their organization [18].
Studies researching HCPs experiences in kidney services are limited, particularly qualitative studies capturing the in-depth complexities of real-time experiences during the different phases of the pandemic [11]. However, the impact of COVID-19 on staff well-being has been well recognised by national organizations (e.g., UKKA, 2021) in the UK, and has resulted in the development of resources promoting mental well-being. The demands on HCPs in kidney services are complex. Kidney care involves regular contact with clinically vulnerable individuals often with multi-morbidities. HCPs provide long-term care through regular hospital appointments for renal replacement therapy (RRT) and monitoring of disease progression, which makes it a significant challenge for kidney care services to balance care quality with patient safety [19,20]. In addition, COVID-19 reportedly impacts on kidney function in the general population, with acute kidney injury and the need for RRT a further complication, while chronic kidney disease patients are at higher risk of COVID-19 infection and adverse outcomes [20,21,22,23]. The COVID-19 pandemic and associated lockdowns has disrupted kidney services and the redeployment of HCPs meant disruptions to RRT, limited access to kidney transplants and other surgical procedures. The rapid innovation of services to tele-nephrology has moved much of the routine medical care away from hospital settings into patients’ homes [24]. Incorporating telemedicine in kidney care has been a priority prior to the COVID-19 pandemic but the efficacy and safety of this has yet to be determined particularly for those patients with advanced kidney disease [25,26,27]. Despite this, there appears to be good acceptability of telemedicine in kidney care for patients and their significant others, an important component in the adoption and delivery of service innovations [28,29].
The present study was initiated by a kidney research group in response to a COVID-19 outbreak, to map and explore the impacts of a new developing pandemic on kidney care, utilizing an ongoing multicenter mixed-methods study. This study’s specific aim was to understand the impacts of (a) the pandemic on the psychological wellbeing of HCPs in kidney services and (b) the impacts on care delivery during the pandemic from HCPs perspectives. Data were collected following the first lockdown (eased restrictions) until after the end of the second lockdown in the UK.
2. Methods
Study design. This is the DIME-CV sub-study of the multicentre DIMENSION-KD observational study (ISRCTN84422148). DIME-CV is a mixed-methods study involving kidney patients, their significant others and HCPs. The present paper reports the qualitative data, i.e., free-text survey responses and telephone interviews, from HCPs and is part of a series of reports on this study [28,29]. The qualitative research design has an interpretative underpinning epistemology, and the Consolidated Criteria for Reporting Qualitative Research statement informs study reporting (Supplementary Material S1).
Ethics. The study was approved by the Health Research Authority and Leicester Research Ethics Committee (Ref. 18/EM/0117), UK.
Participant selection, settings and procedures. HCPs involved in kidney care from eight NHS Trusts across the UK were invited to take part in the survey by local clinical research facilitators and managers. There were no exclusion criteria (number, role, etc.). Participants filling in the survey could opt in for an interview and all those who did were later invited to attend one. Survey data collection (Jisc Online Surveys, Bristol, UK) took place between August and December 2020. One to one telephone interviews took place between December 2020 and January 2021. Interviews were conducted by AMK, female, white (non-British), psychologist, with training and post graduate experience in qualitative methods. The researcher had no specific or strong prior assumptions about the research topic. Participants were sent written information about the survey and the survey link by the local collaborators and signed an online consent form before filling in the survey. Information about the interview study was emailed by the researcher conducting the interviews and introduction of the researcher (credentials, role) was given verbally during the telephone appointment. Prior to confirming a telephone appointment, participants signed a separate online consent form. Interviews were recorded using a digital voice recorder and field notes were kept following each interview.
The bespoke free text survey questions reported in the present paper explored the perceived (1) impacts of COVID-19-related changes on care delivery, (2) their benefits and (3) drawbacks; impacts on oneself and the team with regard to (4) well-being (psychological), (5) behaviours, and (6) communications. Given the COVID-19 restrictions and the high workload of NHS staff, online free-text questions were deemed appropriate as they are easily accessible, offer flexibility regarding time-commitment, but can also facilitate rich disclosure of experiences (Braun et al., 2020). Interviews aimed to further explore experiences and views on the impact of COVID-19 on kidney care, challenges and needs for HCP support and ways to move forward in kidney care (Interview Schedule Supplementary Material S2).
Data analysis. Inductive thematic analysis [30,31] was applied, first to survey responses, next and separately to interview transcripts in an iterative process (AMK). Survey responses (Excel) were imported in NVivo 14 (QSR International©) and after familiarization with data, codes were assigned to all text. Unit of analysis was whole or part of a free-text response with a complete meaning. Codes were a close description of the content. Next, codes were compared with one another, and similar codes were merged or grouped together in first and second order subthemes, then themes and findings were written up. Debriefings with a co-investigator (CRJ), an occupational psychologist with experience of staff wellbeing and organizational psychology, who studied the subthemes and their content. Alternative themes and organizing framework were examined. At this point a care quality focus was adopted, informed by the organizational resilience framework. Next, an auditor (CJL), sport and exercise scientist with experience in research in kidney healthcare, reviewed the content of analysis. Following this feedback, findings were further refined, i.e., themes were reduced and subthemes merged so that the findings become more focused. Interview transcripts were analysed at this point in NVivo as described above and were embedded in the reported findings.
Trustworthiness. The sample of participants was appropriate for the study, i.e., HCPs had direct experience of the topic under study. Analysis was grounded in the data and an audit trail links back to the data as evidenced by the original quotes provided. Other processes to ensure trustworthiness of the findings were peer debriefing, external audit, thick description, negative case analysis, reflexivity.
3. Results
Fifty-nine eligible HCPs took part in the survey out of the 1167 invited. Of the 40 who opted in for an interview, eight attended (participant characteristics in Table 1). Number of participants responding to free-text questions was variant, with 57–58 responding to inquiries about impacts on communication/behaviour/psychological, and 39–40 to inquiries about changes in care delivery, benefits and drawbacks. Interview time ranged from 22 to 67 min (mean = 37 min). Four themes were consistent across participant responses. Themes, subthemes and original quotes from survey (S) and interviews are presented below (more supporting quotes in Supplement S3).
Table 1.
Survey Participants (n = 59) | Interview Participants (n = 8) | |
---|---|---|
Age | 43.7 (±11.4) years | 47.1 (±7.3) years |
Gender (Female) | 31 (69.5%) | 7 (87.5%) |
Ethnicity | ||
White British | 38 (64.4%) | 5 (62.5%) |
Asian | 15 (25.4%) | 2 (25%) |
White Irish/Other | 5 (8.4%) | 1 (12.5%) |
Black | 1 (1.7%) | - |
Profession | ||
Nurse | 26 (44.1%) | 5 (62.5%) * |
Consultant/Registrar | 16 (27.1%) | 2 (25%) |
Dietician | 6 (10%) | 1 (12.5%) |
Research staff | 3 (5.1%) | - |
Other | 8 (13.6%) | - |
* senior sister/ward manager, inpatient matron, pre-dialysis sister, specialist nurse/home-dialysis, palliative care.
3.1. Rapid Changes and Adaptation in Care Delivery
The reported changes varied among participants. Rapid change and innovations took place in kidney care following the initial shock of the emerging crisis. The few accounts of how changes were initiated described both top-down and individual/team initiatives.
3.1.1. Reduced Patient Contact and Services
Most participants referred to reduced face-to-face patient contact across nephrology services, i.e., remote outpatient appointments, mostly via telephone, and cessation of or socially distanced inpatient visits. Face-to-face appointments were still conducted, when clinically indicated and absolutely essential. Fluctuation in number of face-to-face appointments depending on national restrictions was also reported. Other changes in services included minimal haemodialysis care, suspension of patient information events and groups, some patient education and interventions done by telephone and mail, suspension of home visits and other support services in the community, changes in duties and staff mobility between clinics and wards, including COVID-19 wards, to meet demands and staff shortage.
During inpatient ward rounds less likely to sit at the bedside and talk Less physical patient contact unless absolutely necessary less face-to-face appointments in clinic.
(doctor (S), 51y)
3.1.2. Remote Team Communication
Some participants reported staff and multidisciplinary team (MDT) communication changed to remote, i.e., virtual, via emails and telephone.
Face-to-face meeting with members of study team has beenstopped. We communicate using zoom, emails and phone, etc. We are still able to have proper communication with the help of different technology.
(nurse (S), 46y)
3.1.3. Infection Control and Prevention
This was often noted as a pertinent change, including use of personal protective equipment, increased self-awareness of potential symptoms, being more cautious and constant staff updates on guidelines.
And even now, we have a thermometer and a sats machine, a portable one, so every time we go inside, we need to make sure that everything is safe. So yeah, that changed.
(Interview 1, specialist nurse)
3.2. Impacts on Care Quality
This theme includes the direct and/or indirect issues raised and assessments made about COVID-19-related changes in renal care.
3.2.1. Drawbacks and Concerns for Care Quality
The quality of care delivered to patients was routinely highlighted as a cause for concern and one of the most prevalent topics in participants’ responses.
Difficulties in Patient Assessment and Communication
The challenges of remote patient assessment and monitoring was a pressing concern for most participants, who found it unsatisfactory. The absence of a physical examination and visual cues, non-verbal communication and objective clinical measurements and a reliance on patients self-reporting their condition meant missing important information. This issue was even more intensified for patients with advanced or deteriorating kidney disease, and patients in haemodialysis due to the condition’s complexities, and this could impact on appropriateness and timeliness of treatment and diminish the level care provided.
However, for some patients, telephone clinics mean problems are not being sorted, not getting monitoring to know if intervention is required.
(doctor (S), 31y)
They [dialysis patients] tend to be complex, some have hearing difficulties, and others are non-English speakers. I feel that I cannot give them the level of care that I would be able to if I were visiting the unit/seeing them face to face.
(doctor (S), 38y)
Depending on their role, interview participants identified different patient groups as more impacted, e.g., dialysis patients, younger inpatients, older outpatients. Due to a fear of infection of COVID-19 some patients had reportedly concealed their condition to avoid having to attend hospital appointments leading to deterioration and acute episodes. Clinics and service reductions or cancellations, staff shortages and lack of face-to-face MDT communication also created delays in patients receiving appropriate treatment leading to sub-optimal care.
Patients not admitting to symptoms on the phone and becoming unwell leading to acute episodes, visits to renal assessment unit and admission. Patients starting renal replacement therapy sooner than expected as they have not been monitored as effectively.
(nurse (S), 59y)
Other issues included care being more fragmented and less personalised, limited space capacity for face-to-face appointments, so less family involvement. Certain issues were relevant to local procedures and not consistently reported across sites, like difficulties in getting blood results on time.
More than one in three participants described difficulties in HCP-patient communication. This was particularly challenging with certain patient groups such as those with hearing problems, typically elderly, and non-English speakers, which may have led to inequalities in care provision. Other communication challenges were related to building a rapport, introducing treatment options to new patients, dialysis education, breaking bad news, communication via other HCPs, technical difficulties, IT-related disruptions in communication and confidentiality issues.
Building rapport is key to our assessment being patient friendly. The physical barrier of the mask and visors do not help us reassure our patients of confidentiality as they divulge very personal information on a ward.
(occupational therapist (S), 51y)
Increased Work Pressure
Most participants reported increased workload and work pressure. Reasons given included changes in procedures, covering for staff absences as staff contracted COVID-19 or were shielding, increased demand for inpatient care including COVID-19 wards, increase in administrative tasks, difficulties in team remote communication and coordination.
Everyone is ‘busier’—it is certainly a perception and it has factual basis e.g., staffing challenges due to sickness/isolation. Serious nursing shortage; pressured demand for ‘bank’ working.
(doctor (S), 73y)
3.2.2. Efficiencies and Benefits of Implemented Changes
Participants did note the positive impacts of these changes in healthcare working practices, although these were cited less frequency than the drawbacks and challenges.
Efficiencies and Benefits for Clinical Practice
The benefits of remote and telemedicine appointments, particularly the convenience for patients, was frequently discussed. However, for this benefit to be maximised the patient’s condition needed to be well-managed, with stable blood
Managing patients by blood tests and telephone calls has been easier for some of them. Perhaps highlighted we can see some patients less frequently so long as they have regular blood tests. Less need for patient transport.
(nurse (S), 59y)
Time saving was another cited benefit, using telephone as a “triage” for arranging face-to-face appointments; more flexible working arrangements replaced “presentism in NHS” and allowed doctors to meet multiple commitments along with telephone consultations and for some less time altogether spent on consultations. Other efficiencies included improved collaboration between primary and secondary care and rapid innovations, such a highly regarded drive-through phlebotomy service.
I mean what the pandemic has shown is that we can work with primary care very quickly and very effectively.
(Interview 8, consultant)
Crisis Enabling Innovation
Some participants highlighted how under the COVID-19 crisis mode new models of care were rapidly introduced and tested in a complex healthcare system. COVID-19 “forced” HCPs to think differently about their roles and both patients and HCPs “to accept change”. Innovations were implemented and initiatives developed, some of which had been previously stuck in resistant-to-change mechanisms, and evidence for/against new models of care became readily available. This aspect of COVID-19 impact was explicit in interview data, less so on survey responses.
And the guy that [created the new service], he’s been wishing to do it for eight years, he’s been saying this’ll be amazing for patients…
(Interview 5, specialty doctor)
COVID-19 Safety
Limiting COVID-19 transmission and ensuring patient and staff safety in care delivery was discussed by some HCPs. They acknowledged that the infection prevention measures taken were necessary and would need to continue in the future leading to a “new normal” rather than a “back to normal”.
The changes have benefited both staff and patients in the fact of reducing the risk factor of the virus.
(nurse (S), 55y)
3.3. Impacts on Staff Well-Being
The negative psychological impacts of working during the pandemic were cited often across all HCP groups.
3.3.1. Increased Stress and Anxiety
Most participants referred to increased levels of generalised anxiety and stress experienced amongst staff.
Higher levels of general stress amongst the clinical team.
(doctor (S), 39y)
Whilst a number of participants did not expand on the sources of their anxiety, others referred to a fear of becoming infected with COVID-19 at work and then transmitting it to patients and family, which was particularly heightened at the peaks of the pandemic and in clinically vulnerable staff. Other sources of anxiety included poor communication, negative workplace behaviours and heightened emotions. Work pressures that caused anxiety included: covering for staff absences, adjusting to rapid changes in procedures, roles and services and the loss of MDT support, especially in the wards. Concern for patients and the distress that caused was a source of anxiety particularly for those deployed treating COVID-infected patients and the deaths of both patients and staff members. Concerns about patient support provisions not being adequate was also a source of anxiety and the frustration of not seeing patients face to face. This was underpinned by the general climate of uncertainty in addition to disruption in well-being resources outside work.
There is anxiety relating to uncertainty and a demoralization as so many planned activities are cancelled and contact with friends and family is reduced.
(doctor (S), 60y)
3.3.2. Mental Exhaustion, Negative Affect and Fatigue
A sense of weariness, fatigue and mental exhaustion from the prolonged crisis and uncertainty was expressed by many participants. They described how staff resilience had diminished over time and the emotional impact of COVID-19 reporting feeling “tired”, “drained”, “fed up”, “overwhelmed” at times, “disillusioned”, “unhappy”, “angry”, having sleep problems. Individual and collective struggles were noted including “ward burnout”.
I feel exhausted after shifts and have worked late on regular basis to try and keep up. I have booked more random days off work just to recuperate. I take pain relief every day without fail. [] General unhappiness is the new normal sadly.
(occupational therapist (S), 51y)
3.4. Team and Organizational Support
For many participants, peer and team support was important in managing work stress. Organizational support was identified by fewer participants.
3.4.1. Team Support and Teamwork
Many participants highlighted the teamwork, peer and team support they had experienced, which had remained constant or improved during the pandemic.
Team morale and teamwork improved—felt there was a sense of ‘this is a crisis so we have to get on with it’.
(ward manager (S), 46y)
Such accounts included team coming together, stepping up, being flexible, and showing increased tolerance, greater compassion and appreciation of colleagues. Closer staff relationships were a positive and provided a buffering effect during this “horrible period”. Emphasis on teamwork and team morale was more pronounced among ward staff. Support was reciprocal between staff members, and some noted that this was the only support available at that time.
3.4.2. Difficulties in Communication from Remote Working and Low Team Morale
A limited number of participants reported how, conversely, teamwork had been eroded during this time leading to a decline in team morale and cohesion. Some attributed this to limitations of remote communication in MDT, including lack of spontaneous interactions, tacit learning, social activities and face to face introductions of new members, but also imbalance in workload and engagement among team members. Further confounding factors included a lack of support from staff groups working remotely, depletion of personal energy in trying to keep team morale up and avoiding sharing personal struggles.
I think communication, so that was really hard. Trying to communicate what we wanted, because obviously particularly during the first wave, everybody just disappeared. [] I think it was more to do with not being made to think that we were on our own, because that’s what it felt like.
(Interview 6, senior sister)
3.4.3. Need and Availability of Organizational Support
Organizational-level support was rarely mentioned in survey responses. Being informed by the organization and having an opportunity to feedback and input was seen as important for perceived cohesion and support. Interviewees’ perspectives varied regarding the expressed need for support. Some appeared unaware or disinterested in organizational support provisions, others discussed how they had or would welcome such support. Organizational support that had been utilised by interviewees was accessible within the renal clinics, rather at a general hospital-level.
During the first wave of the pandemic, [] we were fortunate to have some group psychology sessions, and we were shown … [] the psychological pandemic model. And that was really helpful actually, and we were able to talk …
(Interview 3, renal matron)
Coping behaviours varied and some turned to the team, family and friends, physical activity, outdoors and religion.
4. Discussion
The present study explored the impact of COVID-19 on kidney care delivery, quality and staff well-being, as seen by HCPs working in secondary kidney healthcare. The majority of participants referred to the rapid changes and adaptations, concerns about care quality, but also benefits from innovations; at staff-level, high work pressure, increased anxiety and mental exhaustion, but also the team as a well-being resource.
By the autumn/early winter 2020, when the majority of data collection took place, remote care had been fairly well established as the ‘norm’ and was expected to continue for the foreseeable future. Remote delivery acted as a mechanism in infection prevention, while allowing access to regular consultations for the clinically vulnerable kidney patients. However, the survey responses and interviews indicated challenges and shortcomings in care provision and care quality. Alongside the reduction of some services, remote patient monitoring proved challenging and was sometimes inadequate to capture disease progression and offer appropriate treatment in a timely manner, leading in some cases to acute deterioration. Findings are in line with existing research showing that telephone and video consultations are “less information rich” compared to face-to-face consultations [32], in turn impacting on information exchange, rapport and treatment planning which are all key functions of clinician-patient communication [33].
Technical difficulties and lack of IT hardware and infrastructure were also reported, a common finding in telehealth research [32,34]. Additionally, remote appointments may have exacerbated existing challenges in clinician-patient communication for certain patient groups, those for whom English isn’t a first language and those with disabilities such as hearing loss [35]. Evidence in favour of incorporating telemedicine in kidney care has been available prior to COVID-19 [25,26,27]. Present findings show that some applications of telemedicine were considered appropriate and advantageous, mainly consultations with stable and well-managed patients and as a method of triage. A two-sided account from HCPs emerged, i.e., support for integration of telemedicine in standard care vs. difficulties in the treatment of certain patient groups, particularly those whose conditions aren’t well managed and complex. This duality has been reported for other conditions [36,37,38] and in primary care [39].
Nevertheless, the findings highlighted efficiencies and innovations in kidney care. Some HCPs, for example, reported remote clinics were up and running by May 2020, while further adjustments in procedures were on-going. Telemedicine may have previously been perceived by HCPs and patients as a threat to traditional models of care. Its implementation required the deconstruction of traditional patient-clinician encounters in healthcare and redesigning of current models with boldness and vision [40], whilst real-life evidence on its effectiveness, particularly in kidney care, was limited [25,27]. Resistance to innovations for quality improvement is common in the complex healthcare systems [41]. Due to COVID-19, telemedicine and other innovations were rapidly implemented and trialled in this real world natural experiment offering a major opportunity to rapidly identify best practices and design new efficient models in renal care. Indeed, in our sample the majority of HCPs wanted to utilise telemedicine in the future through hybrid models using a combination of face-to-face and remote appointments where appropriate [29], while the majority of patients from the same settings and their significant others felt they could get the support they needed [28,29]. This confirms findings from a 4-year trial of referrals to virtual renal outpatient clinics that aimed to facilitate early access to specialist care in the UK which showed that up to one in four total referrals (with a trend for increase) were deemed eligible for virtual clinics, i.e., patients not at risk for disease progression [42].
On the other hand, the implications regarding staff well-being raised are a cause for concern. The majority of participants reported experiencing heightened stress and anxiety since the start of the pandemic, which was more pronounced among patient-facing staff. Numerous studies have demonstrated similar trends [8,10,11,12,43]. This is a typical response to a prolonged and highly stressful event, known as collective trauma [44]. What the findings demonstrate is there was a shift in mental burden expression as the pandemic unfolded, from an initial peak in stress [6,45], uncertainty [5] and overwhelming sense of helplessness for some HCPs [46], to weariness and mental exhaustion related to prolonged work pressure, moving to the second and third wave. This is particularly worrying given that HCPs in kidney services will most likely still have to deal with an increased workload from a backlog of care, deteriorating patients and COVID-19 patients with renal complications [47]. This can leave HCPs vulnerable to burnout, which is in turn linked to poorer care quality and patient safety [15,48]. The House of Commons report on workforce burnout in the NHS in May 2021 referred to an “extraordinarily dangerous risk” to its future functioning. The need for prioritization of HCPs well-being and provision of tangible and psychological HCP support has been highlighted since the beginning of the pandemic [6,16]. Increasing job resources and support to build individual HCPs resilience could buffer long-term impacts on both staff psychological wellbeing and care quality. This has been reflected in studies underpinned by the Job-Demands Resource model [9,49].
Besides formal support, peer support and teamwork were highlighted by many participants. Trusting relationships based on shared lived experiences and reciprocity are indeed important characteristics in peer mental-health support [50]. On the other hand, negative changes in team dynamics, the loss of opportunities for communication due to remote working and a lack of formal and informal face-to-face contact were also reported. Informal opportunities for knowledge sharing and watercooler communication are important in MDT learning [51]. When considering the continued use of telehealth in kidney services and how these are embedded in the wider health service system the impact on communication and tacit knowledge sharing, and team communication and clinical decision making needs to be taken into account.
This study has highlighted there are a number of factors that need to be considered when implementing telemedicine in kidney care to ensure high-quality safe care is delivered to patients with kidney disease. The results of this study have been further interpreted into a theoretical socio-technical framework (Figure 1) of telemedicine in kidney services. This framework posits that the system needs to be understood in terms of both the social and technical aspects and these need to be brought together as interdependent parts [52]. Socio-technical frameworks have been used to understand telemedicine implementation in a number of clinical settings and consider the human, social, organizational and technical factors in the design and implementation of a system [53,54].
The technical factors in Figure 1 are related to the Rapid Adaptions in Care Delivery resulting in new technology implementation and remote appointments. This led to benefits and efficiencies for both HCPs through reduced patient contact and services, convenient appointments and rapid results, changes in remote team communication. The social factors include Team Work and Organisational Support these relate to how HCPs interact with each other through team support and team work, the differing need and availability of organisational support and the negative impact of remote working has had on team communication and morale.
Individual factors include the impacts on HCPs Wellbeing such as increased stress and anxiety and mental exhaustion, negative affect and fatigue. These technical, social and individual factors interact to influence patient Care Quality and Safety with the rapid technological adaptions leading to improved infection control and prevention but also some concerns for care quality due to increased work pressure and difficulties in patient assessments and communication. In this theoretical framework the patient is at the centre to ensure systems are designed to be patient centred and adapted appropriately to patient care needs.
This socio-technical framework can be applied in future research and service evaluations to improve both organizational and HCP resilience and care quality and safety. Future research should take account of these socio-technical factors and how these interact as interdependent parts of one system. Further applications could evaluate telemedicine implementation and ongoing adaptions and innovations in kidney services, particularly as telemedicine and/or hybrid models become the normalised mode of kidney care. Individual factors to consider include reducing HCP work pressure by addressing staff shortages, facilitating better work-life balance; and providing tailored HCP support both for individuals and teams. The technology-human interaction needs to be understood from both HCPs and patient perspectives to design remote consultations in ways that reduce patient fears and maximise the effectiveness of communication and clinical outcomes. Social factors of consideration are how HCPs teams can be involved in the development and implementation of innovations in renal care and how they can be supported effectively by the team and organization. Future adaptions of technical factors could consider how to triage patients, dependent on clinical needs and suitability for telemedicine. Technical factors need to consider what hardware and software infrastructure, such as online platforms, to facilitate optimum visual input from patients during clinical consultations is needed, the usability and acceptability of these and any potential data protection and security issues.
5. Strengths and Limitations
Strengths of the study are a good representation of renal HCPs with regard to occupation, age, work experience and geographic location (England); the qualitative inquiry of the survey allowing for in-depth exploration of the topic; the timing of data collection, i.e., past the initial phases of COVID-19 allowing for adaptations and reflection to take place; the rigour in data analysis and comprehensive theme presentation. A number of limitations also exist: the low participation of HCPs, i.e., only about 5% of invited HCPs participated in the survey, and subsequent limited sample size. In addition, many survey responses were brief. However, reports based on larger and/or different samples of HCPs reveal similarities in themes [1,11,12,38]. With regard to the interviews, it was not possible to confirm data saturation due to the limited number of available participants. Nevertheless, six interviews may suffice for themes to emerge [55] and interview data fit well with the survey coding structure. Overall, although HCPs’ experiences varied, the reported findings represent consistent patterns, discussed by the majority. Lastly, participants often did not make a distinction among different kidney conditions. Focused studies have given a condition-specific insight on COVID-19 impact, for example, emphasising the advantages of the increased home replacement therapy for dialysis patients [56] or the implications of interruption in living donation and kidney transplantation [57].
6. Conclusions
Moving forwards and taking into account the positive and negative impacts of COVID-19 found in the present study, balancing the efficiencies of remote appointments with care quality and safety are important considerations in NHS quality planning in kidney care. There is an unprecedented momentum for change and HCPs’ input is key in identifying the service model that best meets population needs [41]. Site-specific benefits and drawbacks should be gathered to allow for best practices to emerge. Present findings showed that telemedicine is feasible and suitable for several renal services and patient groups and its long-term retention can improve healthcare access and efficiency. Specification of conditions for its application is warranted. Renal HCPs have been dealing with high workload and anxiety and their support and engagement should also be components of quality planning. A socio-technical framework holds promise for identifying effective future adaptions and applications.
Acknowledgments
This report is independent research supported by the National Institute for Health Research (NIHR) Leicester Biomedical Research Centre and the NIHR Applied Research Collaboration East Midlands. The views expressed are those of the authors and not necessarily those of the Stoneygate Trust, National Health Service, NIHR, or the Department of Health. We are grateful to all the participants who took part, and other research staff who assisted with data collection, particularly Daniel GD Nixon.
Supplementary Materials
The following are available online at https://www.mdpi.com/article/10.3390/ijerph19010188/s1, Supplement S1: Consolidated Criteria for Reporting Qualitative Research (COREQ) Statement, Supplement S2: Interview topic guide, Supplement S3: Table of themes, subthemes and original quotes.
Author Contributions
Conceptualisation and design: A.C.S., A.M.K., T.J.W., C.J.L., J.P., C.R.J.; Data acquisition (survey): A.M.K., J.P.; Data acquisition (interviews): A.M.K.; Data analysis: A.M.K.; Interpretation: A.M.K., C.J.L., C.R.J.; Draft preparation: A.M.K., C.R.J.; Review and editing: A.M.K., C.R.J., A.C.S., C.J.L., T.J.W., J.P.; Funding acquisition: A.C.S.; All authors have full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the Stoneygate Trust (ref KLRP) and the National Institute for Health Research (NIHR) (ref Applied Research Collaboration East Midlands), and additionally supported by the NIHR Leicester Biomedical Research Centre. The APC was funded by the Stoneygate Trust and the Department of Neuroscience Psychology and Behaviour, University of Leicester, UK.
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki, sponsored by University Hospitals of Leicester NHS Trust, and approved by the Health Research Authority Leicester Research Ethics Committee (IRAS 242263) on 24 May 2018 and 29 June 2020.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy restrictions.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.House of Commons Delivering Core NHS and Care Services during the Pandemic and beyond 2020. [(accessed on 24 July 2021)]. Available online: https://committees.parliament.uk/publications/2793/documents/27577/default/
- 2.NICE NIoHR COVID-19 Rapid Guide: Chronic Kidney Disease 2020 Contract No.: NG176. [(accessed on 24 July 2021)]. Available online: https://www.nice.org.uk/guidance/ng176.
- 3.Schroeder K., Norful A.A., Travers J., Aliyu S. Nursing perspectives on care delivery during the early stages of the COVID-19 pandemic: A qualitative study. Int. J. Nurs. Stud. Adv. 2020;2:100006. doi: 10.1016/j.ijnsa.2020.100006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Kang L., Li Y., Hu S., Chen M., Yang C., Yang B.X., Wang Y., Hu J., Lai J., Ma X., et al. The mental health of medical workers in Wuhan, China dealing with the 2019 novel coronavirus. Lancet Psychiatry. 2020;7:e14. doi: 10.1016/S2215-0366(20)30047-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Health Professionals Facing the Coronavirus Disease 2019 (COVID-19) Pandemic: What Are the Mental Health Risks? [(accessed on 24 July 2021)]; Available online: https://pubmed.ncbi.nlm.nih.gov/32370984/
- 6.Shanafelt T., Ripp J., Trockel M. Understanding and Addressing Sources of Anxiety among Health Care Professionals during the COVID-19 Pandemic. JAMA. 2020;323:2133. doi: 10.1001/jama.2020.5893. [DOI] [PubMed] [Google Scholar]
- 7.BMA Consultant Workforce Shortages and Solutions: Now and in the Future. 2020. [(accessed on 24 July 2021)]. Available online: https://www.bma.org.uk/media/3429/bma-consultant-workforce-shortages-and-solutions-oct-2020.pdf.
- 8.Fiest K.M., Leigh J.P., Krewulak K.D., Plotnikoff K.M., Kemp L.G., Ng-Kamstra J., Stelfox H.T. Experiences and management of physician psychological symptoms during infectious disease outbreaks: A rapid review. BMC Psychiatry. 2021;21:91. doi: 10.1186/s12888-021-03090-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Barello S., Caruso R., Palamenghi L., Nania T., Dellafiore F., Bonetti L., Silenzi A., Marotta C., Graffigna G. Factors associated with emotional exhaustion in healthcare professionals involved in the COVID-19 pandemic: An application of the job demands-resources model. Int. Arch. Occup. Environ. Health. 2021;94:1751–1761. doi: 10.1007/s00420-021-01669-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Pappa S., Ntella V., Giannakas T., Giannakoulis V.G., Papoutsi E., Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Brain Behav. Immun. 2020;88:901–907. doi: 10.1016/j.bbi.2020.05.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Mc Keaveney C., Reid J., Carswell C., Bonner A., de Barbieri I., Johnston W., Maxwell A.P., O’Riordan J., Strini V., Walsh I., et al. Experiences of renal healthcare practitioners during the COVID-19 pandemic: A multi-methods approach. BMC Nephrol. 2021;22:301. doi: 10.1186/s12882-021-02500-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Beckwith H., Nimmo A., Savino M., Selvaskandan H., Graham-Brown M., Medcalf J., Cockwell P. Impact of the COVID-19 Pandemic on Training, Morale and Well-Being among the UK Renal Workforce. Kidney Int. Rep. 2021;6:1433–1436. doi: 10.1016/j.ekir.2021.03.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Zhou T., Guan R., Sun L. Perceived organizational support and PTSD symptoms of frontline healthcare workers in the outbreak of COVID-19 in Wuhan: The mediating effects of self-efficacy and coping strategies. Appl. Psychol. 2021;13:745–760. doi: 10.1111/aphw.12267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Aselage J., Eisenberger R. Perceived organizational support and psychological contracts: A theoretical integration. J. Organ. Behav. 2003;24:491–509. doi: 10.1002/job.211. [DOI] [Google Scholar]
- 15.Tawfik D.S., Scheid A., Profit J., Shanafelt T., Trockel M., Adair K.C., Sexton J.B., Ioannidis J.P.A. Evidence Relating Health Care Provider Burnout and Quality of Care: A Systematic Review and Meta-analysis. Ann. Intern. Med. 2019;171:555–567. doi: 10.7326/M19-1152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Rangachari P., Woods J.L. Preserving Organizational Resilience, Patient Safety, and Staff Retention during COVID-19 Requires a Holistic Consideration of the Psychological Safety of Healthcare Workers. Int. J. Environ. Res. Public Health. 2020;17:4267. doi: 10.3390/ijerph17124267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.CQC Annual Report and Accounts 2018/192018. [(accessed on 24 July 2021)]; Available online: http://www.gov.uk/official-documents.
- 18.Ogbonnaya C., Tillman C.J., Gonzalez K. Perceived Organizational Support in Health Care: The Importance of Teamwork and Training for Employee Well-Being and Patient Satisfaction. Group Organ. Manag. 2018;43:475–503. doi: 10.1177/1059601118767244. [DOI] [Google Scholar]
- 19.Syed-Ahmed M., Narayanan M. Immune Dysfunction and Risk of Infection in Chronic Kidney Disease. Adv. Chronic Kidney Dis. 2019;26:8–15. doi: 10.1053/j.ackd.2019.01.004. [DOI] [PubMed] [Google Scholar]
- 20.Kant S., Menez S.P., Hanouneh M., Fine D.M., Crews D.C., Brennan D.C., Sperati C.J., Jaar B.G. The COVID-19 nephrology compendium: AKI, CKD, ESKD and transplantation. BMC Nephrol. 2020;21:449. doi: 10.1186/s12882-020-02112-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Gagliardi I., Patella G., Michael A., Serra R., Provenzano M., Andreucci M. COVID-19 and the Kidney: From Epidemiology to Clinical Practice. J. Clin. Med. 2020;9:2506. doi: 10.3390/jcm9082506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Silver S.A., Beaubien-Souligny W., Shah P.S., Harel S., Blum D., Kishibe T., Meraz-Munoz A., Wald R., Harel Z. The Prevalence of Acute Kidney Injury in Patients Hospitalized with COVID-19 Infection: A Systematic Review and Meta-analysis. Kidney Med. 2020;3:83–98. doi: 10.1016/j.xkme.2020.11.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Bruchfeld A. The COVID-19 pandemic: Consequences for nephrology. Nat. Rev. Nephrol. 2021;17:81–82. doi: 10.1038/s41581-020-00381-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Bringing Kidney Care Home: Lessons from COVID-19. NEJM Catalyst. [(accessed on 24 July 2021)]. Available online: https://mashupmd.com/bringing-kidney-care-home-lessons-from-covid-19-2/
- 25.Gordon E.J., Fink J.C., Fischer M.J. Telenephrology: A novel approach to improve coordinated and collaborative care for chronic kidney disease. Nephrol. Dial. Transplant. 2013;28:972–981. doi: 10.1093/ndt/gfs552. [DOI] [PubMed] [Google Scholar]
- 26.Soman S.S., Yee J. Nephrology and Telehealth: Now? or Now! Adv Chronic Kidney Dis. 2017;24:1–3. doi: 10.1053/j.ackd.2016.12.006. [DOI] [PubMed] [Google Scholar]
- 27.Stauss M., Floyd L., Becker S., Ponnusamy A., Woywodt A. Opportunities in the cloud or pie in the sky? Current status and future perspectives of telemedicine in nephrology. Clin. Kidney J. 2020;14:492–506. doi: 10.1093/ckj/sfaa103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Kanavaki A., Palmer J., Lightfoot C.J., Wilkinson T., Billany R.E., Smith A. MO615: Support for Chonic Kindy Disease Patients Duging COVID-19: Perspectives from Patients, Fanily and Healthcare Professionals. [(accessed on 24 July 2021)]; Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8195140/
- 29.Lightfoot C.J., Wilkinson T.J., Palmer J., Kanavaki A.M., Smith A.C. Patient and Staff Experiences of Remote Kidney Healthcare: Lessons Learnt from COVID-19. [(accessed on 24 July 2021)]; doi: 10.1007/s40620-021-01175-y. Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8494161/ [DOI] [PMC free article] [PubMed]
- 30.Braun V., Clarke V., Boulton E., Davey L., McEvoy C. The online survey as a qualitative research tool. Int. J. Soc. Res. Methodol. 2021;24:641–654. doi: 10.1080/13645579.2020.1805550. [DOI] [Google Scholar]
- 31.Braun V., Clarke V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006;3:77–101. doi: 10.1191/1478088706qp063oa. [DOI] [Google Scholar]
- 32.Hammersley V., Donaghy E., Parker R., McNeilly H., Atherton H., Bikker A., Campbell J., McKinstry B. Comparing the content and quality of video, telephone, and face-to-face consultations: A non-randomised, quasi-experimental, exploratory study in UK primary care. Br. J. Gen. Pract. 2019;69:e595–e604. doi: 10.3399/bjgp19X704573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ong L., De Haes J., Hoos A.M., Lammes F.B. Doctor-patient communication: A review of the literature. Soc. Sci. Med. 1995;40:903–918. doi: 10.1016/0277-9536(94)00155-M. [DOI] [PubMed] [Google Scholar]
- 34.Mammen J.R., Elson M.J., Java J.J., Beck C.A., Beran D.B., Biglan K.M., Boyd C.M., Schmidt P.N., Simone R., Willis A., et al. Patient and Physician Perceptions of Virtual Visits for Parkinson’s Disease: A Qualitative Study. Telemed. E-Health. 2018;24:255–267. doi: 10.1089/tmj.2017.0119. [DOI] [PubMed] [Google Scholar]
- 35.Mick P., Foley D.M., Lin F.R. Hearing loss is associated with poorer ratings of patient-physician communication and healthcare quality. J. Am. Geriatr. Soc. 2014;62:2207–2209. doi: 10.1111/jgs.13113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Hincapié M.A., Gallego J.C., Gempeler A., Piñeros J.A., Nasner D., Escobar M.F. Implementation and Usefulness of Telemedicine during the COVID-19 Pandemic: A Scoping Review. J. Prim. Care Community Health. 2020;11:2150132720980612. doi: 10.1177/2150132720980612. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Tersalvi G., Winterton D., Cioffi G.M., Ghidini S., Roberto M., Biasco L., Pedrazzini G., Dauw J., Ameri P., Vicenzi M. Telemedicine in Heart Failure During COVID-19: A Step Into the Future. Front. Cardiovasc. Med. 2020;7:612818. doi: 10.3389/fcvm.2020.612818. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Johnson S., Dalton-Locke C., Juan N.V.S., Foye U., Oram S., Papamichail A., Landau S., Olive R.R., Jeynes T., Shah P., et al. Impact on mental health care and on mental health service users of the COVID-19 pandemic: A mixed methods survey of UK mental health care staff. Soc. Psychiatry Psychiatr. Epidemiol. 2020;56:25–37. doi: 10.1007/s00127-020-01927-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Gomez T., Anaya Y.B., Shih K.J., Tarn D.M. A Qualitative Study of Primary Care Physicians’ Experiences with Telemedicine During COVID-19. J. Am. Board Fam. Med. 2021;34:S61–S70. doi: 10.3122/jabfm.2021.S1.200517. [DOI] [PubMed] [Google Scholar]
- 40.Schwamm L.H. Telehealth: Seven Strategies to Successfully Implement Disruptive Technology and Transform Health Care. Health Aff. 2014;33:200–206. doi: 10.1377/hlthaff.2013.1021. [DOI] [PubMed] [Google Scholar]
- 41.Shah A. How to move beyond quality improvement projects. BMJ. 2020;370:m2319. doi: 10.1136/bmj.m2319. [DOI] [PubMed] [Google Scholar]
- 42.Mark D.A., Fitzmaurice G.J., Haughey K.A., O’Donnell M.E., Harty J.C. Assessment of the quality of care and financial impact of a virtual renal clinic compared with the traditional outpatient service model. Int. J. Clin. Pract. 2011;65:1100–1107. doi: 10.1111/j.1742-1241.2011.02750.x. [DOI] [PubMed] [Google Scholar]
- 43.Billings J., Ching B.C.F., Gkofa V., Greene T., Bloomfield M. Experiences of frontline healthcare workers and their views about support during COVID-19 and previous pandemics: A systematic review and qualitative meta-synthesis. BMC Health Serv. Res. 2021;21:923. doi: 10.1186/s12913-021-06917-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Resnick K.S., Fins J.J. Professionalism and Resilience after COVID-19. Acad. Psychiatry. 2021;45:552–556. doi: 10.1007/s40596-021-01416-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Maciaszek J., Ciulkowicz M., Misiak B., Szczesniak D., Luc D., Wieczorek T., Fila-Witecka K., Gawlowski P., Rymaszewska J. Mental Health of Medical and Non-Medical Professionals during the Peak of the COVID-19 Pandemic: A Cross-Sectional Nationwide Study. J. Clin. Med. 2020;9:2527. doi: 10.3390/jcm9082527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Newman K.L., Jeve Y., Majumder P. Experiences and emotional strain of NHS frontline workers during the peak of the COVID-19 pandemic. Int. J. Soc. Psychiatry. 2021 doi: 10.1177/00207640211006153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Kunutsor S.K., Laukkanen J.A. Renal complications in COVID-19: A systematic review and meta-analysis. Ann. Med. 2020;52:345–353. doi: 10.1080/07853890.2020.1790643. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Panagioti M., Geraghty K., Johnson J., Zhou A., Panagopoulou E., Chew-Graham C., Peters D., Hodkinson A., Riley R., Esmail A. Association Between Physician Burnout and Patient Safety, Professionalism, and Patient Satisfaction. JAMA Intern. Med. 2018;178:1317–1330. doi: 10.1001/jamainternmed.2018.3713. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 49.Bakker A.B., Demerouti E. The Job Demands-Resources model: State of the art. J. Manag. Psychol. 2007;22:309–328. doi: 10.1108/02683940710733115. [DOI] [Google Scholar]
- 50.Gillard S., Foster R., Gibson S., Goldsmith L., Marks J., White S. Describing a principles-based approach to developing and evaluating peer worker roles as peer support moves into mainstream mental health services. Ment. Health Soc. Incl. 2017;21:133–143. doi: 10.1108/MHSI-03-2017-0016. [DOI] [Google Scholar]
- 51.Waring J.J., Bishop S. “Water cooler” learning: Knowledge sharing at the clinical “backstage” and its contribution to patient safety. J. Health Organ. Manag. 2010;24:325–342. doi: 10.1108/14777261011064968. [DOI] [PubMed] [Google Scholar]
- 52.Baxter G., Sommerville I. Socio-technical systems: From design methods to systems engineering. Interact. Comput. 2011;23:4–17. doi: 10.1016/j.intcom.2010.07.003. [DOI] [Google Scholar]
- 53.Talal A.H., Sofikitou E.M., Jaanimägi U., Zeremski M., Tobin J.N., Markatou M. A framework for patient-centered telemedicine: Application and lessons learned from vulnerable populations. J. Biomed. Inform. 2020;112:103622. doi: 10.1016/j.jbi.2020.103622. [DOI] [PubMed] [Google Scholar]
- 54.Vitacca M., Mazzu M., Scalvini S. Socio-technical and organizational challenges to wider e-Health implementation. Chronic Respir. Dis. 2009;6:91–97. doi: 10.1177/1479972309102805. [DOI] [PubMed] [Google Scholar]
- 55.Guest G., Bunce A., Johnson L. How Many Interviews Are Enough? An experiment with data saturation and variability. Field Methods. 2006;18:59–82. doi: 10.1177/1525822X05279903. [DOI] [Google Scholar]
- 56.Brunori G., Reboldi G., Aucella F. Lessons Learnt during the COVID-19 Pandemic: For Patients with End-Stage Renal Disease, We Should Prioritize Home-Based Treatment and Telemedicine. Kidney Blood Press. Res. 2021;46:1–6. doi: 10.1159/000512629. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Lentine K.L., Mannon R.B., Josephson M.A. Practicing with Uncertainty: Kidney Transplantation during the COVID-19 Pandemic. Am. J. Kidney Dis. 2021;77:777–785. doi: 10.1053/j.ajkd.2020.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy restrictions.