Abstract
The issue of research on patient satisfaction with healthcare services took on a completely new dimension due to the COVID-19 pandemic and the developing telehealth services. This results from the fact that during the pandemic, remote healthcare was often the only possible form of care provision to the patient. The COVID-19 pandemic has substantially accelerated the implementation of remote healthcare in healthcare institutions and made it an essential tool for providing healthcare services. The objective of the literature review was to study the research on patient satisfaction with remote healthcare services prior to and during the pandemic. The study featured a literature review of electronic databases, such as: Medline, ProQuest, PubMED, Ebsco, Google Scholar, WoS. The identified empirical papers were classified in two groups concerning the research on patient satisfaction prior to and during the COVID-19 pandemic, and were divided and descriptively synthesised. Certain limitations to the methodical quality of the research were demonstrated as result of the conducted analyses. It was also ascertained that researchers lack clarity on the method of defining and measuring satisfaction prior to and during the COVID-19 pandemic.
Keywords: patient satisfaction, remote healthcare, telehealth services, COVID-19
1. Introduction
The satisfaction of stakeholders, such as patients and service providers, can affect the success and degree of application of telehealth services [1]. The issue of research on patient satisfaction with healthcare services took on a completely new dimension due to the pandemic and the developing telehealth services. This results from the fact that during the pandemic, remote healthcare was often the only possible way of providing care to patients. The COVID-19 pandemic made telehealth services an essential tool for providing healthcare. The application of telehealth services around the world was limited until March 2020. In 2019 in the USA, telehealth appointments constituted 8% of all medical appointments [2]. The primary reasons for scarce utilisation of telehealth services, aside from those deriving from financial issues, included the lack of comfort during the use of telehealth technologies by patients and suppliers. Research conducted in the United States between 2 March and 14 April 2020 demonstrated that the number of telehealth appointments increased by 683% [2]. The level of patient satisfaction with telehealth services was usually very high [3,4,5]. However, the prerequisites for such perception of satisfaction are not entirely clear. First, patients usually highly rated their healthcare in general. Second, the high patient satisfaction with telehealth services could derive from the fact that the appointment was available at a convenient time or due to the time saved because there was no need to drive to the appointment, or that such an appointment could even take place, as was the case during the COVID-19 pandemic [6]. Many studies on satisfaction featured difficulties in identifying the elements of satisfaction desired by the patients and linking satisfaction with a specific service, which in consequence, lowers the information utility of such a study [7]. Satisfaction is deemed important because it can affect the treatment result and the patient’s decision on its continuation [8]. Patient satisfaction is a complex issue and its various aspects can affect telehealth services in a manner that makes the interpretation of results difficult [9]. Furthermore, there are concerns on whether there are methodologies that adequately identify satisfaction and what particular measures represent [10]. Therefore, the paper focuses on the review of studies related to patient satisfaction prior to and during the COVID-19 pandemic. The main objective of the study was to review the research on patient satisfaction with remote healthcare prior to, and during, the COVID-19 pandemic. The conducted analyses focused especially on the methods of defining and measuring patient satisfaction. Due to the fact that the COVID-19 pandemic contributed to a drastic increase in the use of remote healthcare, it was expected that it also entailed greater awareness regarding the methods of defining and measuring patient satisfaction. When comparing the research on patient satisfaction prior to and during the COVID-19 pandemic, it was expected that different operating conditions imposed by the pandemic will also entail a qualitative change in the methods of defining and measuring patient satisfaction. Such a change has been recommended for a long time [11]. The paper is organised as follows. The first part presents a manner of defining and measuring satisfaction provided in literature. The second part features a review of the research on patient satisfaction with remote healthcare prior to the COVID-19 pandemic. The third part features a review of the research on patient satisfaction with remote healthcare during the COVID-19 pandemic. Finally, the fourth part presents the theoretical and empirical implications for patient satisfaction with remote healthcare prior to and during the COVID-19 pandemic.
2. Theoretical Background
There is currently much discussion on how to define patient satisfaction in healthcare. In A. Donabedian’s model, patient satisfaction is referred to as the measure of opinions provided by patients [1]. C. Jenkinson et al. pointed out that patient satisfaction seems to mainly reflect the patients’ attitude towards care and the various aspects of this care [11]. In the opinion of M. Tanniru and J. Khuntia, patient satisfaction consists of emotions and perception of the healthcare services provided to them [12]. Other authors specify patient satisfaction as compliance with the patient’s expectations concerning his or her images of perfect healthcare with what is actually provided to him or her, and deem it as an emotional and subjective reaction [13]. Satisfaction is higher, the greater is the compliance with the patient’s earlier expectations, the fewer obstacles in the healthcare system against satisfying own needs and the fewer limitations of rights. Patient satisfaction is a desired result, a measure of quality and the basis for predicting patient behaviours [14,15]. The level of satisfaction is affected by various factors. These factors include, among others, service waiting time, treatment rate, obtaining information on health and the empathy of the medical personnel. The service quality is measured according to subjective criteria. Patients have their own “threshold” of expectations and requirements, their own past experiences and the patient’s feelings and emotions experienced during illness hinder an objective assessment of the situation [4]. It is often stated that patient satisfaction is affected by factors that do not necessarily derive from the treatment process itself, but from his or her expectations towards nurses or doctors and the location of healthcare provision (clinic, emergency department, hospital) [16]. The use of information and communication technologies in service provision contributed to the re-definition of the service provision location and brought healthcare services closer to the patients. Telehealth services are defined as: “an improvement in the way healthcare provision is conceived and delivered by healthcare providers through the use of information and communication technologies to monitor and improve the wellbeing and health of patients and to empower patients in the management of their health and that of their families” [17]. In these terms, the research on patient satisfaction is becoming much more important than ever before because in this situation the service provider obtains information about the degree to which its healthcare system satisfies the patients’ expectations. The use of research information allows for adapting the healthcare system to the customer’s needs. Patient satisfaction is commonly studied with the use of questionnaires [18]. M.S. Weaver, J. Lukowski et al. identified 12 questionnaire tools to assess telehealth service interactions [19]. The tools used most often include, among others, the following: Telemedicine Satisfaction Questionnaire (TSQ) [20], Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) [21], Telemedicine Perception Questionnaire (TMPQ) [22], Patient Experience Questionnaire (PEQ) [23]. The latter part of the paper features a review of studies on patient satisfaction prior to and during the COVID-19 pandemic. The emphasis was especially put on the methods of defining and measuring patient satisfaction prior to and during the pandemic.
3. Review of the Research on Patient Satisfaction with Remote Healthcare Prior to the COVID-19 Pandemic
During the time prior to the COVID-19 pandemic, remote healthcare services were developing to a small extent, however their level was high in selected countries, such as the USA, Canada or Australia. The conducted analyses featured a literature review of electronic databases, such as the following: Medline, ProQuest, PubMED, Ebsco, Google Scholar, WoS, with consideration of the patient satisfaction and telehealth keywords. The paper uses a narrative analysis, in the context of a qualitative approach, selecting studies on patient satisfaction with remote medical service provision prior to the COVID-19 pandemic, taking into account primary healthcare, medical specialisations and geographical diversity. The selected studies are presented in Table 1 below. A literature review demonstrated that the provision of remote healthcare services was deemed useful for patients, but there are few complex papers on how patients rated the services and what was the level of their satisfaction with remote appointments. An analysis of the results of the studies on patient satisfaction with remote healthcare service provision prior to the pandemic was rather fragmentary and concerned selected patient groups in selected countries, which featured a various level of development of this type of healthcare services. It mainly concerned selected medical specialisations, the patients’ specific health-related circumstances, and the research samples are not representative and prevent making a comparison. Nevertheless, when compared to outpatient appointments, the patients’ trust towards doctors in remote healthcare is changing and the satisfaction with remote services is high.
Table 1.
Author | Categories of Care | Type of Measures | Telemedicine Tool | Country |
---|---|---|---|---|
Mendez et al. [24]. | Primary Care | own measures | videoconferencing | Canada |
Yang Y. Zhang X. Lee P. [25] | Neurology: chronic neurological disorders | own measures | unspecified | Chinese medical platform |
Davis et al. [26] | Neurology: chronic neurological disorders | own measures | videoconferencing | USA |
Baranowski, M. L., Balakrishnan, V., & Chen, S. C. [27] | Dermatology | own measures | unspecified | USA |
Burns et al. [28] | Rehabilitation | own measures | videoconferencing | Australia |
Polinski et al. [29] | Primary Care | own measures | videoconferencing | USA |
Hilty et al. [30] | Psychiatry | own measures | videoconferencing | USA |
Saqui et al. [31] | Gastroenterology: | own measures | videoconferencing | Canada |
Simpson et al. [32] | Psychotherapy: | own measures | videoconferencing | Scotland |
Zilliacus et al. [33] | Oncology (cancer) | own measures | videoconferencing | Australia |
Tokuda et al. [34] | Diabetes | own measures | videoconferencing | USA |
Patient satisfaction with remote healthcare services prior to the pandemic is affected by many factors that include, among others, the following:
criteria related to the service provision and treatment method (medical specialisation): Service availability, first or subsequent appointment-diagnosis, diagnostics, referral for hospitalisation or continuation of treatment,
behavioural criteria: Building the doctor-patient relations (building communication, trust, perception of the interaction, mindfulness, sufficient time allocated for the appointment),
systemic criteria: Access to the system, lack of technical problems, electronic medical documentation).
A review of empirical studies points to the lack of uniform research methods and tools used for measuring patient satisfaction with remote services. Various research methods and tools were used, and the number of respondents varied and was difficult to compare.
4. Review of the Research on Patient Satisfaction with Remote Healthcare during the COVID-19 Pandemic
The research on patient satisfaction with remote healthcare featured a review of electronic databases, such as the following: PubMED, ProQuest, Ebsco, Scopus, WoS. The analysis covered papers published in the period from 1 January 2020 to 20 January 2021, papers, published and translated into English or German, and included studies that assessed patient satisfaction with telehealth services or telemedicine. The literature review was conducted with the use of a commonly available Internet search engine (Google). Pearling of study reference lists was conducted to identify additional papers. The keywords used in the search were as follows: COVID-19 AND telehealth AND patient satisfaction AND COVID-19; telemedicine AND patient satisfaction AND COVID-19; teleconsultation AND patient satisfaction AND COVID-19. The analyses also featured the consideration of papers published in the period from 1 January 2020 to 20 January 2021, excluding the keyword COVID-19 to prevent a limitation of the results.
The PRISMA guidelines were used during the research. All search results were pooled and the duplicates were removed. Titles and abstracts underwent screening prior to the analysis of full texts to determine their eligibility. All forms of primary research studies were considered in the analyses. Secondary research, such as literature reviews, was excluded but its reference lists were sought after to identify additional studies. Studies were taken into account if they featured measurements of patient satisfaction with telehealth services during the COVID-19 pandemic. Studies were included if the service was provided remotely via audio-visual telehealth platforms, telephone or application. The review was focused on patient satisfaction with telehealth services. All quantitative and/or qualitative measures were taken into account.
Attention was paid to the tools intended for measuring patient satisfaction and the method of communicating with the patient (teleconference, telephone, application) as means for the interpretation of findings and implications for practice and science.
The initial search featured the identification of 675 studies. After pooling searches and removing duplicates, titles and abstracts were screened, thereby leaving 99 potentially relevant studies. Reference list pearling identified five additional studies. The full texts were retrieved and assessed for eligibility, thereby resulting in the identification of 55 studies eligible for review. The literature selection process is outlined in Figure 1.
Research Characteristics
The relevant papers were published in the period between 1 January 2020 and 20 January 2021. Half of the studies was conducted in the United States of America. The total number of studies conducted in all European countries is equal to half of the studies conducted in the United States of America [35].
All papers focused on telehealth services featuring remote appointments between patients in their local healthcare centre and a healthcare provider at another centre. 27 papers utilised audio-visual telehealth platforms (i.e., InTouch, Zoom, Doxy.me, Google Hangouts, Apple Facetime, Skype, Upfox, VSee, Epic Warp, Doximity), 17 papers reported using the telephone and 1 study reported using an asynchronous method: Store-and-forward. The communication channel was not specified in two papers, beyond the general statement that it concerned telehealth services.
The clinical areas included surgery (n = 6), otolaryngology (n = 5), remote appointment (n = 5), cardiology (n = 3), neurology (n = 3), oncology (n = 3), orthopaedic (n = 3), rehabilitation (n = 3), urology (n = 3), psychiatry (n = 2), dermatology (n = 1), endocrinology (n = 1), gastroenterology (n = 1), gynaecology (n = 1), ambulatory neurosurgery (n = 1), neurosurgery (n = 1), paediatrics (n = 1), proctology (n = 1), rhinology (n = 1), sports medicine (n = 1), orthodontic (n = 1), ophthalmology (n = 1). The clinical areas were not specified in 7 papers.
The patient satisfaction with telehealth services was measured using a range of different methods, such as questionnaires (n = 52) or numerical rating scores (n = 3). The measures used were often developed for each study’s unique setting, thereby, resulting in the measures’ heterogeneity. In three cases, the authors used measures proposed by others authors [6,35,36,37]. In one case, the authors developed measures based on well-defined instruments: General Medical Council (GMC), Patient Questionnaire, Telehealth Satisfaction Scale (TESS), Telehealth Usability Questionnaire (TUQ) and the Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) [38]. Nine studies utilised well-defined, known, validated and reliable measures. These measures included the following: SQUIRE 2.0 [39], WCM Press Ganey Medical Practice Survey [5], Telehealth Usability Questionnaire (TUQ) [39,40], Patient Satisfaction Questionnaire-18 (PSQ-18) [41,42,43], Teleconsultation Satisfaction Questionnaire (TSQ) [8], Short Assessment of Patient Satisfaction (SAPS) [44], Patient Assessment of Communication during Telemedicine (PACT) [45] (Table 2).
Table 2.
Author | Categories of Care | Type of Measures | Telemedicine Tool | Country |
---|---|---|---|---|
Mohanty et al. [46] | ambulatory neurosurgery | own measures | unspecified | USA |
Gerbutavicius et al. [47] | ophthalmology | own measures | video | Germany |
Byrne & Watkinson [48] | orthodontic | own measures | video | UK |
Bhuva, Lankford, Patel, & Haddas [49] | rehabilitation | own measures | mixed (audio/video) | USA |
Zhu et al. [50] | surgery | own measures | video | USA |
Horgan, Alsabbagh, McGoldrick, Bhatia, & Messahel [51] | surgery | own measures | audio | UK |
Haxhihamza et al. [43] | psychiatry | PSQ- 18 | video | Macedonia |
Smrke et al. [52] | oncology | own measures | audio | UK |
Pinar et al. [8] | urology | TSQ | video (virtual room) | France |
Campennì et al. [53] | proctology | own measures | mixed (audio/video | Italy |
Semprino et al. [54] | pediatric | own measures | video (Whatsapp) | Argentina |
Kaur, Galloway, & Oyibo [55] | endocrinology | own measures | audio | UK |
Park et al. [41] | unspecified | TUQ | audio | Korea |
Itamura, Tang, et al. [56] | otolaryngology | own measures | video | USA |
Kodama et al. [57] | cardiology | own measures | not specified/monitoring | USA |
Liu et al. [58] | outpatient visit | own measures | video | China |
Timmers, Janssen, Stohr, Murk, & Berrevoets [59] | unspecified | own measures | audio/monitoring | Netherlands |
Kato-Lin & Thelen [60] | unspecified/acute conditions | own measures | video | USA |
Fieux et al. [61] | otolaryngology | own measures | video | France |
Layfield et al. [40] | otolaryngology | TUQ | video | USA |
Yoon et al. [37] | neurosurgery | Hicks et al. [62] | mixed (audio/video | USA |
Dhahri, Iqbal, & Pardoe [63] | outpatient visit | own measures | video | USA |
Garcia-Huidobro, Rivera, Chang, Bravo, & Capurro [63] | outpatient visit | own measures | video | Chile |
Leibar Tamayo et al. [64] | urology | own measures | audio | Spain |
Barca et al., [65] | surgery | own measures | mixed (audio/video | Italy |
Rizzi, Polachek, Dulas, Strelzow, & Hynes [66] | unspecified | own measures | video | USA |
Casares, Wombles, Skinner, Westerveld, & Gireesh [67] | neurology | own measures | video | USA |
Tenforde et al. [39] | rehabilitation | SQUIRE 2.0 | video | USA |
Ramaswamy et al. [5] | unspecified | WCM Press Ganey Medical Practice Survey | video | USA |
Morisada et al. [42] | rhinology | PSQ-18 | video | USA |
Annis et al. [68] | unspecified | own measures | audio/monitoring | USA |
Kirby et al. [69] | sports medicine | own measures | video | USA |
Satin et al. [36] | surgery | [70] | video | USA |
Chang, Jay, Kalpakjian, Andrews, & Smith [71] | rehabilitation | own measures | mixed (audio/video | USA |
Banks et al. [72] | neurology | own measures | audio | Ireland |
Barkai et al. [73] | outpatient visit | own measures | video | Israel |
Gutkin et al. [74] | oncology | own measures | video | USA |
Guinart, Marcy, Hauser, Dwyer, & Kane [75] | psychiatry | own measures | mixed (audio/video | USA |
Singh et al. [76] | outpatient visit | own measures | audio | India |
Motolese et al. [77] | neurology | own measures | audio | Italy |
Kumar et al. [6] | orthopedics | [78] | audio | India |
Li, Chan, Huang, & Cheng [79] | surgery | own measures | video | China |
Ashmawy et al. [80] | surgery | own measures | video | UK |
Darr et al. [38] | otolaryngology | The Pediatric Otolaryngology Telemedicine Satisfaction survey (POTSS): GMC, TESS, TUQ, TSUQ | mixed (audio/video | UK |
Futterman et al. [44] | gynecology | The Short Assessment of Patient Satisfaction (SAPS) | audio | USA |
Isautier et al. [81] | unspecified | own measures | mixed (audio/video | Australia |
Kerr et al. [82] | cardiology | own measures | audio | Ireland |
Shafi et al. [83] | orthopedics | own measures | video | USA |
Sendagorta et al. [84] | dermatology | own measures | asynchronous: store-and-forward | Spain |
Itamura, Rimell, et al. [85] | otolaryngology | own measures | video | USA |
Singh et al. [45] | cardiology | Patient Assessment of Communication during Telemedicine (PACT) | video | USA |
Taxonera et al. [86] | gastroenterology | own measures | audio | Spain |
Schuster-Bruce, Middleton, Macpherson, Pearce, & Evans [87] | oncology | own measures | audio | UK |
Shiff, Frankel, Oake, Blachman-Braun, & Patel [88] | urology | own measures | audio | Canada |
Khan et al. [89] | orthopedic, ophthalmology, and general medicine | own measures | audio | Pakistan |
5. Recommendations for Preparing Research on Patient Satisfaction with Remote Healthcare
A lack of attention to the definition of “patient satisfaction” in related studies has been observed for many years [90,91,92,93]. The adoption of a suitable definition of patient satisfaction seems to be a necessary basis for the designing of studies and the development of further papers. Logically speaking, the review of concept and theoretical notions should take place prior to the measurement of this construct, while the analysed papers studied patient satisfaction in the reverse order. There were also papers in which satisfaction was not defined at all [43,46,47,48,49,53,56,61,64,65,66,67,72,80]. Taking into account both the survey questionnaires developed by the authors as well as well-defined, known, validated and reliable measures, these treat satisfaction as a multi-dimensional construct. These dimensions only specify certain aspects of patient satisfaction instead of its essence. The dimensions are usually assessed in various contexts and differ in particular studies [94,95,96]. As result, it is not clear whether some dimensions can be context-specific or whether their application is universal.
The studies on patient satisfaction with remote healthcare commonly use questionnaires [18]. Their popularity as a method of measuring this construct is justified, because it has many advantages. Firstly, confidential questions are well suited for capturing the experiences, observations and attitudes of particular persons. Furthermore, the views of patients and doctors can be assessed and compared independently without endangering their mutual relations. Secondly, the studies can utilise the existing and earlier defined scales, thereby enabling their repetition and comparison of results. Thirdly, such studies allow for data collection from large sample sizes at relatively low costs, which can ensure their representative nature. Fourthly, the relevance and reliability of research tools can be assessed using rigorous and transparent validation methods, giving the researcher confidence that they are adapted to the established objectives and ensure a precise measurement [97].
6. Discussion and Conclusions
The first step for the designed studies related to measuring patient satisfaction should be the conceptualisation of the term itself. The second step involved the selection of the measurement tool, possibly from among the existing verified instruments instead of developing new ones. The selection of a verified instrument facilitates the comparison of results from various studies and ultimately creates an integrated collection of knowledge on telehealth services. The tool selected for the study should previously undergo a rigorous assessment of its relevance and reliability, factor structure stability and reactivity to changes over time, especially if it is to be used in the long-term. Insufficient attention is paid to the selection of attributes that are measured with the research instruments and the use of novel instruments, or unverified or unreliable instruments can limit interpretation, prevent comparisons and the advancement of knowledge on the analysed notions [98].
The decision-makers should have the ability to easily interpret the assessment results concerning the provision of remote healthcare services to enable their improvement in their respective healthcare institutions. Patient satisfaction was widely studied, but there are still gaps in the understanding of its role, e.g., in the improvement of the quality of healthcare services. These is needed for modelling factors specific to the situations in which services are provided. Similarly to other researchers studying this phenomenon, the emphasis in this paper has been placed on the fact that patient satisfaction with remote healthcare services can be artificially inflated during the COVID-19 pandemic due to the limited access to outpatient appointments.
However, recent studies on telehealth services demonstrated overall patient satisfaction with any method—video, telephone, application—but this does not mean that improvement measures cannot be implemented. Our understanding of the impact of interactive treatment in outpatient conditions on patient satisfaction is limited. Few papers studied patient satisfaction with telehealth services with the use of validated survey questionnaires which take into account various dimensions of patient satisfaction. More detailed questions in the survey questionnaire can help practitioners understand the specific aspects of remote healthcare that are most important for their patients and adequately redesign their measures. The dominant perspective in the studies on patient satisfaction during the COVID-19 pandemic rarely featured the question of whether the patient was sufficiently satisfied to continue to use this form of consulting if F2F (Face to Face) appointments become available. A large portion of the conducted studies is characterised by high bias, because most respondents had no other option than to choose a remote appointment due to the on-going COVID-19 pandemic. Due to the above, the expressed level of satisfaction does not refer to specific services, but to the availability of any form of healthcare in this difficult period.
If it is possible to choose between face to face and remote healthcare services, many patients prefer the former. Therefore, it seems reasonable that more studies are required that are conducted with the use of survey questionnaires covering more detailed dimensions of satisfaction to assess this discrepancy. For example, patients prefer a limited number of appointments, but healthcare continuity is key for them. However, this aspect is rarely surveyed. The number of outpatient appointments will probably become limited in the nearest future due to the on-going COVID-19 pandemic, while deep and more detailed studies on patient satisfaction with telehealth services can provide valuable information to persons with limit access to patients. A verified questionnaire that encompasses many dimensions of patient satisfaction could be used by researchers from various centres, which in consequence, more reliably compare patient satisfaction with outpatient appointments and remote appointments. This would also allow for the identification of existing gaps in the preferences of potential patients.
An analysis and literature review of the studies on patient satisfaction demonstrate certain limitations concerning their methodical quality. The areas of interest include the small sample size and heterogeneity of the method of defining satisfaction. Furthermore, these areas are measured using unverified instruments. Patient satisfaction was generally not the main objective of the reviewed studies, but rather an additional field of data collection.
7. Implications for Practice and Research
The indices for patient satisfaction largely determine the feedback on the provision of remote healthcare services. In order to improve the level of patient satisfaction, it is worth focusing on improving the provision of remote services, especially of aspects important to the patients (service recipients). This includes, for example, prevention of future health issues, providing the patient with full and exhaustive information on the treatment, the further diagnostic and treatment procedure, and even on the impact of the patient’s health issue on his or her family or personal life. It is also important to implement the provision of remote services in combination with outpatient appointments (hybrid model). Taking into account the increasingly competitive healthcare market, institution managers should focus on achieving high or perfect patient satisfaction ratings to improve the quality of the provided services. This can be done (even during the pandemic) if the managers are provided by researchers with guidelines on what does this satisfaction depend on and on the dimensions it encompasses.
The current situation with the COVID-19 pandemic favours using remote healthcare consulting. As demonstrated by the conducted analyses of the studies on patient satisfaction, it is required to adopt a suitable methodical approach, prepare the studies and develop a reliable research tool that takes into account the multi-dimensionality of patient satisfaction. This means not only careful measurement preparation, but also pilot examinations and tool validation. This approach will ensure the reliability and effectiveness of the conducted research studies. The correlations between demographic factors, such as age, gender, health condition, education, and patient satisfaction cannot be disregarded in the analyses. Studies conducted in the future should concern a precise preparation of the analysis, in terms of satisfaction measurement through pilot examinations and tool validation, which in turn, will contribute to the reliability and effectiveness of the papers and the ability of using them in a broader scope.
Author Contributions
Conceptualization, L.H., G.G. and A.B.; methodology, L.H., G.G. and A.B. software, L.H., A.B.; formal analysis, L.H., G.G. and A.B. investigation, L.H., G.G. and A.B., resources, L.H., G.G. and A.B.; data curation, L.H., G.G. and A.B. writing—original draft preparation, L.H., G.G. and A.B.; writing—review and editing, L.H., G.G. and A.B.; visualization and supervision, L.H., G.G. and A.B.; project administration, L.H., G.G. and A.B. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded/by IDUB against COVID-19 project granted by Warsaw University of Technology under the program Excellence Initiative: Research University (IDUB).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Al-Abri R., Al-Balushi A. Patient Satisfaction Survey as a Tool Towards Quality Improvement. Oman Med. J. 2014;29:3–7. doi: 10.5001/omj.2014.02. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Mann D.M., Chen J., Chunara R., Testa P.A., Nov O. COVID-19 transforms health care through telemedicine: Evidence from the field. J. Am. Med. Inform. Assoc. JAMIA. 2020;27:1132–1135. doi: 10.1093/jamia/ocaa072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Triantafillou V., Layfield E., Prasad A., Deng J., Shanti R.M., Newman J.G., Rajasekaran K. Patient Perceptions of Head and Neck Ambulatory Telemedicine Visits: A Qualitative Study. Otolaryngol. Neck Surg. 2020;164:923–931. doi: 10.1177/0194599820943523. [DOI] [PubMed] [Google Scholar]
- 4.Andrews E., Berghofer K., Long J., Prescott A., Caboral-Stevens M. Satisfaction with the use of telehealth during COVID-19: An integrative review. Int. J. Nurs. Stud. Adv. 2020;2:100008. doi: 10.1016/j.ijnsa.2020.100008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Ramaswamy A., Yu M., Drangsholt S., Ng E., Culligan P.J., Schlegel P.N., Hu J.C. Patient Satisfaction With Telemedicine During the COVID-19 Pandemic: Retrospective Cohort Study. J. Med. Internet Res. 2020;22:e20786. doi: 10.2196/20786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kumar S., Kumar A., Kumar M., Kumar A., Arora R., Sehrawat R. Feasibility of telemedicine in maintaining follow-up of orthopaedic patients and their satisfaction: A preliminary study. J. Clin. Orthop. Trauma. 2020;11:704–710. doi: 10.1016/j.jcot.2020.07.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Leonardsen A.-C.L., Hardeland C., Helgesen A.K., Grøndahl V.A. Patient experiences with technology enabled care across healthcare settings- a systematic review. BMC Health Serv. Res. 2020;20:1–17. doi: 10.1186/s12913-020-05633-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Pinar U., Anract J., Perrot O., Tabourin T., Chartier-Kastler E., Parra J., Vaessen C., de la Taille A., Roupret M. Preliminary assessment of patient and physician satisfaction with the use of teleconsultation in urology during the COVID-19 pandemic. World J. Urol. 2020:1–6. doi: 10.1007/s00345-020-03432-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Nochomovitz M., Sharma R. Is it time for a new medical specialty? The medical virtualist. JAMA J. Am. Med. Assoc. 2018;319:437–438. doi: 10.1001/jama.2017.17094. [DOI] [PubMed] [Google Scholar]
- 10.Williams B., Wilkinson G. Patient Satisfaction in Mental Health Care: Evaluating an Evaluative Method. Br. J. Psychiatry. 1995;166:559–562. doi: 10.1192/bjp.166.5.559. [DOI] [PubMed] [Google Scholar]
- 11.Jenkinson C. Patients’ experiences and satisfaction with health care: Results of a questionnaire study of specific aspects of care. Qual. Saf. Health Care. 2002;11:335–339. doi: 10.1136/qhc.11.4.335. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Tanniru M., Khuntia J. Dimensions of Patient Experience and Overall Satisfaction in Emergency Departments. J. Patient Exp. 2017;4:95–100. doi: 10.1177/2374373517692914. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Maconko M., Kopański Z., Strychar J., Małek Ł. Satysfakcja pacjenta i metody jej pomiaru (Patient satisfaction and the methods of its assessment) J. Clin. Healthc. 2016;3:14–19. [Google Scholar]
- 14.Otani K., Herrmann P.A., Kurz R.S. Improving patient satisfaction in hospital care settings. Heal. Serv. Manag. Res. 2011;24:163–169. doi: 10.1258/hsmr.2011.011008. [DOI] [PubMed] [Google Scholar]
- 15.Korneta P., Kludacz-Alessandri M., Walczak R. The Impact of COVID-19 on the Performance of Primary Health Care Service Providers in a Capitation Payment System: A Case Study from Poland. Int. J. Environ. Res. Public Health. 2021;18:1407. doi: 10.3390/ijerph18041407. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Bourdillon F., du Montcel S.T., Collin E., Coutaux A., Lébeaupin E., Cesselin F., Bourgeois P. Determinants of patient satisfaction regarding pain care. Rev. d’Épidémiologie Santé Publique. 2012;60:455–462. doi: 10.1016/j.respe.2012.03.012. [DOI] [PubMed] [Google Scholar]
- 17.Iyawa G.E., Herselman M., Botha A. Digital Health Innovation Ecosystems: From Systematic Literature Review to Conceptual Framework. Procedia Comput. Sci. 2016;100:244–252. doi: 10.1016/j.procs.2016.09.149. [DOI] [Google Scholar]
- 18.Whitten P., Johannessen L.K., Soerensen T., Gammon D., Mackert M. A systematic review of research methodology in telemedicine studies. J. Telemed. Telecare. 2007;13:230–235. doi: 10.1258/135763307781458976. [DOI] [PubMed] [Google Scholar]
- 19.Weaver M.S., Lukowski J., Wichman B., Navaneethan H., Fisher A.L., Neumann M.L. Human Connection and Technology Connectivity: A Systematic Review of Available Telehealth Survey Instruments. J. Pain Symptom Manag. 2021;61:1042–1051.e2. doi: 10.1016/j.jpainsymman.2020.10.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Yip M.P., Chang A.M., Chan J., MacKenzie A.E. Development of the Telemedicine Satisfaction Questionnaire to evaluate patient satisfaction with telemedicine: A preliminary study. J. Telemed. Telecare. 2003;9:46–50. doi: 10.1258/135763303321159693. [DOI] [PubMed] [Google Scholar]
- 21.Bakken S., Grullon-Figueroa L., Izquierdo R., Lee N.-J., Morin P., Palmas W., Teresi J., Weinstock R.S., Shea S., Starren J., et al. Development, Validation, and Use of English and Spanish Versions of the Telemedicine Satisfaction and Usefulness Questionnaire. J. Am. Med. Inform. Assoc. 2006;13:660–667. doi: 10.1197/jamia.M2146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Demiris G., Speedie S., Finkelstein S. A questionnaire for the assessment of patients’ impressions of the risks and benefits of home telecare. J. Telemed. Telecare. 2000;6:278–284. doi: 10.1258/1357633001935914. [DOI] [PubMed] [Google Scholar]
- 23.Steine S., Finset A., Laerum E. A new, brief questionnaire (PEQ) developed in primary health care for measuring patients’ experience of interaction, emotion and consultation outcome. Fam. Pr. 2001;18:410–418. doi: 10.1093/fampra/18.4.410. [DOI] [PubMed] [Google Scholar]
- 24.Mendez I., Jong M., Keays-White D., Turner G. The use of remote presence for health care delivery in a northern Inuit community: A feasibility study. Int. J. Circumpolar Health. 2013;72 doi: 10.3402/ijch.v72i0.21112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Yang Y., Zhang X., Lee P.K. Improving the effectiveness of online healthcare platforms: An empirical study with multi-period patient-doctor consultation data. Int. J. Prod. Econ. 2019;207:70–80. doi: 10.1016/j.ijpe.2018.11.009. [DOI] [Google Scholar]
- 26.Davis L.E., Coleman J., Harnar J., King M.K. Teleneurology: Successful Delivery of Chronic Neurologic Care to 354 Patients Living Remotely in a Rural State. Telemed. e-Health. 2014;20:473–477. doi: 10.1089/tmj.2013.0217. [DOI] [PubMed] [Google Scholar]
- 27.Baranowski M.L., Balakrishnan V., Chen S.C. Patient Satisfaction with the Veteran’s Administration Teledermatology Service. J. Am. Acad. Dermatol. 2019 doi: 10.1016/j.jaad.2019.01.036. [DOI] [PubMed] [Google Scholar]
- 28.Burns C.L., Ward E.C., Bassett L., Kenny L.M., Greenup P., Malcolme K., Hill A.J. A pilot trial of a speech pathology telehealth service for head and neck cancer patients. J. Telemed. Telecare. 2012;18:443–446. doi: 10.1258/jtt.2012.gth104. [DOI] [PubMed] [Google Scholar]
- 29.Polinski J.M., Barker T., Gagliano N., Sussman A.J., Brennan T.A., Shrank W.H. Patients’ Satisfaction with and Preference for Telehealth Visits. J. Gen. Intern. Med. 2016;31:269–275. doi: 10.1007/s11606-015-3489-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Hilty D.M., Nesbitt T.S., Kuenneth C.A., Cruz G.M., Hales R.E. Rural Versus Suburban Primary Care Needs, Utilization, and Satisfaction With Telepsychiatric Consultation. J. Rural. Health. 2007;23:163–165. doi: 10.1111/j.1748-0361.2007.00084.x. [DOI] [PubMed] [Google Scholar]
- 31.Saqui O., Chang A., Mcgonigle S., Purdy B., Fairholm L., Baun M., Yeung M., Rossos P., Allard J. Telehealth Videoconferencing: Improving Home Parenteral Nutrition Patient Care to Rural Areas of Ontario, Canada. J. Parenter. Enter. Nutr. 2007;31:234–239. doi: 10.1177/0148607107031003234. [DOI] [PubMed] [Google Scholar]
- 32.Simpson S., Bell L., Knox J., Mitchell D. Therapy via videoconferencing: A route to client empowerment? Clin. Psychol. Psychother. 2005;12:156–165. doi: 10.1002/cpp.436. [DOI] [Google Scholar]
- 33.Zilliacus E.M., Meiser B., Lobb E.A., Kirk J., Warwick L., Tucker K. Women’s Experience of Telehealth Cancer Genetic Counseling. J. Genet. Couns. 2010;19:463–472. doi: 10.1007/s10897-010-9301-5. [DOI] [PubMed] [Google Scholar]
- 34.Tokuda L., Lorenzo L., Theriault A., Taveira T.H., Marquis L., Head H., Edelman D., Kirsh S.R., Aron D.C., Wu W.-C. The utilization of video-conference shared medical appointments in rural diabetes care. Int. J. Med. Inform. 2016;93:34–41. doi: 10.1016/j.ijmedinf.2016.05.007. [DOI] [PubMed] [Google Scholar]
- 35.Hong S.M., Olson-Kellogg B.J., North S.E., Davis J.L., Staker J.L. Telehealth Physical Therapy as an Innovative Clinical Education Model With Positive Patient Impact: A Case Report in the Context of the COVID-19 Pandemic. J. Phys. Ther. Educ. 2020;34:275–281. doi: 10.1097/JTE.0000000000000163. [DOI] [Google Scholar]
- 36.Satin A.M., Shenoy K., Sheha E.D., Basques B., Schroeder G.D., Vaccaro A.R., Lieberman I.H., Guyer R.D., Derman P.B. Spine Patient Satisfaction With Telemedicine During the COVID-19 Pandemic: A Cross-Sectional Study. Glob. Spine J. 2020 doi: 10.1177/2192568220965521. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Yoon E.J., Tong D., Anton G.M., Jasinski J.M., Claus C.F., Soo T.M., Kelkar P.S. Patient Satisfaction with Neurosurgery Telemedicine Visits During the Coronavirus Disease 2019 Pandemic: A Prospective Cohort Study. World Neurosurg. 2021;145:e184–e191. doi: 10.1016/j.wneu.2020.09.170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Darr A., Senior A., Argyriou K., Limbrick J., Nie H., Kantczak A., Stephenson K., Parmar A., Grainger J. The impact of the coronavirus (COVID-19) pandemic on elective paediatric otolaryngology outpatient services—An analysis of virtual outpatient clinics in a tertiary referral centre using the modified paediatric otolaryngology telemedicine satisfaction survey (POTSS) Int. J. Pediatr. Otorhinolaryngol. 2020;138:110383. doi: 10.1016/j.ijporl.2020.110383. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Tenforde A.S., Borgstrom H., Polich G., Steere H., Davis I.S., Cotton K., O’Donnell M., Silver J.K. Outpatient Physical, Occupational, and Speech Therapy Synchronous Telemedicine. Am. J. Phys. Med. Rehabil. 2020;99:977–981. doi: 10.1097/PHM.0000000000001571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Ba E.L., Triantafillou V., Prasad A., Deng J., Shanti R.M., Newman J.G., Rajasekaran K. Telemedicine for head and neck ambulatory visits during COVID -19: Evaluating usability and patient satisfaction. Head Neck. 2020;42:1681–1689. doi: 10.1002/hed.26285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Park H.-Y., Kwon Y.-M., Jun H.-R., Jung S.-E., Kwon S.-Y. Satisfaction Survey of Patients and Medical Staff for Telephone-Based Telemedicine During Hospital Closing Due to COVID-19 Transmission. Telemed. e-Health. 2020 doi: 10.1089/tmj.2020.0369. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Morisada M.V., Hwang J., Gill A.S., Wilson M.D., Strong E.B., Steele T.O. Telemedicine, Patient Satisfaction, and Chronic Rhinosinusitis Care in the Era of COVID-19. Am. J. Rhinol. Allergy. 2020 doi: 10.1177/1945892420970460. [DOI] [PubMed] [Google Scholar]
- 43.Haxhihamza K., Arsova S., Bajraktarov S., Kalpak G., Stefanovski B., Novotni A., Milutinovic M. Patient Satisfaction with Use of Telemedicine in University Clinic of Psychiatry: Skopje, North Macedonia During COVID-19 Pandemic. Telemed. e-Health. 2020 doi: 10.1089/tmj.2020.0256. [DOI] [PubMed] [Google Scholar]
- 44.Futterman I., Rosenfeld E., Toaff M., Boucher T., Golden-Espinal S., Evans K., Clare C.A. Addressing Disparities in Prenatal Care via Telehealth During COVID-19: Prenatal Satisfaction Survey in East Harlem. Am. J. Perinatol. 2021;38:088–092. doi: 10.1055/s-0040-1718695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Singh A., Mountjoy N., McElroy D., Mittal S., Al Hemyari B., Coffey N., Miller K., Gaines K. Patient Perspectives With Telehealth Visits in Cardiology During COVID-19: Online Patient Survey Study. JMIR Cardio. 2021;5:e25074. doi: 10.2196/25074. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Mohanty A., Srinivasan V.M., Burkhardt J.-K., Johnson J., Patel A.J., Sheth S.A., Viswanathan A., Yoshor D., Kan P. Ambulatory neurosurgery in the COVID-19 era: Patient and provider satisfaction with telemedicine. Neurosurg. Focus. 2020;49:E13. doi: 10.3171/2020.9.FOCUS20596. [DOI] [PubMed] [Google Scholar]
- 47.Gerbutavicius R., Brandlhuber U., Glück S., Kortüm G.-F., Kortüm I., Navarrete Orozco R., Rakitin M., Strodtbeck M., Wolf A., Kortüm K.U. Evaluierung der Patientenzufriedenheit mit einer augenärztlichen Videosprechstunde während der COVID-19-Pandemie. Ophthalmologe. 2020;117:659–667. doi: 10.1007/s00347-020-01143-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Byrne E., Watkinson S. Patient and clinician satisfaction with video consultations during the COVID-19 pandemic: An opportunity for a new way of working. J. Orthod. 2021;48:64–73. doi: 10.1177/1465312520973677. [DOI] [PubMed] [Google Scholar]
- 49.Bhuva S., Lankford C., Patel N., Haddas R. Implementation and Patient Satisfaction of Telemedicine in Spine Physical Medicine and Rehabilitation Patients During the COVID-19 Shutdown. Am. J. Phys. Med. Rehabil. 2020;99:1079–1085. doi: 10.1097/PHM.0000000000001600. [DOI] [PubMed] [Google Scholar]
- 50.Zhu C., Williamson J., Lin A., Bush K., Hakim A., Upadhyaya K., Hunter K., Sensenig R., Spitz F., Atabek U., et al. Implications for Telemedicine for Surgery Patients After COVID-19: Survey of Patient and Provider Experiences. Am. Surg. 2020;86:907–915. doi: 10.1177/0003134820945196. [DOI] [PubMed] [Google Scholar]
- 51.Horgan T., Alsabbagh A., McGoldrick D., Bhatia S., Messahel A. Oral and maxillofacial surgery patient satisfaction with telephone consultations during the COVID-19 pandemic. Br. J. Oral Maxillofac. Surg. 2021;59:335–340. doi: 10.1016/j.bjoms.2020.08.099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Smrke A., Younger E., Wilson R., Husson O., Farag S., Merry E., Macklin-Doherty A., Cojocaru E., Arthur A., Benson C., et al. Telemedicine During the COVID-19 Pandemic: Impact on Care for Rare Cancers. JCO Glob. Oncol. 2020;6:1046–1051. doi: 10.1200/GO.20.00220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Campennì P., Marra A.A., Ferri L., Orefice R., Parello A., Litta F., de Simone V., Goglia M., Ratto C. Impact of COVID-19 Quarantine on Advanced Hemorrhoidal Disease and the Role of Telemedicine in Patient Management. J. Clin. Med. 2020;9:3416. doi: 10.3390/jcm9113416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Semprino M., Fasulo L., Fortini S., Molina C.I.M., González L., Ramos P.A., Martínez C., Caraballo R. Telemedicine, drug-resistant epilepsy, and ketogenic dietary therapies: A patient survey of a pediatric remote-care program during the COVID-19 pandemic. Epilepsy Behav. 2020;112:107493. doi: 10.1016/j.yebeh.2020.107493. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Kaur D., Galloway G.K., Oyibo S.O. Patient Satisfaction With the Use of Telemedicine in the Management of Hyperthyroidism. Cureus. 2020;12:e9859. doi: 10.7759/cureus.9859. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Itamura K., Tang D.M., Higgins T.S., Rimell F.L., Illing E.A., Ting J.Y., Lee M.K., Wu A. Comparison of Patient Satisfaction Between Virtual Visits During the COVID-19 Pandemic and In-person Visits Pre-pandemic. Ann. Otol. Rhinol. Laryngol. 2020 doi: 10.1177/0003489420977766. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Kodama R., Arora S., Anand S., Choudhary A., Weingarten J., Francesco N., Chiricolo G., Silber S., Mehta P.H. Reengineering the Discharge Transition Process of COVID-19 Patients Using Telemedicine, Remote Patient Monitoring, and Around-the-Clock Remote Patient Monitoring from the Emergency Department and Inpatient Units. Telemed. e-Health. 2020 doi: 10.1089/tmj.2020.0459. [DOI] [PubMed] [Google Scholar]
- 58.Liu L., Gu J., Shao F., Liang X., Yue L., Cheng Q., Zhang L., Ohannessian R., Seuren L. Application and Preliminary Outcomes of Remote Diagnosis and Treatment During the COVID-19 Outbreak: Retrospective Cohort Study. JMIR mHealth uHealth. 2020;8:e19417. doi: 10.2196/19417. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Timmers T., Janssen L., Stohr J., Murk J.L., Berrevoets M. Using eHealth to Support COVID-19 Education, Self-Assessment, and Symptom Monitoring in the Netherlands: Observational Study. JMIR mHealth uHealth. 2020;8:e19822. doi: 10.2196/19822. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Kato-Lin Y.-C., Thelen S.T. Telemedicine for Acute Conditions During COVID-19: A Nationwide Survey Using Crowdsourcing. Telemed. e-Health. 2020 doi: 10.1089/tmj.2020.0351. [DOI] [PubMed] [Google Scholar]
- 61.Fieux M., Duret S., Bawazeer N., Denoix L., Zaouche S., Tringali S. Telemedicine for ENT: Effect on quality of care during Covid-19 pandemic. Eur. Ann. Otorhinolaryngol. Head Neck Dis. 2020;137:257–261. doi: 10.1016/j.anorl.2020.06.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Hicks L.L., Boles K.E., Hudson S., Kling B., Tracy J., Mitchell J., Webb W. Patient satisfaction with teledermatology services. J. Telemed. Telecare. 2003;9:42–45. doi: 10.1258/135763303321159684. [DOI] [PubMed] [Google Scholar]
- 63.Dhahri A.A., Iqbal M.R., Pardoe H. Agile Application of Video Telemedicine During the COVID-19 Pandemic. Cureus. 2020;12:e11320. doi: 10.7759/cureus.11320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Tamayo A.L., Espinós E.L., González E.R., Guzmán C.T., Álvarez-Maestro M., Guerín C.D.C., Fernández-Pascual E., de Francisco M.G., de Vicente J.G., Rivas J.G., et al. Evaluación de la teleconsulta en el paciente urológico durante la pandemia COVID-19. Actas Urológicas Españolas. 2020;44:617–622. doi: 10.1016/j.acuro.2020.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Barca I., Novembre D., Giofrè E., Caruso D., Cordaro R., Kallaverja E., Ferragina F., Cristofaro M.G. Telemedicine in Oral and Maxillo-Facial Surgery: An Effective Alternative in Post COVID-19 Pandemic. Int. J. Environ. Res. Public Health. 2020;17:7365. doi: 10.3390/ijerph17207365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Rizzi A.M., Polachek W.S., Dulas M., Strelzow J.A., Hynes K.K. The new ‘normal’: Rapid adoption of telemedicine in orthopaedics during the COVID-19 pandemic. Injury. 2020;51:2816–2821. doi: 10.1016/j.injury.2020.09.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Casares M., Wombles C., Skinner H.J., Westerveld M., Gireesh E.D. Telehealth perceptions in patients with epilepsy and providers during the COVID-19 pandemic. Epilepsy Behav. 2020;112 doi: 10.1016/j.yebeh.2020.107394. [DOI] [PubMed] [Google Scholar]
- 68.Annis T., Pleasants S., Hultman G., Lindemann E., Thompson J.A., Billecke S., Badlani S., Melton G.B. Rapid implementation of a COVID-19 remote patient monitoring program. J. Am. Med. Inform. Assoc. 2020;27 doi: 10.1093/jamia/ocaa097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Kirby D.J., Fried J.W., Buchalter D.B., Moses M.J., Hurly E.T., Cardone D.A., Yang S.S., Virk M.S., Rokito A.S., Jazrawi L.M., et al. Patient and Physician Satisfaction with Telehealth During the COVID-19 Pandemic: Sports Medicine Perspective. Telemed. e-Health. 2021 doi: 10.1089/tmj.2020.0387. [DOI] [PubMed] [Google Scholar]
- 70.Sathiyakumar V., Apfeld J.C., Obremskey W.T., Thakore R.V., Sethi M.K. Prospective Randomized Controlled Trial Using Telemedicine for Follow-Ups in an Orthopedic Trauma Population. J. Orthop. Trauma. 2015;29:e139–e145. doi: 10.1097/BOT.0000000000000189. [DOI] [PubMed] [Google Scholar]
- 71.Do P.J.C., Jay G.M., Kalpakjian C., Andrews C., Smith S. Patient and Provider-Reported Satisfaction of Cancer Rehabilitation Telemedicine Visits During the COVID -19 Pandemic. PM&R. 2021 doi: 10.1002/pmrj.12552. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Banks J., Corrigan D., Grogan R., El-Naggar H., White M., Doran E., Synnott C., Fitzsimons M., Delanty N., Doherty C.P. LoVE in a time of CoVID: Clinician and patient experience using telemedicine for chronic epilepsy management. Epilepsy Behav. 2020;115:107675. doi: 10.1016/j.yebeh.2020.107675. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Barkai G., Gadot M., Amir H., Menashe M., Shvimer-Rothschild L., Zimlichman E. Patient and clinician experience with a rapidly implemented large-scale video consultation program during COVID-19. Int. J. Qual. Health Care. 2020;33 doi: 10.1093/intqhc/mzaa165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Gutkin P.M., Prionas N.D., Minneci M.O., Allen E., Balazy K.E., Rahimy E., Chang D.T., Horst K.C. Telemedicine in Radiation Oncology: Is It Here to Stay? Impacts on Patient Care and Resident Education. Int. J. Radiat. Oncol. 2020;108:416–420. doi: 10.1016/j.ijrobp.2020.06.047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Guinart D., Marcy P., Hauser M., Dwyer M., Kane J.M. Patient Attitudes Toward Telepsychiatry During the COVID-19 Pandemic: A Nationwide, Multisite Survey. JMIR Ment. Health. 2020;7:e24761. doi: 10.2196/24761. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Singh G., Kapoor S., Bansal V., Grewal M., Singh B., Goyal A., Tandon R., Chhabra S.T., Aslam N., Wander G.S., et al. Active surveillance with telemedicine in patients on anticoagulants during the national lockdown (COVID-19 phase) and comparison with pre-COVID-19 phase. Egypt. Hear. J. 2020;72:1–7. doi: 10.1186/s43044-020-00105-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Motolese F., Magliozzi A., Puttini F., Rossi M., Capone F., Karlinski K., Stark-Inbar A., Yekutieli Z., Di Lazzaro V., Marano M. Parkinson’s Disease Remote Patient Monitoring During the COVID-19 Lockdown. Front. Neurol. 2020;11:567413. doi: 10.3389/fneur.2020.567413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Rai J.J., Acharya R.V. Evaluation of patient and doctor perception toward the use of telemedicine in Apollo Tele Health Services, India. J. Fam. Med. Prim. Care. 2016;5:798–803. doi: 10.4103/2249-4863.201174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Li H.-L., Chan Y.C., Huang J.-X., Cheng S.W. Pilot Study Using Telemedicine Video Consultation for Vascular Patients’ Care During the COVID-19 Period. Ann. Vasc. Surg. 2020;68:76–82. doi: 10.1016/j.avsg.2020.06.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.El Ashmawy A.-A.H., Dowson K., El-Bakoury A., Hosny H.A., Yarlagadda R., Keenan J. Effectiveness, Patient Satisfaction, and Cost Reduction of Virtual Joint Replacement Clinic Follow-Up of Hip and Knee Arthroplasty. J. Arthroplast. 2021;36:816–822.e1. doi: 10.1016/j.arth.2020.08.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Isautier J.M., Copp T., Ayre J., Cvejic E., Meyerowitz-Katz G., Batcup C., Bonner C., Dodd R., Nickel B., Pickles K., et al. People’s Experiences and Satisfaction With Telehealth During the COVID-19 Pandemic in Australia: Cross-Sectional Survey Study. J. Med. Internet Res. 2020;22:e24531. doi: 10.2196/24531. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Kerr B., Pharithi R.B., Barrett M., Halley C., Gallagher J., Ledwidge M., McDonald K. Changing to remote management of a community heart failure population during COVID-19—Clinician and patient perspectives’. IJC Hear. Vasc. 2020;31:100665. doi: 10.1016/j.ijcha.2020.100665. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Shafi K., Lovecchio F., Forston K., Wyss J., Casey E., Press J., Creighton A., Sandhu H., Iyer S. The Efficacy of Telehealth for the Treatment of Spinal Disorders: Patient-Reported Experiences During the COVID-19 Pandemic. HSS J. 2020;16:17–23. doi: 10.1007/s11420-020-09808-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Sendagorta E., Servera G., Nuño A., Gil R., Pérez-España L., Herranz P. Direct-to-Patient Teledermatology During COVID-19 Lockdown in a Health District in Madrid, Spain: The EVIDE-19 Pilot Study. Actas Dermo-Sifiliográficas. 2021;112:345–353. doi: 10.1016/j.ad.2020.11.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Itamura K., Rimell F.L., Illing E.A., Higgins T.S., Ting J.Y., Lee M.K., Wu A.W. Assessment of Patient Experiences in Otolaryngology Virtual Visits During the COVID-19 Pandemic. OTO Open. 2020;4 doi: 10.1177/2473974X20933573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Taxonera C., Alba C., Olivares D., Martin M., Ventero A., Cañas M. Innovation in IBD Care During the COVID-19 Pandemic: Results of a Cross-Sectional Survey on Patient-Reported Experience Measures. Inflamm. Bowel Dis. 2020 doi: 10.1093/ibd/izaa223. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Schuster-Bruce A.T., Middleton H.A.R., Macpherson C., Pearce B.C.S., Evans A. Patient satisfaction with nurse-led end of treatment telephone consultation for breast cancer during COVID-19 pandemic. Breast J. 2021;27:77–79. doi: 10.1111/tbj.14034. [DOI] [PubMed] [Google Scholar]
- 88.Shiff B., Frankel J., Oake J., Blachman-Braun R., Patel P. Patient Satisfaction With Telemedicine Appointments in an Academic Andrology-focused Urology Practice During the COVID-19 Pandemic. Urology. 2021 doi: 10.1016/j.urology.2020.11.065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Khan Z.A., Zahoor A., Afzal I., Butt U., Siddiqui A.M., Khan Z., Shah I.A., Shah J.A. Evaluation of Patient Perception and Satisfaction Toward the Use of Telemedicine During Pandemic of Novel Coronavirus in Pakistan. Telemed. e-Health. 2021 doi: 10.1089/tmj.2020.0343. [DOI] [PubMed] [Google Scholar]
- 90.Locker D., Dunt D. Theoretical and methodological issues in sociological studies of consumer satisfaction with medical care. Soc. Sci. Med. Part. A Med. Psychol. Med. Sociol. 1978;12:283–292. doi: 10.1016/0271-7123(78)90067-6. [DOI] [PubMed] [Google Scholar]
- 91.Abramowitz S., Coté A.A., Berry E. Analyzing Patient Satisfaction: A Multianalytic Approach. QRB Qual. Rev. Bull. 1987;13:122–130. doi: 10.1016/S0097-5990(16)30118-X. [DOI] [PubMed] [Google Scholar]
- 92.Fitzpatrick R., Bowling A., Gibbons E., Haywood K., Jenkinson C., Mackintosh A., Peters M. A Structured Review of Patient-Reported Measures in Relation to Selected Chronic Conditions, Perceptions of Quality of Care and Carer Impact. National Centre for Health Outcomes Development; Oxford, UK: 2006. Chapter 11: Measuring patient perceptions of quality in health care: A structured review to inform service delivery for chronic disease. [Google Scholar]
- 93.Williams B. Patient satisfaction: A valid concept? Soc. Sci. Med. 1994;38:509–516. doi: 10.1016/0277-9536(94)90247-X. [DOI] [PubMed] [Google Scholar]
- 94.Mounessa J.S., Chapman S., Braunberger T., Qin R., Lipoff J.B., Dellavalle R.P., Dunnick C.A. A systematic review of satisfaction with teledermatology. J. Telemed. Telecare. 2018;24:263–270. doi: 10.1177/1357633X17696587. [DOI] [PubMed] [Google Scholar]
- 95.Hubley S., Lynch S.B., Schneck C., Thomas M., Shore J. Review of key telepsychiatry outcomes. World J. Psychiatry. 2016;6:269–282. doi: 10.5498/wjp.v6.i2.269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Diamantopoulos A., Riefler P., Roth K.P. Advancing formative measurement models. J. Bus. Res. 2008;61:1203–1218. doi: 10.1016/j.jbusres.2008.01.009. [DOI] [Google Scholar]
- 97.Masino C., Lam T.C. Choice of Rating Scale Labels: Implication for Minimizing Patient Satisfaction Response Ceiling Effect in Telemedicine Surveys. Telemed. e-Health. 2014;20:1150–1155. doi: 10.1089/tmj.2013.0350. [DOI] [PubMed] [Google Scholar]
- 98.Ekeland A.G., Bowes A., Flottorp S. Methodologies for assessing telemedicine: A systematic review of reviews. Int. J. Med. Inform. 2012;81:1–11. doi: 10.1016/j.ijmedinf.2011.10.009. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.