Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2022 Sep 1;19(17):10937. doi: 10.3390/ijerph191710937

Use of Telemedicine Technology among General Practitioners during COVID-19: A Modified Technology Acceptance Model Study in Poland

Renata Walczak 1, Magdalena Kludacz-Alessandri 2, Liliana Hawrysz 3,*
Editors: Jan Ehlers, Daniel Tolks
PMCID: PMC9518366  PMID: 36078650

Abstract

During the COVID-19 pandemic, telehealth became a popular solution for the remote provision of primary care by General Practitioners (GPs) in Poland. This study aimed to assess the GPs’ acceptance of telehealth during the COVID-19 pandemic in Poland and to explain the factors that drive GPs’ need to implement a telehealth system in primary care using the modified Technology Acceptance Model (TAM). In Poland, 361 GPs from a representative sample of 361 clinics drawn from 21,500 outpatient institutions in Poland participated in the empirical study. Structural equation modelling (SEM) was used to evaluate the causal relationships that were formulated in the proposed model. Research has shown that Polish GPs reported a positive perception and high acceptance of the telehealth system during the COVID-19 pandemic. Overall, the results show that the social factors (image, decision autonomy, perception of patient interaction) significantly positively influence the technological factors (perceived ease of use and perceived usefulness) that influence the need to implement a telehealth system. The proposed socio-technological model can serve as a theoretical basis for future research and offer empirical predictions for practitioners and researchers in health departments, governments, and primary care settings.

Keywords: telemedicine technology acceptance, perceived usefulness, perceived ease of use, primary healthcare

1. Introduction

During the COVID-19 pandemic, many people were afraid to go to healthcare facilities. Supporting patients in performing non-emergency procedures with the use of telemedicine has become a popular solution in such a situation. Telemedicine is a key technology that enables the provision of health services at a distance by healthcare professionals, especially GPs, who play a key role in protecting the health of their patients. Specialized personnel use communication and information technology (ICT) to exchange information in the diagnosis, treatment and prevention of diseases and injuries, for testing and assessment, and for the lifelong learning of health professionals [1,2,3,4].

Telemedicine combines convenience, low cost, and easy access to health-related information and communication using the Internet and related technologies. The use of telemedicine can help patients become more involved in their healthcare plan and increase their autonomy. Telemedicine can significantly improve patients’ health in areas with insufficient access to primary and specialist healthcare. This tool aims to improve access to care for everyone, regardless of location, and reduce face-to-face visits [5,6]. Given the important role of telemedicine in improving healthcare, especially during the COVID-19 epidemic, it may be important to investigate factors that drive the need for GPs to implement this technology. One of the key measures for successful ICT implementation and effective implementation is user acceptance of the technology.

Telemedicine is a valuable health service only if GPs use it proactively; therefore, the GPs’ approach to telemedicine technology plays a key role in its successful use. In addition, GPs act as watchdogs of the telemedicine service by deciding whether it is offered. GPs are the main users and stakeholders of telehealth services, and their acceptance in healthcare facilities profoundly impacts their success. Some GPs may perceive telemedicine technology as a threat to their knowledge and are reluctant to use it, while others may feel a strong need to implement it. When new information systems are implemented in a healthcare organization, GPs must actively participate in the reception of the telemedicine service. Therefore, in order to convince GPs to use telemedicine services, it is important to understand the variables that determine how physicians can change their perception of telemedicine services [7].

Decisions on adopting a given technology are among the most important medical and administrative decisions made in healthcare systems in general and in hospitals in particular [8]. However, the adaptation process is complex and depends on many interacting factors [9,10]. Factors identified in the literature as important for telemedicine adoption have been divided into four levels: environmental, organizational, individual, and innovative. So far, research has focused mainly on the organizational level [11]. Less attention has been paid to the individual level, although decisions about adoption in healthcare facilities are made by (groups of) people and are subject to subjective influence. GPs, in particular, strongly influence the introduction of innovation in healthcare entities as they serve as initiators, facilitators, and decision-makers [12,13,14].

Therefore, this study aimed to analyze GPs’ acceptance of the telehealth system in primary care during the COVID-19 pandemic in Poland and to examine possible factors affecting this acceptance. To investigate these factors, we developed a proprietary telemedicine service acceptance model as a modification of the technology acceptance model (TAM). The basic TAM model assumes the mediating role of technical factors (perceived ease of use and usefulness) in the relationship between the system and user characteristics (external variables) and system acceptance [15]. The model used in this study includes key factors drawn from the original TAM and previous qualitative research on satisfaction from telemedicine services. The data used to develop and validate the scale was obtained from the literature, face-to-face, and telephone interviews with GPs in the pilot study, and a research survey conducted among GPs. The target population of this study were GPs who carried out remote teleconsultations with primary care patients during the COVID-19 pandemic in Poland. In total, 361 respondents took part in the survey. The respondents came from 361 clinics drawn from 21,500 clinics in Poland, one GP from each clinic. The data processing was performed using a method based on the modelling of structural equations in the AMOS 24 application

This article is divided into six sections. Section 2 analyzes the literature on technology acceptance models in healthcare and defines the concepts discussed in the article. The proposed model with its theoretical foundations and research methodology is presented in Section 3. Section 4 presents the research results, and the discussion of these results is included in Section 5. Finally, Section 6 contains the conclusions that end the article.

2. Theoretical Basics

Broadly speaking, there are three main types of telemedicine: store-and-forward, remote patient monitoring, and real-time interactive services known as teleconsultations [16]. Store-and-forward telemedicine services are provided asynchronously so that the data exchange process can occur even when the sender and recipient are not present simultaneously [17]. One example is an X-ray of a patient sent to a healthcare professional by email. Real-time interactive services are defined as telemedicine services that require interactive interaction between healthcare professionals and patients at the same time, such as online health consultation services conducted via video [17]. Since the outbreak of the COVID-19 pandemic, also primary healthcare facilities in Poland have started to develop real-time interactive services (telehealth services) to expand the coverage of health services and prevent the spread of the COVID-19 pandemic. It is a very modern form of providing medical services that can be implemented using well-known telecommunications and ICT tools to interact with people who are geographically distant from each other.

This study used the TAM, which is one of the popular and widely used models for studying the social and technological mechanisms of ICT adoption and usage [18,19,20]. Over the past few decades, the TAM model has become the dominant model for explaining technology acceptance by assessing beliefs, attitudes, and intentions towards technology and its actual adoption. Technology acceptance in this model has been defined as the mental state of an individual with regard to his voluntary or deliberate use of a particular technology [21]. The original model treated intention as a direct determinant of behavior, while user attitudes and social norms were predictors of intention. The main goal of TAM was to anticipate the acceptance of information technology and to shed light on design problems related to new information systems prior to their adoption. Most researchers found this model very simple and easy to use, which turned out to be a very powerful model for identifying variables influencing user acceptance of computer technology [7].

From the end-user perspective, this model focuses on the factors determining the behavioral intention of using new ICT [22,23]. According to TAM, the behavioral intention (BI) of an individual to use a system is determined by two beliefs: perceived usefulness (PU) (the degree to which the user believes that using a particular system will improve his performance at work) and perceived ease of use (PEU) (the degree to which a person believes that using a particular system will the system will reduce physical or mental effort). The perceived ease of use also indirectly influences the intention to use through its direct impact on the perceived usefulness [15,21].

Research to date has shown that the main components of TAMs: PU and PEU of ICT, are considered to be the main determinants that directly or indirectly explain BI to use (“accept”) a new technology [24,25,26,27,28]. BI is the degree to which a person has formulated conscious plans to perform or not perform a particular future behavior [29].

A systematic review to examine the factors influencing ICT uptake by healthcare professionals covering all technology acceptance models in health services found that PU and PEU were the two most influential factors in these models [29,30]. PEU is defined as the degree to which a person believes that using the system is easy [15,21]. PEU is considered to be one of the most important TAM constructs that helps predict user acceptance or rejection of technology [31,32]. PU refers to “the extent to which an individual believes that applying a particular technology will improve job performance” [33]. Research on technology acceptance in various fields suggests that PU is the main factor determining the acceptance and application of new technology [34,35,36,37]. On the basis of TAM, several studies have demonstrated the explanatory power of these two factors in interpreting specific behaviors of health professionals, such as adherence to guidelines, the use of health information technology, etc. [38,39,40,41].

In order to explain the acceptance of new technology, the extended and modified models take into account various external variables. Since the introduction of TAM, the initial model has been enhanced with some external constructs to explain user acceptance of new ICT technologies such as information exchange, staff ICT experience, technical infrastructure [42,43], positive social norms, computer skills [44], social influence [45,46], and others [47,48,49,50]. Among the external factors, a special role is played by personal characteristics (e.g., self-efficacy, risk, trust and innovation, experience) [51], social capital factors (social trust, institutional trust, and social participation) [18], social impact (subjective norm, voluntariness and image), cognitive-instrumental processes (adequacy of work, quality of results and the ability to demonstrate results) [36], and organizational features [52]. The most common factors added to the original TAM in almost all technological contexts were, in order of importance and frequency of repetition, compatibility, subjective norm, self-efficacy, experience, training, anxiety, habit, and facilitators [36].

Several studies have also suggested that user attitudes may be important in the acceptance and effectiveness of using technology in practice [53,54,55]. Attitude is a predisposed state of mind regarding the system’s benefits in improving work efficiency, managing work time and its impact on improving the quality of work performed [56]. The attitude variable is usually omitted in some studies due to the argument that it should not be a strong predictor of acceptance, but rather it may be one of many factors determining acceptance [57].

The TAM model has also been tested in the healthcare context and has been proven to be a good model for the predictive BI of GPs to accept telemedicine technology [58,59,60]. The validity of TAM has been tested in various healthcare areas, such as the intention of GPs to use telemedicine technology in Hong Kong [61,62]; patient acceptance of vendor-provided telehealth [63], public health nurses ‘intentions for internet learning [64], mobile computing acceptance factors in healthcare [65], and nurses’ intention to adopt an electronic logistics information system in Taiwan [44,66].

The results of various studies show that the attitude and acceptance of healthcare providers are critical to the successful implementation of the telehealth system in healthcare systems, as they are the system’s primary users [67,68,69].

A general overview of the most widely used acceptance models in health services has shown that TAM is the most important model used to identify factors influencing the adoption of information technology in the healthcare system [70]. However, there is still insufficient information on the needs of users of these technologies in terms of adoption and use in primary care, especially during the crisis of the COVID-19 pandemic. This study, therefore, aims to fill this gap by assessing the validity of the modified TAM and identifying the impact of key technological and social factors on healthcare professionals’ needs in terms of adopting telehealth technologies in crisis conditions.

In technology acceptance research, BI is typically used as the dependent variable instead of actual usage and is considered an accurate predictor of future ICT user behavior [63]. In this study, BI has been replaced with a proprietary construct concerning the need to implement a telehealth system (NEC). Until now, researchers have focused more on the socio-economic and technical acceptance factors of telehealth, as well as the relationship between BI regarding telehealth systems and satisfaction with medical services, but did not analyze GPs’ real needs regarding telehealth use [71].

We decided that it was more reasonable to analyze their actual needs than their intentions in a crisis situation, such as the period of the COVID-19 pandemic, which forced GPs to use ICT systems. To the best of our knowledge, there has been no research to date on the need for GPs to implement a telehealth system, taking into account the impact of social and technological factors on this need. Additionally, the analytical methods used in previous studies, such as descriptive analysis, comparison of differences, and linear regression analysis, could not simultaneously determine the relationship between various factors in the mechanism and test the potential mediating effects. Therefore, this study aims to examine GPs’ needs in using the telehealth system (NEC) and its predictors at the social (image (IM), decision autonomy (AUT), perceived interaction with the patient (SIM)), and technological (PU, PEU) factors level using the basic dimensions of TAM and to investigate the entire mechanism using the structural equation model (SEM). The findings will fill the knowledge gap about the factors related to the GPs’ need to use the telehealth system.

3. Materials and Methods

Theoretical Model and Hypotheses

The model for this study is a modification of TAM from studies that analyze user acceptance of telemedicine, especially teleconsultation, in developing countries [72,73]. The theoretical model of this study was also inspired by the integration of TAM with dimensions derived from other models regarding GP satisfaction analysis.

We kept the technology factors of TAM—PU and PEU. As the research was conducted after the spread of the COVID-19 pandemic in Poland, we removed the dimension of the BI to use teleconsultation. We added the dimension of the actual needs (NEC) of GPs to implement teleconsultation.

To comprehensively investigate the mechanism shaping the GPs’ needs to implement a telehealth system, we took into account the social factors that include variables that are directly related to the GPs as the system user: IM, AUT, SIM. The developed research model consists of 5 factors regarding exogenous variables (IM, AUT, SIM, PU, PEU), two factors as endogenous variables (PU, NEC) and 26 indicators. The proposed theoretical model is presented in Figure 1.

Figure 1.

Figure 1

The theoretical model.

The model is based on previous research that suggested that user acceptance depends on two key factors: PU and PEU. In addition, TAM includes three independent variables: IM, AUT, SIM.

In this study, we hypothesized that the constructs and associations described in the modified TAM are appropriate for measuring the NEC by GPs in crisis conditions. In the model shown in Figure 1, the attitude variable that mediates some of the effects of PU and PEU has been removed.

PU and PEU in the initial TAM were the most dominant determinants of the use of technology [21] and the acceptance of telemedicine services [50,74]. PU was originally defined as the degree to which an individual believed using the system would improve their performance. In this study, the definition of PU was adapted to the specificity of healthcare, where professional utility and performance have a slightly different meaning than those in the original TAM. We assume that GPs believe telehealth is useful when it improves patient care, leads to faster healthcare delivery, better documentation, shorter delivery times, and allows for accurate, low-cost medical monitoring [75,76]. Generally, a PEU is defined as the degree to which a person believes that using a particular system will be effortless [21]. In this study, PEU is to determine whether the telehealth service is easy to learn and use by GPs [77,78].

The variables for examining the NEC were developed on the basis of previous studies on medical staff satisfaction with telephone-based telemedicine during COVID-19 pandemic [79]. The NEC dimension used in this study also served to see if telemedicine is needed in emergencies such as COVID-19 and regardless of emergencies such as COVID-19 and whether telemedicine can replace partially in-person visits.

Both PU and PEU were conceived as key factors in the acceptance of the new technology [75,76,80,81]. Earlier studies in other areas have emphasized the influence of PU and PEU on BI to use [49,50,63,74,82]. In this study, we intend to see if GPs will feel a greater need for a telemedicine service when they find it easy to use, effective, and that it delivers good healthcare outcomes. Therefore, hypotheses 1a, 1b, and 1c were proposed:

Hypothesis 1a (H1a).

The need for GPs to implement a telehealth system is influenced by the PU of the system.

Hypothesis 1b (H1b).

The need for GPs to implement a telehealth system depends on the PEU of the system.

Hypothesis 1c (H1c).

The PU mediates the positive relationship between PEU andNEC.

Moreover, previous studies have shown that PEU directly influences PU [50,74,83,84]. In other words, the greater ease of use of telehealth suggests that it is more useful for users. In this context, we can conclude that if the GP experienced increased PEU, the technology would probably have been better viewed in terms of its usefulness. Therefore, we proposed that greater PEU inevitably leads to greater PU of telemedicine services.

Hypothesis 2 (H2).

The PEU will have a positive effect on the PU.

On our scale, we relied on the literature concerning not only the acceptance but also the motivation of GPs, and we also took into account the orientation of GPs towards patients. In healthcare, GPs take care of the decisions about adopting technologies to treat patients. Therefore, it is necessary to incorporate additional factors that can capture GPs’ motivation to improve patient benefits through the use of medical technologies [85,86]. In this study, we considered external social factors such as IM, AUT, and SIM.

The impact of IM and AUT (defined as “voluntariness”) on the acceptance of the telehealth system has already been carried out in Australian long-term care facilities. These studies assumed that these factors could also be important determinants of PU and PEU of a health information system [44]. In other research on GPs’ AUT and GPs-patient interaction, these factors were included in the organizational contextual factors. These factors were also identified on the basis of a literature review and previous empirical research [47,87,88,89].

The IM variable has already appeared in the modified version of TAM2 [49] among the “external variables” included in the social impact (subjective norm, voluntary, and image). The literature defines the IM as the degree to which a person perceives that applying innovation improves their status in their social system [85]. IM can positively affect PU and the NEC by increasing the strength and influence of elevated status, as individuals often respond to social normative influences to establish or maintain a favorable image in the reference group [49].

The AUT and the SIM are included in TAM extensions, which introduce a wide range of external factors [89,90]. Furthermore, the AUT affects the differences between GPs and other user groups in terms of adopting new information technologies. For this reason, GPs are very sensitive to upcoming work environment changes [90]. AUT has been included as an external voluntary variable and defined as “the extent to which potential adopters perceive the decision to adopt a system as optional” [91].

SIM serves as a means of educating patients about their healthcare, including health status assessment and disease diagnosis. Elements of effective SIM interaction during teleconsultation include setting the appropriate tone, accurate interpretation of communication signals, and active listening. Effective SIM is essential to ensure high-quality patient care [92]. This study’s perception of SIM concerns the possibility of understanding the patient, the quality of communication with him, and the possibility of providing reliable advice using the telehealth system. It has already been found in the studies that the relational effect, which relates to the GPs’ perception of interaction with the patient, is a key factor that may shape the NEC and influence its implementation [93]. Several studies have also shown that SIM is associated with intentions to use health-related information technology [94]. On the basis of previous research, we suspect that the perception of interactions with the patient directly impacts the acceptance of medical technology by GP.

The corresponding hypotheses (H) are as follows:

Hypothesis 3a (H3a).

The need for GPs to implement a telehealth system is influenced by the IM.

Hypothesis 3b (H3b).

The need for GPs to implement a telehealth system is influenced by their AUT.

Hypothesis 3c (H3c).

The need for GPs to implement a telehealth system is influenced by SIM.

Items measuring PU and PEU were taken from previously validated questionnaires and modified to fit telehealth in primary healthcare in Poland. Some statements have been developed specifically for this study. The respondents agreed or disagreed with the statements using a five-point Likert-type scale. Selected users and experts conducted preliminary and pilot studies, after which the statements were modified to be appropriate to the context of using telehealth in primary care in Poland. Table 1 lists the statements used in the questionnaire. Table 2 shows the descriptive statistics of variable used in the model.

Table 1.

Statements used in the questionnaire *.

Latent Factor Variable Name Statement in the Questionnaire Literature Source
Perceived
Usefulness
PU1_q3s1 My work during a pandemic would be difficult without teleconsultations Martínez et al., 2006 [80]
Rimmer et al., 2020 [95]
Bakken et al, 2006 [96]
Rho et al., 2014 [7]
Davis, 1989 [21]
PU2_q3s2 Teleconsultations meet my needs at work
PU3_q3s3 Teleconsultations increase the efficiency of my work
PU4_q3s4 In general I find the teleconsultations a useful system in my work
PU5_q3s5 teleconsultations save my time
PU6_q4s1 Teleconsultations makes my work easier
Perceived Ease of Use PEU1_q4s2 Using a teleconsultations system is easy Whitten et al., 2005 [97]
Martínez et al., 2006 [80]
Rimmer et al., 2020 [95]
Bakken et al, 2006 [96]
Zaidi et al., 2008 [77]
Taylor, 2005 [78]
Rho et al., 2014 [7]
Davis, 1989 [21]
PEU2_q4s3 Using a teleconsultations system does not require too much intellectual effort
PEU3_q4s4 Using the teleconsultations system is understandable for me
PEU4_q4s5 Using the teleconsultations system I can do everything I want
Image IM1_q7s1 People who use teleconsultations are more prestigious than those who do not use it Holden, Karsh, 2010 [98]
Chau, Hu, 2002 [60]
Chismar, Wiley-Patton, 2002 [58]
IM2_q7s2 People who use teleconsultations get noticed
IM3_q7s3 Using teleconsultations is a status symbol
IM4_q7s4 I compare myself with people who use teleconsultations
Needs to implement the telehealth system NEC1_q7s5 Teleconsultations is an acceptable method of delivering health services Rho et. al., 2014 [7]
Holden, Karsh, 2010 [98]
Adewale, 2015 [99]
NEC2_q8s1 Teleconsultations are needed in new situations, such as the COVID-19 pandemic
NEC3_q8s2 Teleconsultations are needed regardless of emerging situations, such as COVID-19
NEC4_q8s3 Teleconsultations can partially replace in-person patient visits
NEC5_q8s4 By being able to use teleconsultations, patients have easier access to healthcare
Decision
autonomy
AUT2_q13s1 I can influence the number of teleconsultations I take per day Holden, Karsh, 2010 [98]
Yi et.al., 2006 [100]
Chau, Hu, 2002 [60]
AUT3_q13s2 I can decide in which situation to use the teleconsultation
AUT4_q13s3 I can decide how the teleconsultations will be done
Perception of Interaction
with the Patient
SIM1_q11s1 When talking to the patient, I understand what the patient’s problem is Rho et al., 2014 [7]
Holden, Karsh, 2010 [98]
SIM2_q11s2 In conversation with the patient I can easily give advice
SIM3_q11s3 I can easily talk to the patient during the teleconsultation
SIM4_q11s4 I can understand the patient’s problem

* Source: Authors’ own research.

Table 2.

Descriptive statistics of variable used in the model *.

Variable Name Mean Std. Deviation Variance Skewness Kurtosis
PU1_q3s1 4.36 0.935 0.875 −1.731 2.773
PU2_q3s2 4.04 1.031 1.062 −1.247 1.071
PU3_q3s3 3.85 1.176 1.383 −0.912 −0.136
PU4_q3s4 4.24 0.867 0.752 −1.342 1.933
PU5_q3s5 3.89 1.138 1.295 −0.810 −0.378
PU6_q4s1 4.03 1.006 1.013 −1.163 0.990
IM1_q7s1 2.70 1.318 1.738 0.221 −1.077
IM2_q7s2 3.09 1.243 1.544 −0.148 −0.945
IM3_q7s3 2.64 1.331 1.771 0.304 −1.062
IM4_q7s4 2.57 1.367 1.868 0.310 −1.184
SIM1_q11s1 3.98 0.925 0.855 −1.143 1.017
SIM2_q11s2 3.91 1.011 1.022 −0.983 0.293
SIM3_q11s3 3.81 1.050 1.103 −0.731 −0.434
SIM4_q11s4 3.93 0.992 0.984 −0.954 0.223
PEU1_q4s2 4.28 0.834 0.695 −1.338 1.885
PEU2_q4s3 3.81 1.420 2.016 −0.988 −0.467
PEU3_q4s4 4.51 0.671 0.451 −1.819 5.271
PEU4_q4s5 4.06 1.039 1.080 −1.273 1.138
AUT2_q13s1 4.05 1.009 1.017 −1.189 0.907
AUT3_q13s2 4.29 0.818 0.669 −1.660 3.857
AUT4_q13s3 4.35 0.756 0.572 −1.646 4.272
NEC1_q7s5 4.05 0.866 0.750 −1.134 1.725
NEC2_q8s1 4.59 0.631 0.399 −1.864 5.056
NEC3_q8s2 4.30 0.853 0.727 −1.751 3.985
NEC4_q8s3 4.11 0.925 0.857 −1.454 2.321
NEC5_q8s4 4.11 0.872 0.760 −1.279 2.063

* Source: Authors’ own research.

The survey was carried out by an external company at the request of the Warsaw University of Technology. The survey was positively evaluated by the Professional Ethics Committee of the Warsaw University of Technology.

The data collected were complete, with no missing responses. GPs of primary healthcare institutions filled in a total of 361 questionnaires. A Likert scale was used to evaluate the statements: 1—do not agree, 2—I do not agree some-what, 3—Neither agree nor disagree, 4—I agree somewhat, 5—I agree.

4. Results

4.1. Exploratory Factor Analysis

A factor analysis was conducted using Principal Component Analysis to identify latent variables. Varimax rotation was used. The variables presented in Table 1 were used for the analysis. The model turned out to be adequate since all variables are sufficiently correlated and form a reliable solution. The adequacy was confirmed by two tests: (1) the Kaiser–Meyer–Olkin test (KMO coefficient) (KMO = 0.90 > 0.8) and the Bartlett’s significant sphericity test (χ2 = 5588.27, df = 325, p < 0.0001 < 0.05) and (2) extracted communalities. The principal components method and Varimax rotation were used to identify significant factors. Extracted communalities, ideally, should be greater than 0.5. However, the 0.3 threshold is accepted. All variables in the model extracted communalities greater than 0.3 (Table 3). The factor analysis solutions error was small, the number of non-redundant residuals equaled 1.191 × 10−7 < 0.05. This allowed all variables to be taken into account in EFA analysis [101].

Table 3.

Extracted communalities during Exploratory Factor Analysis *.

Variable Initial Extraction
PU1_q3s1 1.000 0.546
PU2_q3s2 1.000 0.721
PU3_q3s3 1.000 0.809
PU4_q3s4 1.000 0.789
PU5_q3s5 1.000 0.707
PU6_q4s1 1.000 0.638
PEU1_q4s2 1.000 0.702
PEU2_q4s3 1.000 0.604
PEU3_q4s4 1.000 0.440
PEU4_q4s5 1.000 0.664
NEC1_q7s5 1.000 0.469
NEC2_q8s1 1.000 0.643
NEC3_q8s2 1.000 0.647
NEC4_q8s3 1.000 0.674
NEC5_q8s4 1.000 0.644
IM1_q7s1 1.000 0.835
IM2_q7s2 1.000 0.671
IM3_q7s3 1.000 0.838
IM4_q7s4 1.000 0.817
AUT2_q13s1 1.000 0.755
AUT3_q13s2 1.000 0.810
AUT4_q13s3 1.000 0.760
SIM1_q11s1 1.000 0.774
SIM2_q11s2 1.000 0.757
SIM3_q11s3 1.000 0.728
SIM4_q11s4 1.000 0.755

* Extraction Method: Principal Component Analysis. Source: Authors’ own research.

The model explains almost 70% of variance (Table 4). The results of the exploratory factor analysis are presented in Table 5, where only correlation coefficients greater than 0.5 were included. Six latent variables were expected to be extracted, and six factors were extracted based on eigenvalues greater than 1.

Table 4.

Total variance explained by six factor extracted during Exploratory Factor Analysis *.

Component Initial Eigenvalues Extraction Sums
of Squared Loadings
Rotation Sums
of Squared Loadings
Total % of
Variance
%
Cumulative
Total % of
Variance
%
Cumulative
Total % of
Variance
%
Cumulative
1 8.887 34.181 34.181 8.887 34.181 34.181 3.707 14.257 14.257
2 2.506 9.639 43.820 2.506 9.639 43.820 3.451 13.272 27.529
3 2.224 8.555 52.374 2.224 8.555 52.374 3.297 12.681 40.210
4 1.871 7.196 59.570 1.871 7.196 59.570 3.099 11.917 52.127
5 1.583 6.088 65.658 1.583 6.088 65.658 2.323 8.933 61.060
6 1.125 4.327 69.985 1.125 4.327 69.985 2.320 8.925 69.985
7 0.804 3.092 73.078

* Extraction Method: Principal Component Analysis. Source: Authors’ own research.

Table 5.

Rotated Component Matrix *.

Variable Component
1. PU 2. SIM 3. IM 4. NEC 5. AUT 6. PEU
Cronbach’s Alpha 0.894 0.902 0.908 0.815 0.83 0.676
PU1_q3s1 0.623
PU2_q3s2 0.720
PU3_q3s3 0.811
PU4_q3s4 0.733
PU5_q3s5 0.752
PU6_q4s1 0.628
PEU1_q4s2 0.807
PEU2_q4s3 0.670
PEU3_q4s4 0.592
PEU4_q4s5 0.696
NEC1_q7s5 0.545
NEC2_q8s1 0.760
NEC3_q8s2 0.727
NEC4_q8s3 0.765
NEC5_q8s4 0.659
IM1_q7s1 0.874
IM2_q7s2 0.757
IM3_q7s3 0.897
IM4_q7s4 0.879
AUT2_q13s1 0.811
AUT3_q13s2 0.848
AUT4_q13s3 0.781
SIM1_q11s1 0.827
SIM2_q11s2 0.800
SIM3_q11s3 0.775
SIM4_q11s4 0.822

* Extraction Method: Principal Component Analysis, Rotation Method: Varimax with Kaiser Normalization, Rotation converged in 6 iterations. Source: Authors’ own research.

Convergent validity of the model was confirmed. All variables loadings were greater than 0.5, and the average loading per latent factor was greater than 0.7 (Table 5), that means that each latent factor variable were highly correlated. None of initial variables were removed. Additionally, discriminant validity was confirmed. All latent factors are unique, discriminant from each other. Variables load clearly on latent factors. There were no cross-loadings. The reliability of the model was also confirmed. Cronbach’s Alpha coefficient for each latent factor was greater than 0.6, which is permissible [102]

4.2. Confirmatory Factor Analysis

On the basis of the EFA model the Confirmatory Factor Analysis model was prepared (Figure 2). χ2cmin=739.104; DF=284; p-value < 0.0001; cminDF=2.602<3; The model fit values: CFI=0.916>0.9; RMSEA=0.067<0.1; SRMR=0.05980.8 0.9 allowed it to be accepted for further analysis. The strengths of the variables’ correlations described the Average Variance Extracted (AVE) coefficient and composite reliability coefficient (CR). On the basis of those coefficients, the convergent validity of the model could be confirmed. AVE values should be greater than 0.5, CR values should be greater than 0.7. For NEC and PEU variables convergent validity was confirmed only on the basis of the CR coefficient (Table 6). On the basis of the CR factor, reliability was also confirmed [103]. Discriminant validity was confirmed on the basis of the hetero-trait–mono-trait coefficients (HTMT) (Table 7). Coefficient values should be smaller than 0.9 [103]. On this basis, it was possible to create a structural model.

Figure 2.

Figure 2

Confirmatory Factor Analysis model. Source: Authors’ own research.

Table 6.

Convergent validity measures *.

Variable CR AVE MSV AVE PU SIM IM NEC AUT PEU
Correlations
PU 0.899 0.602 0.575 0.776 1
SIM 0.904 0.701 0.277 0.837 0.526 1
IM 0.909 0.717 0.180 0.847 0.424 0.304 1
NEC 0.823 0.484 0.575 0.696 0.758 0.454 0.363 1
AUT 0.847 0.650 0.209 0.806 0.436 0.457 0.206 0.417 1
PEU 0.719 0.407 0.233 0.638 0.483 0.479 0.280 0.347 0.411 1

* p-value < 0.0001. Source: Authors’ own research.

Table 7.

HTMT analysis *.

PU SIM IM NEC AUT PEU
PU
SIM 0.551
IM 0.444 0.335
NEC 0.762 0.468 0.383
AUT 0.450 0.455 0.241 0.448
PEU 0.466 0.419 0.290 0.323 0.440

* p-value < 0.0001. Source: Authors’ own research.

4.3. Structural Model

Figure 3 shows a structural model of acceptance of remote medical advice technology. Hypothesis H3a regarding the influence of image on the need for remote advice was not confirmed. This means that GPs did not take up remote work because of their image in society and their reputation among other GPs. Image assessment was not important in the decision to provide remote consultations.

Figure 3.

Figure 3

Structural model of the acceptance of remote medical advice technology. Source: Authors’ own research.

Hypothesis H3c on the effect of the perception of interaction with the patient on the need for teleconsultations was also not confirmed. GPs rated the similarity of the provision of remote consultations to in-patient consultations at a level of 4 on a scale of 1 to 4. It is important to recognise that the ratings for patient contact, both remote and face-to-face, are similar. The variable SIM had no impact on GPs’ evaluation of remote working.

The effect of the decision-making autonomy on the need to give teleconsultations (hypothesis H3b) was small. The AUT variable concerned the voluntariness of remote advice. GPs ranked highly the autonomy to decide whether to provide remote advice. Each variable scored above 4 on a scale of 1 to 5. This means that GPs were not forced by their employer to work remotely. The AUT variable had little impact on GPs’ evaluation of remote consultations (NEC).

The hypothesis H1c regarding an indirect effect of the ease of use of the system on the perceived usefulness on the need for teleconsulting was confirmed. The effect of the ease of use of the system on the need to give teleconsultations (hypothesis H1b) was small and negative. This means that even a system that was difficult to use, this did not cause reluctance to give teleconsultations. The largest regression coefficients in the model were the effect of the ease of use of the system on the perceived usefulness of the system (hypothesis H2) and the perceived usefulness on the need to use the system (hypothesis H1a). The regression coefficients of the structural model and the probability value for the coefficients are summarised in Table 8.

Table 8.

Standardized regression weights for the structural model.

Hypothesis Variables Relation Variables Standardized Path Estimate p-Value Confirmation
of the Hypotheses
H2 PU PEU 0.543 <0.0001 Supported
H3a NEC IM 0.036 0.268 Not supported
H3b NEC AUT 0.111 0.002 Supported
H1a NEC PU 0.791 <0.0001 Supported
H1b NEC PEU −0.108 0.004 Supported
H3c NEC SIM 0.049 0.205 Not supported
H1c PEU → PU → NEC 0.464 0.001 Supported

The data collected in the survey were analyzed using exploratory factor analysis (EFA), which opted for a six-factor solution to describe the GPs’ need to implement the system adequately. Then, a confirmatory factor analysis (CFA) was performed, which confirmed the EFA results. Our tests have shown good reliability and validity of the measuring scale.

5. Discussion

We attempted to identify predictive constructs influencing the decision of GPs to adopt telemedicine services. The analysis of these constructs from the individual level is important because of GPs’ strong influence on the introduction of innovation in healthcare entities. GPs serve as initiators, facilitators, and decision-makers in those entities. For this purpose, we developed the socio-technological model by modifying the original TAM. We also tested the applicability of the socio-technological model in Poland. In technology acceptance models, behavioral intentions were usually used as the dependent variable considered an accurate predictor of future ICT user behavior [63]. In this study, behavioral intentions were replaced with a proprietary construct concerning the need to implement a telehealth system. We decided that it was more reasonable to analyze GPs’ actual need to implement a telehealth system than their intentions in a crisis situation. During the COVID-19 pandemic, many people were afraid to go to healthcare facilities. The COVID-19 pandemic showed that telehealth is needed in new, emerging and crisis situations and can partially replace in-person patient visits. By being able to use telehealth, patients have easier access to healthcare. Sometimes it is the only way of access to healthcare.

To the best of our knowledge, there has been no research to date on the need for GPs to implement a telehealth system, taking into account the impact of social and technological factors on this need. This study, therefore, fills this gap by assessing the validity of the modified TAM and identifying the impact of key technological and social factors on GPs’ needs in terms of adopting telehealth technologies in crisis conditions. Our results show that perceived usefulness and perceived ease of use significantly impacted the need to implement a telehealth system. Research examining the factors influencing ICT uptake by GPs covering all technology acceptance models in health services found that perceived usefulness and perceived ease of use were the two most influential factors in these models [29,30]. Several studies have demonstrated the explanatory power of perceived usefulness and perceived ease of use in interpreting the specific behaviors of GPs, such as adherence to guidelines, the use of health information technology, etc. [38,39,40,41]. The results of the analysis of the use of telehealth services showed that the main factors influencing the use of telemedicine services, in addition to perceived usefulness and ease of use, were the following variables: social impact, favorable conditions, and trust [73]. Our results showed that the GPs’ image assessment in society was not important in the decision to provide remote consultations. GPs ranked highly the autonomy to decide whether to provide remote advice. Our results show that decision autonomy impacted the need to implement a telehealth system. Previous studies have shown that perceived ease of use directly influences perceived usefulness [50,74,83,84]. This means that the greater perceived ease of use of telehealth suggests that it is more useful for users. GPs who experienced increased perceived ease of use technology would probably better view its usefulness.

Our results show that perceived usefulness mediated the positive relationship between perceived ease of use and the need for GPs to implement a telehealth system.

5.1. Contribution

This is the first reliable and accurate scale to measure the physicians’ need to implement a telehealth system in an emergency. As far as we know, our model is the first that has been specifically designed to explain the influence of individual factors at the GP level on the acceptance of a technology system in a healthcare context.

5.2. Limitations

However, these studies did not review psychological parameters, such as habits or cultural factors of patients and GPs that could explain the adoption of telemedicine services in developing countries.

6. Conclusions

Despite the spread of telemedicine technologies, the acceptance of telehealth services in real healthcare conditions is slow. In this research, we developed a theoretical socio-technological model explaining the predictive factors influencing the need of GPs to use telehealth technologies in the provision of health services. The model is based on the modified technology acceptance model (TAM), taking into account the predictive technological constructs from previously published telemedicine literature (perceived usefulness and perceived ease of use) and three external social factors (1) decision-making autonomy, (2) image, (3) perceived perception of interaction with the patient.

The study showed that the acceptance model of telehealth services is feasible and can explain GPs’ acceptance of telemedicine services. These results allow us to identify important factors increasing the involvement of GPs in telehealth practice.

Our results confirm the validity of the original TAM constructs. The results show that perceived ease of use and perceived usefulness significantly impact the need to implement a telehealth system. The results also show that decision autonomy impact the need to implement a telehealth system. Moreover, the perceived usefulness of the telehealth system depends on the perceived ease of use and impact on the need to implement a telehealth system.

The proposed model can serve as a basis for future research and offer empirical predictions for practitioners and researchers in health departments, governments, and primary care settings.

This research can help primary healthcare facilities and the government in Poland to provide guidance in developing telemedicine applications. The results can be used as a benchmark for primary healthcare management to analyze the advantages and disadvantages of their telehealth services compared to similar services.

Identifying the most important factors influencing the acceptance of telemedicine from the perspective of GPs, as key players in telehealth projects, can help managers and decision-makers make the right decisions about the successful implementation of telehealth services, especially in the initial stages. Planners and managers should ensure that the telehealth system deployed in the primary care facility is useful and easy to use. GP support by extending their decision-making autonomy can be important to success. Our findings may be also useful in other emergencies or strengthen routine healthcare. Telemedicine may be particularly supportive in cases of routine health issues and when there has been an already established relationship with a GP. The potential of telemedicine can be used wherever it is possible to improve medical processes, the quality of services, and patient safety or achieve a sustainable economy. Future research may also evaluate the aggregation of the factors identified in this article.

Author Contributions

Conceptualization, R.W., M.K.-A. and L.H.; methodology, R.W., M.K.-A. and L.H.; software, R.W.; validation, R.W.; formal analysis, R.W.; investigation, R.W., M.K.-A. and L.H.; resources, R.W., M.K.-A. and L.H.; data curation, R.W., M.K.-A. and L.H.; writing—original draft preparation, R.W., M.K.-A. and L.H.; writing—review and editing, R.W., M.K.-A. and L.H.; visualization, R.W.; supervision, M.K.-A.; project administration, M.K.-A.; funding acquisition, M.K.-A. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This research was funded by IDUB against the COVID-19 project granted by Warsaw University of Technology under the program Excellence Initiative: Research University (IDUB) No. 504/04496/7200/45.01001.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Garavand A., Aslani N., Nadri H., Abedini S., Dehghan S. Acceptance of telemedicine technology among physicians: A systematic review. Inform. Med. Unlocked. 2022;30:100943. doi: 10.1016/j.imu.2022.100943. [DOI] [Google Scholar]
  • 2.Hyder M.A., Razzak J. Telemedicine in the United States: An Introduction for Students and Residents. J. Med. Internet Res. 2020;22:e20839. doi: 10.2196/20839. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Manyazewal T., Woldeamanuel Y., Blumberg H.M., Fekadu A., Marconi V.C. The potential use of digital health technologies in the African context: A systematic review of evidence from Ethiopia. NPJ Digit. Med. 2021;4:125. doi: 10.1038/s41746-021-00487-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Ryu S. Telemedicine: Opportunities and Developments in Member States: Report on the Second Global Survey on eHealth 2009 (Global Observatory for eHealth Series, Volume 2) Healthc. Inform. Res. 2012;18:153. doi: 10.4258/hir.2012.18.2.153. [DOI] [Google Scholar]
  • 5.Andrews V. Using telemedicine in clinical decision-making. Pract. Nurs. 2014;25:42–46. doi: 10.12968/pnur.2014.25.1.42. [DOI] [Google Scholar]
  • 6.Monaghesh E., Hajizadeh A. The role of telehealth during COVID-19 outbreak: A systematic review based on current evidence. BMC Public Health. 2020;20:1193. doi: 10.1186/s12889-020-09301-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Rho M.J., Choi I.Y., Lee J. Predictive factors of telemedicine service acceptance and behavioral intention of physicians. Int. J. Med. Inform. 2014;83:559–571. doi: 10.1016/j.ijmedinf.2014.05.005. [DOI] [PubMed] [Google Scholar]
  • 8.Greenberg D., Peterburg Y., Vekstein D., Pliskin J.S. Decisions to adopt new technologies at the hospital level: Insights from Israeli medical centers. Int. J. Technol. Assess. Health Care. 2005;21:219–227. doi: 10.1017/S0266462305050294. [DOI] [PubMed] [Google Scholar]
  • 9.Greenhalgh T., Robert G., Macfarlane F., Bate P., Kyriakidou O. Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations. Milbank Q. 2004;82:581–629. doi: 10.1111/j.0887-378X.2004.00325.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Robert G., Greenhalgh T., MacFarlane F., Peacock R. Adopting and assimilating new non-pharmaceutical technologies into health care: A systematic review. J. Health Serv. Res. Policy. 2010;15:243–250. doi: 10.1258/jhsrp.2010.009137. [DOI] [PubMed] [Google Scholar]
  • 11.Reyes P.M., Li S., Visich J.K. Accessing antecedents and outcomes of RFID implementation in health care. Int. J. Prod. Econ. 2012;136:137–150. doi: 10.1016/j.ijpe.2011.09.024. [DOI] [Google Scholar]
  • 12.Wernz C., Zhang H., Phusavat K. International study of technology investment decisions at hospitals. Ind. Manag. Data Syst. 2014;114:568–582. doi: 10.1108/IMDS-10-2013-0422. [DOI] [Google Scholar]
  • 13.Gold H.T., Pitrelli K., Hayes M.K., Murphy M.M. Decision to adopt medical technology: Case study of breast cancer radiotherapy techniques. Med. Decis. Mak. 2014;34:1006–1015. doi: 10.1177/0272989X14541679. [DOI] [PubMed] [Google Scholar]
  • 14.Barasa E.W., Molyneux S., English M., Cleary S. Setting healthcare priorities in hospitals: A review of empirical studies. Health Policy Plan. 2015;30:386–396. doi: 10.1093/heapol/czu010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Davis F.D., Bagozzi R.P., Warshaw P.R. User Acceptance of Computer Technology: A Comparison of Two Theoretical Models. Manage. Sci. 1989;35:982–1003. doi: 10.1287/mnsc.35.8.982. [DOI] [Google Scholar]
  • 16.Nakajima I., Sawada Y., Maeda T., Martin D.L., Nagano S., Hamano N. Telemedicine Using Small Satellite MEO/HICAT for International Medical Communications. COSPAR Colloq. Ser. 1999;10:258–267. doi: 10.1016/S0964-2749(99)80033-X. [DOI] [Google Scholar]
  • 17.Aziz S.R., Ziccardi V.B. Telemedicine Using Smartphones for Oral and Maxillofacial Surgery Consultation, Communication, and Treatment Planning. J. Oral Maxillofac. Surg. 2009;67:2505–2509. doi: 10.1016/j.joms.2009.03.015. [DOI] [PubMed] [Google Scholar]
  • 18.Tsai C.H. Integrating Social Capital Theory, Social Cognitive Theory, and the Technology Acceptance Model to Explore a Behavioral Model of Telehealth Systems. Int. J. Environ. Res. Public Health. 2014;11:4905–4925. doi: 10.3390/ijerph110504905. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Taherdoost H. A review of technology acceptance and adoption models and theories. Procedia Manuf. 2018;22:960–967. doi: 10.1016/j.promfg.2018.03.137. [DOI] [Google Scholar]
  • 20.Lai P. The Literature Review of Technology Adoption Models and Theories for the Novelty Technology. J. Inf. Syst. Technol. Manag. 2017;14:21–38. doi: 10.4301/S1807-17752017000100002. [DOI] [Google Scholar]
  • 21.Davis F.D. Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 1989;13:319–340. doi: 10.2307/249008. [DOI] [Google Scholar]
  • 22.Tarhini A., Hone K., Liu X. The effects of individual differences on e-learning users’ behaviour in developing countries: A structural equation model. Comput. Human Behav. 2014;41:153–163. doi: 10.1016/j.chb.2014.09.020. [DOI] [Google Scholar]
  • 23.Becker D. Acceptance of Mobile Mental Health Treatment Applications. Procedia Comput. Sci. 2016;98:220–227. doi: 10.1016/j.procs.2016.09.036. [DOI] [Google Scholar]
  • 24.Scherer R., Siddiq F., Tondeur J. The technology acceptance model (TAM): A meta-analytic structural equation modeling approach to explaining teachers’ adoption of digital technology in education. Comput. Educ. 2019;128:13–35. doi: 10.1016/j.compedu.2018.09.009. [DOI] [Google Scholar]
  • 25.Faber S., van Geenhuizen M., de Reuver M. eHealth adoption factors in medical hospitals: A focus on the Netherlands. Int. J. Med. Inform. 2017;100:77–89. doi: 10.1016/j.ijmedinf.2017.01.009. [DOI] [PubMed] [Google Scholar]
  • 26.Melas C.D., Zampetakis L.A., Dimopoulou A., Moustakis V. Modeling the acceptance of clinical information systems among hospital medical staff: An extended TAM model. J. Biomed. Inform. 2011;44:553–564. doi: 10.1016/j.jbi.2011.01.009. [DOI] [PubMed] [Google Scholar]
  • 27.Khan I., Xitong G., Ahmad Z., Shahzad F. Investigating Factors Impelling the Adoption of e-Health: A Perspective of African Expats in China. SAGE Open. 2019;9:2158244019865803. doi: 10.1177/2158244019865803. [DOI] [Google Scholar]
  • 28.Briz-Ponce L., García-Peñalvo F.J. An Empirical Assessment of a Technology Acceptance Model for Apps in Medical Education. J. Med. Syst. 2015;39:176. doi: 10.1007/s10916-015-0352-x. [DOI] [PubMed] [Google Scholar]
  • 29.Ahlan A., Ahmad B. An overview of patient acceptance of Health Information Technology in developing countries: A review and conceptual model. Int. J. Inf. Syst. Proj. Manag. 2015;3:29–48. doi: 10.12821/ijispm030102. [DOI] [Google Scholar]
  • 30.Gagnon M.P., Desmartis M., Labrecque M., Car J., Pagliari C., Pluye P., Frémont P., Gagnon J., Tremblay N., Légaré F. Systematic review of factors influencing the adoption of information and communication technologies by healthcare professionals. J. Med. Syst. 2012;36:241–277. doi: 10.1007/s10916-010-9473-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Schnall R., Higgins T., Brown W., Carballo-Dieguez A., Bakken S. Trust, Perceived Risk, Perceived Ease of Use and Perceived Usefulness as Factors Related to mHealth Technology Use. Stud. Health Technol. Inform. 2015;216:467. doi: 10.3233/978-1-61499-564-7-467. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Sánchez R.A., Hueros A.D. Motivational factors that influence the acceptance of Moodle using TAM. Comput. Human Behav. 2010;26:1632–1640. doi: 10.1016/j.chb.2010.06.011. [DOI] [Google Scholar]
  • 33.Marangunić N., Granić A. Technology acceptance model: A literature review from 1986 to 2013. Univers. Access Inf. Soc. 2014;14:81–95. doi: 10.1007/s10209-014-0348-1. [DOI] [Google Scholar]
  • 34.Ching-Ter C., Hajiyev J., Su C.R. Examining the students’ behavioral intention to use e-learning in Azerbaijan? The General Extended Technology Acceptance Model for E-learning approach. Comput. Educ. 2017;111:128–143. doi: 10.1016/j.compedu.2017.04.010. [DOI] [Google Scholar]
  • 35.Khatun F., Heywood A.E., Ray P.K., Hanifi S.M.A., Bhuiya A., Liaw S.T. Determinants of readiness to adopt mHealth in a rural community of Bangladesh. Int. J. Med. Inform. 2015;84:847–856. doi: 10.1016/j.ijmedinf.2015.06.008. [DOI] [PubMed] [Google Scholar]
  • 36.Rahimi B., Nadri H., Afshar H.L., Timpka T. A systematic review of the technology acceptance model in health informatics. Appl. Clin. Inform. 2018;9:604–634. doi: 10.1055/s-0038-1668091. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Mortenson M.J., Vidgen R. A computational literature review of the technology acceptance model. Int. J. Inf. Manag. 2016;36:1248–1259. doi: 10.1016/j.ijinfomgt.2016.07.007. [DOI] [Google Scholar]
  • 38.Seehusen D.A., Deavers J., Mainous A.G., Ledford C.J.W. The intersection of physician wellbeing and clinical application of diabetes guidelines. Patient Educ. Couns. 2018;101:894–899. doi: 10.1016/j.pec.2017.12.007. [DOI] [PubMed] [Google Scholar]
  • 39.Hsieh P.J. Healthcare professionals’ use of health clouds: Integrating technology acceptance and status quo bias perspectives. Int. J. Med. Inform. 2015;84:512–523. doi: 10.1016/j.ijmedinf.2015.03.004. [DOI] [PubMed] [Google Scholar]
  • 40.Williams A., Turer C., Smith J., Nievera I., McCulloch L., Wareg N., Clary M., Rajagopalan A., Brownson R.C., Koopman R.J., et al. Adoption of an Electronic Medical Record Tool for Childhood Obesity by Primary Care Providers. Appl. Clin. Inform. 2020;11:210–217. doi: 10.1055/s-0040-1705106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Tubaishat A. Perceived usefulness and perceived ease of use of electronic health records among nurses: Application of Technology Acceptance Model. Inform. Health Soc. Care. 2018;43:379–389. doi: 10.1080/17538157.2017.1363761. [DOI] [PubMed] [Google Scholar]
  • 42.Idoga P.E., Toycan M., Nadiri H., Çelebi E. Factors Affecting the Successful Adoption of e-Health Cloud Based Health System from Healthcare Consumers’ Perspective. IEEE Access. 2018;6:71216–71228. doi: 10.1109/ACCESS.2018.2881489. [DOI] [Google Scholar]
  • 43.Zayyad M.A., Toycan M. Factors affecting sustainable adoption of e-health technology in developing countries: An exploratory survey of Nigerian hospitals from the perspective of healthcare professionals. PeerJ. 2018;2018:e4436. doi: 10.7717/peerj.4436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Yu P., Li H., Gagnon M.P. Health IT acceptance factors in long-term care facilities: A cross-sectional survey. Int. J. Med. Inform. 2009;78:219–229. doi: 10.1016/j.ijmedinf.2008.07.006. [DOI] [PubMed] [Google Scholar]
  • 45.Vandecasteele B., Geuens M. Motivated Consumer Innovativeness: Concept, measurement, and validation. Int. J. Res. Mark. 2010;27:308–318. doi: 10.1016/j.ijresmar.2010.08.004. [DOI] [Google Scholar]
  • 46.Goldsmith R.E. The Validity Of A Scale To Measure Global Innovativeness. J. Appl. Bus. Res. 1991;7:89–97. doi: 10.19030/jabr.v7i2.6249. [DOI] [Google Scholar]
  • 47.Aggelidis V.P., Chatzoglou P.D. Using a modified technology acceptance model in hospitals. Int. J. Med. Inform. 2009;78:115–126. doi: 10.1016/j.ijmedinf.2008.06.006. [DOI] [PubMed] [Google Scholar]
  • 48.Carter L., Bélanger F. The utilization of e-government services: Citizen trust, innovation and acceptance factors. Inf. Syst. J. 2005;15:5–25. doi: 10.1111/j.1365-2575.2005.00183.x. [DOI] [Google Scholar]
  • 49.Venkatesh V., Davis F.D. Theoretical extension of the Technology Acceptance Model: Four longitudinal field studies. Manage. Sci. 2000;46:186–204. doi: 10.1287/mnsc.46.2.186.11926. [DOI] [Google Scholar]
  • 50.Wu J.H., Chen Y.C., Lin L.M. Empirical evaluation of the revised end user computing acceptance model. Comput. Human Behav. 2007;23:162–174. doi: 10.1016/j.chb.2004.04.003. [DOI] [Google Scholar]
  • 51.Venkatesh V., Davis F.D. A Model of the Antecedents of Perceived Ease of Use: Development and Test. Decis. Sci. 1996;27:451–481. doi: 10.1111/j.1540-5915.1996.tb01822.x. [DOI] [Google Scholar]
  • 52.Amoako-Gyampah K., Salam A.F. An extension of the technology acceptance model in an ERP implementation environment. Inf. Manag. 2004;41:731–745. doi: 10.1016/j.im.2003.08.010. [DOI] [Google Scholar]
  • 53.Ward R., Stevens C., Brentnall P., Briddon J. The attitudes of health care staff to information technology: A comprehensive review of the research literature. Health. Inf. Libr. J. 2008;25:81–97. doi: 10.1111/j.1471-1842.2008.00777.x. [DOI] [PubMed] [Google Scholar]
  • 54.Nazi K.M. The Personal Health Record Paradox: Health Care Professionals’ Perspectives and the Information Ecology of Personal Health Record Systems in Organizational and Clinical Settings. J. Med. Internet Res. 2013;15:e2443. doi: 10.2196/jmir.2443. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Simpao A.F., Ahumada L.M., Gálvez J.A., Rehman M.A. A Review of Analytics and Clinical Informatics in Health Care. J. Med. Syst. 2014;38:45. doi: 10.1007/s10916-014-0045-x. [DOI] [PubMed] [Google Scholar]
  • 56.Kalayou M.H., Endehabtu B.F., Tilahun B. The Applicability of the Modified Technology Acceptance Model (TAM) on the Sustainable Adoption of eHealth Systems in Resource-Limited Settings. J. Multidiscip. Healthc. 2020;13:1827. doi: 10.2147/JMDH.S284973. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Irani T. Prior Experience, Perceived Usefulness and the Web: Factors Influencing Agricultural Audiences’ Adoption of Internet Communication Tools. J. Appl. Commun. 2000;84:49–63. doi: 10.4148/1051-0834.2151. [DOI] [Google Scholar]
  • 58.Chismar W.G., Wiley-Patton S. Test of the technology acceptance model for the internet in pediatrics. Proc. AMIA Symp. 2002:155–159. [PMC free article] [PubMed] [Google Scholar]
  • 59.Schaper L.K., Pervan G.P. ICT and OTs: A model of information and communication technology acceptance and utilisation by occupational therapists. Int. J. Med. Inform. 2007;76:S212–S221. doi: 10.1016/j.ijmedinf.2006.05.028. [DOI] [PubMed] [Google Scholar]
  • 60.Chau P.Y.K., Hu P.J.H. Investigating healthcare professionals’ decisions to accept telemedicine technology: An empirical test of competing theories. Inf. Manag. 2002;39:297–311. doi: 10.1016/S0378-7206(01)00098-2. [DOI] [Google Scholar]
  • 61.Hu P.J., Chau P.Y.K., Liu Sheng O.R., Tam K.Y. Examining the Technology Acceptance Model Using Physician Acceptance of Telemedicine Technology. J. Manag. Inf. Syst. 1999;16:91–112. doi: 10.1080/07421222.1999.11518247. [DOI] [Google Scholar]
  • 62.Chau P.Y.K., Hu P.J. Examining a Model of Information Technology Acceptance by Individual Professionals: An Exploratory Study. J. Manag. Inf. Syst. 2014;18:191–229. doi: 10.1080/07421222.2002.11045699. [DOI] [Google Scholar]
  • 63.Vance Wilson E., Lankton N.K. Modeling patients’ acceptance of provider-delivered E-health. J. Am. Med. Inform. Assoc. 2004;11:241–248. doi: 10.1197/jamia.M1475. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Chen I.J., Yang K.F., Tang F.I., Huang C.H., Yu S. Applying the technology acceptance model to explore public health nurses’ intentions towards web-based learning: A cross-sectional questionnaire survey. Int. J. Nurs. Stud. 2008;45:869–878. doi: 10.1016/j.ijnurstu.2006.11.011. [DOI] [PubMed] [Google Scholar]
  • 65.Wu J.H., Wang S.C., Lin L.M. Mobile computing acceptance factors in the healthcare industry: A structural equation model. Int. J. Med. Inform. 2007;76:66–77. doi: 10.1016/j.ijmedinf.2006.06.006. [DOI] [PubMed] [Google Scholar]
  • 66.Tung F.C., Chang S.C., Chou C.M. An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry. Int. J. Med. Inform. 2008;77:324–335. doi: 10.1016/j.ijmedinf.2007.06.006. [DOI] [PubMed] [Google Scholar]
  • 67.Tilahun B., Fritz F. Modeling antecedents of electronic medical record system implementation success in low-resource setting hospitals Healthcare Information Systems. BMC Med. Inform. Decis. Mak. 2015;15:61. doi: 10.1186/s12911-015-0192-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Biruk S., Yilma T., Andualem M., Tilahun B. Health Professionals’ readiness to implement electronic medical record system at three hospitals in Ethiopia: A cross sectional study. BMC Med. Inform. Decis. Mak. 2014;14:115. doi: 10.1186/s12911-014-0115-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Yehualashet G., Asemahagn M., Tilahun B. The Attitude towards and Use of Electronic Medical Record System by Health Professionals at a Referral Hospital in Northern Ethiopia: Cross-Sectional Study. J. Health Inform. Africa. 2015;3:19–29. doi: 10.12856/JHIA-2015-v3-i1-124. [DOI] [Google Scholar]
  • 70.Garavand A., Mohseni M., Asadi H., Etemadi M., Moradi-Joo M., Moosavi A. Factors influencing the adoption of health information technologies: A systematic review. Electron. Physician. 2016;8:2713. doi: 10.19082/2713. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Zhou M., Zhao L., Kong N., Campy K.S., Qu S., Wang S. Factors influencing behavior intentions to telehealth by Chinese elderly: An extended TAM model. Int. J. Med. Inform. 2019;126:118–127. doi: 10.1016/j.ijmedinf.2019.04.001. [DOI] [PubMed] [Google Scholar]
  • 72.Alexandra S., Handayani P.W., Azzahro F. Indonesian hospital telemedicine acceptance model: The influence of user behavior and technological dimensions. Heliyon. 2021;7:e08599. doi: 10.1016/j.heliyon.2021.e08599. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Kamal S.A., Shafiq M., Kakria P. Investigating acceptance of telemedicine services through an extended technology acceptance model (TAM) Technol. Soc. 2020;60:101212. doi: 10.1016/j.techsoc.2019.101212. [DOI] [Google Scholar]
  • 74.Lanseng E.J., Andreassen T.W. Electronic healthcare: A study of people’s readiness and attitude toward performing self-diagnosis. Int. J. Serv. Ind. Manag. 2007;18:394–417. doi: 10.1108/09564230710778155. [DOI] [Google Scholar]
  • 75.Sandberg J., Trief P.M., Izquierdo R., Goland R., Morin P.C., Palmas W., Larson C.D., Strait J.G., Shea S., Weinstock R.S. A Qualitative Study of the Experiences and Satisfaction of Direct Telemedicine Providers in Diabetes Case Management. Telemed. e-Health. 2009;15:742–750. doi: 10.1089/tmj.2009.0027. [DOI] [PubMed] [Google Scholar]
  • 76.Olver I.N., Selva-Nayagam S. Evaluation of a Telemedicine Link Between Darwin and Adelaide to Facilitate Cancer Management. Telemed. J. 2004;6:213–218. doi: 10.1089/107830200415144. [DOI] [PubMed] [Google Scholar]
  • 77.Zaidi S.T.R., Marriott J.L., Nation R.L. The role of perceptions of clinicians in their adoption of a web-based antibiotic approval system: Do perceptions translate into actions? Int. J. Med. Inform. 2008;77:33–40. doi: 10.1016/j.ijmedinf.2006.11.008. [DOI] [PubMed] [Google Scholar]
  • 78.Taylor P. Evaluating telemedicine systems and services. J. Telemed. Telecare. 2005;11:167–177. doi: 10.1258/1357633054068955. [DOI] [PubMed] [Google Scholar]
  • 79.Park H.-Y., Kwon Y.-M., Jun H.-R., Jung S.-E., Kwon S.-Y. Satisfaction Survey of Patients and Medical Staff for Telephone-Based Telemedicine during Hospital Closing Due to COVID-19 Transmission. Telemed. e-Health. 2020;27:724–732. doi: 10.1089/tmj.2020.0369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Martínez A., Everss E., Rojo-Álvarez J.L., Figal D.P., García-Alberola A. A systematic review of the literature on home monitoring for patients with heart failure. J. Telemed. Telecare. 2006;12:234–241. doi: 10.1258/135763306777889109. [DOI] [PubMed] [Google Scholar]
  • 81.Dünnebeil S., Sunyaev A., Blohm I., Leimeister J.M., Krcmar H. Determinants of physicians’ technology acceptance for e-health in ambulatory care. Int. J. Med. Inform. 2012;81:746–760. doi: 10.1016/j.ijmedinf.2012.02.002. [DOI] [PubMed] [Google Scholar]
  • 82.Rajan C.A., Baral R. Adoption of ERP system: An empirical study of factors influencing the usage of ERP and its impact on end user. IIMB Manag. Rev. 2015;27:105–117. doi: 10.1016/j.iimb.2015.04.008. [DOI] [Google Scholar]
  • 83.Hung S.Y., Ku Y.C., Chien J.C. Understanding physicians’ acceptance of the Medline system for practicing evidence-based medicine: A decomposed TPB model. Int. J. Med. Inform. 2012;81:130–142. doi: 10.1016/j.ijmedinf.2011.09.009. [DOI] [PubMed] [Google Scholar]
  • 84.Thong J.Y.L., Hong W., Tam K.Y. Understanding user acceptance of digital libraries: What are the roles of interface characteristics, organizational context, and individual differences? Int. J. Hum. Comput. Stud. 2002;57:215–242. doi: 10.1016/S1071-5819(02)91024-4. [DOI] [Google Scholar]
  • 85.Hatz M.H.M., Sonnenschein T., Blankart C.R. The PMA Scale: A Measure of Physicians’ Motivation to Adopt Medical Devices. Value Health. 2017;20:533–541. doi: 10.1016/j.jval.2016.12.002. [DOI] [PubMed] [Google Scholar]
  • 86.Teplensky J.D., Pauly M.V., Kimberly J.R., Hillman A.L., Schwartz J.S. Hospital adoption of medical technology: An empirical test of alternative models. Health Serv. Res. 1995;30:437. [PMC free article] [PubMed] [Google Scholar]
  • 87.Wu J.H., Shen W.S., Lin L.M., Greenes R.A., Bates D.W. Testing the technology acceptance model for evaluating healthcare professionals’ intention to use an adverse event reporting system. Int. J. Qual. Health Care. 2008;20:123–129. doi: 10.1093/intqhc/mzm074. [DOI] [PubMed] [Google Scholar]
  • 88.Moeinedin F. Assessing Primary Care Physicians’ Attitudes towards Adoption of an Electronic Tool to Support Cancer Diagnosis. University of Toronto; Toronto, ON, Canada: 2011. [Google Scholar]
  • 89.Abdekhoda M., Ahmadi M., Gohari M., Noruzi A. The effects of organizational contextual factors on physicians’ attitude toward adoption of Electronic Medical Records. J. Biomed. Inform. 2015;53:174–179. doi: 10.1016/j.jbi.2014.10.008. [DOI] [PubMed] [Google Scholar]
  • 90.Handayani P.W., Hidayanto A.N., Pinem A.A., Hapsari I.C., Sandhyaduhita P.I., Budi I. Acceptance model of a Hospital Information System. Int. J. Med. Inform. 2017;99:11–28. doi: 10.1016/j.ijmedinf.2016.12.004. [DOI] [PubMed] [Google Scholar]
  • 91.Moore G.C., Benbasat I. Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation. Inf. Syst. Res. 1991;2:192–222. doi: 10.1287/isre.2.3.192. [DOI] [Google Scholar]
  • 92.Teutsch C. Patient–doctor communication. Med. Clin. North Am. 2003;87:1115–1145. doi: 10.1016/S0025-7125(03)00066-X. [DOI] [PubMed] [Google Scholar]
  • 93.Ventres W., Kooienga S., Vuckovic N., Marlin R., Nygren P., Stewart V. Physicians, Patients, and the Electronic Health Record: An Ethnographic Analysis. Ann. Fam. Med. 2006;4:124–131. doi: 10.1370/afm.425. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94.Werner P., Karnieli E. A model of the willingness to use telemedicine for routine and specialized care. J. Telemed. Telecare. 2003;9:264–272. doi: 10.1258/135763303769211274. [DOI] [PubMed] [Google Scholar]
  • 95.Rimmer M.P., Al Wattar B.H., on behalf of the UKARCOG Members Provision of obstetrics and gynaecology services during theCOVID-19 pandemic: A survey of junior doctors in the UK National Health Service. BJOG. 2020;127:1123–1128. doi: 10.1111/1471-0528.16313. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Bakken S., Ghullo-Ficurnoa L., Izquierdo R., Lee N.-J., Morin P., Palmas W., Teresi J., Weinstock R., Shea S., Starren J. Development, Validation, and use of English and Spanish Versions of the TElemedicine Satisfaciot and Usefulness Questionnaire. J. Am. Med. Inform. Assoc. 2006;13:660–667. doi: 10.1197/jamia.M2146. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Whitten P., Doolittle G., Mackert M. Providers’ Acceptance of Telehospice. J. Palliat. Med. 2005;8:730–735. doi: 10.1089/jpm.2005.8.730. [DOI] [PubMed] [Google Scholar]
  • 98.Holden R.J., Karsh B.T. The Technology Acceptance Model: Its past and its future in health care. J. Biomed. Inform. 2010;43:159–172. doi: 10.1016/j.jbi.2009.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Adewale E. Doctoral Dissertation. Colorado Technical University; Colorado Springs, CO, USA: 2015. An Exploratory Qualitative Investigation into the Acceptance of Telemedicine Technologies in the Washington DC Metro Area. [Google Scholar]
  • 100.Yi M.Y., Jackson J.D., Park J.S., Probst J.C. Understanding information technology acceptance by individual professionals: Toward an integrative view. Inf. Manag. 2006;43:350–363. doi: 10.1016/j.im.2005.08.006. [DOI] [Google Scholar]
  • 101.Tabachnick B., Fidell L. Using Multivariate Statistics. Pearson Education; Upper Saddle River, NJ, USA: 2018. [Google Scholar]
  • 102.Hair J.F.J., Black W.C., Babin B.J., Anderson R.E., Black W.C., Anderson R.E. Multivariate Data Analysis. Cengage; Boston, MA, USA: 2018. [Google Scholar]
  • 103.Henseler J., Ringle C.M., Sarstedt M. A New Criterion for assessing discriminant validity in variance-based structural equation modeling. J. Acad. Mark. Sci. 2015;43:115–135. doi: 10.1007/s11747-014-0403-8. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable.


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES