Abstract
Background
Acceptance of Electronic patient portal (EPP) is instrumental for its success. Studies on users’ acceptance in the Middle East region are scarce. This study aims to use the TAM as a framework to quantitatively describe potential users, diabetic and chronic high blood pressure patients and their providers, intention to use and factors influencing the intention to use EPP at AUBMC-FMC We concurrently test the internal construct validity and the reliability of the TAM.
Methods
A cross-sectional survey design and the vignette approach were used. For validation, we needed a minimum of 180 patients; all 35 attending physicians and 11 registered nurses were targeted. We used descriptive statistics to calculate the intention to use EPP and its determinants based on the TAM constructs. Exploratory factor analysis (EFA) and structural equation modeling (SEM) were employed to estimate significant path coefficients for patients only as the sample size of providers was too small.
Results
We had 199 patients, half intended to use EPP; 73% of providers (N = 17) intended to use EPP. Perceived ease of use and privacy concerns were significantly higher among providers than patients (Mean (M) = 0.77 vs M = 0.42 (CI: − 0.623; − 0.081)) and (M = 3.67 vs M = 2.13, CI: − 2.16; − 0.91) respectively; other constructs were not significantly different. Reliability of TAM revealed a Cronbach Alpha of α=.91. EFA showed that three components explained 73.48% of the variance: Behavioral Intention of Use (14.9%), Perceived Ease of Use (50.74%), Perceived Usefulness (7.84%). SEM found that perceived ease of use increased perceived usefulness (standardized regression weight = 0.49); perceived usefulness (0.51) had more predictive value than perceived ease of use (0.27) to explain the behavioral intention of use of the EPP.
Conclusions
We found that providers valued the usefulness of EPP and were mostly intending to use it. This finding has yet to be tested in future studies testing actual use as intention and actual use may not be concordant. The intention to use among patients was lower than those reported in developed countries. We identified two factors that we need to address to increase use, namely perceived ease and usefulness, and proposed practical implications to address them; future research directions were also discussed.
Keywords: Patient portal, Electronic health record, Middle East, Arab, User acceptance, TAM model
Background
Electronic technology (ET) permeates various aspects of our modern society. Many use the Internet for shopping, social networking, banking [1, 2], and for seeking health information [3–5]. Some use mobile applications or web portals to support behavior modification such as physical activity, diet control, and smoking cessation [6–8].
Electronic Patient Portals (EPPs) are one form of ET pervading the health care system. EPPs are a secure online platform where patients enter a password to access their clinical summaries as well as a spectrum of communication features enabling them to communicate directly with their providers at any time and from anywhere. The impact of EPPs on health care is well documented. Studies show the use of EPPs mitigate difficulties booking appointments and renewing medications [9, 10], and facilitate patient-provider communication [11–13]. EPPs improve patients’ self-care by assisting them in making lifestyle changes and improving their engagement in health promotion and health prevention activities [13–16].
For patients with chronic diseases, EPPs improve treatment adherence and clinical outcomes [17–21]. EPP features that allow patients to record, edit and retrieve their health care data such as blood pressure, blood glucose and weight enable patients to monitor their health and to early detect critical situations and timely intervention [22, 23]. The ability to view their own clinical summaries (problem and medication list), increase patient awareness of important aspects of their own diseases and enable the health care team to identify gaps in self-management to target them with health education [24]. EPP use was also associated with improved medication adherence and controlled blood pressure [25–27].
EPPs are of little value unless they are used meaningfully. Several factors can influence the meaningful use of EPPs, including interface with the technology, individual characteristics of users, and acceptance of the technology. Interface with EPP factors includes the language used to communicate with the provider and self-efficacy in using technology [19, 21, 28–33]. Users’ characteristics, such as health literacy, age, ethnicity, and cultural factors, influence the meaningful use of EPP [19, 28, 30, 31, 34, 35]. A plethora of studies has found that users’ acceptance is the main lever for meaningful use of EPP and a critical factor in determining its success or failure [36–40]. Acceptance is defined as a process that begins with users’ intention to employ the technology, followed by actual use, and if found efficient and effective, then they accept and adopt the technology [39].
Because acceptance of technology has salient theoretical and practical implications, many researchers have proposed theories or models to predict users’ acceptance of technology. There are about fourteen theories or models focusing on users’ acceptance of the technology [41]. The main objective of those theories or models is to identify barriers for adoption to promote the use of technology [41]. In this study, we opted to use the Technology Acceptance Model [38] version 1 [42] (Fig. 1). TAM is one of the most popular models that focuses on psychological factors influencing acceptance. The TAM measures acceptance in terms of reported intention to use and subsequent technology usage. This framework posits that perceived ease of use of the technology, perceived usefulness of the tasks to be performed, external factors, and attitude predict acceptance and adoption [42]. This model was selected for this study due to its relatively high explanatory power of predicting a broad range of factors influencing intention to use (R2 = 0.52); TAM posits an association between perceived usefulness and perceived ease of use, not reflected in other models [43, 44] and its parsimony (few predictors) [45].
To our knowledge, the reliability and validity of this model in predicting use have not been tested in the Arab world thus it is important to examine whether the constructs of the TAM have high explanatory power for predicting factors influencing use in this specific culture.
Study setting and aim
While EPPs has been successfully rolled out in the daily practice of various developed countries [46–49], they are scarce in the Arab world, with less than 12% of healthcare organizations offering this service [50], the first one was launched in the United Arab Emirates in 2015 [51]. Studies on users’ acceptance of EPP are also sparse in the Middle East region in general [52–54].
This study is based at the American University of Beirut Medical Center- Family Medicine Clinic (AUBMC-FMC), in Lebanon. AUBMC-FMC is a large primary health care center serving mainly AUB faculty, staff, and their families. There are approximately 9469 adult beneficiaries aged 20 years or older, 7.5% are diabetic, and 27% have chronic high blood pressure [55]. Given that EPP is expected to be particularly beneficial for self-management of chronic diseases [56], the focus in this study is on this particular out-patient population.
We conducted this study in 2016–2017, before the launch of the EPP system in November 2018. The “MyChart” EPP system at AUBMC-FMCisa free application accessible via smartphone or computer and linked to the Electronic Medical Record (EMR) using a password. “MyChart” allows patients to schedule appointments, refill prescriptions, directly message their care providers with the option of including photos, access laboratory results, and clinical summaries,. Communication language is English.
This study aims to use the TAM as a framework to quantitatively describe potential users, diabetic and chronic high blood pressure patients and their providers, intention to use and factors influencing the intention to use EPP at AUBMC-FMC. We concurrently test the internal construct validity and the reliability of the TAM framework through a hypothesized structural model.
Methods
Study design
We used a cross-sectional survey design and the vignette approach to explore the determinants of users’ acceptance of EPP.
In a typical vignette, respondents are presented with a scenario mimicking a real-life situation and are asked to express their opinions based on this scenario. Vignettes have several advantages over survey questionnaires, including approximating real-life situations, enhancing internal validity and reliability of measurement [57–60], and improving construct validity [61].
The approval of the Ethical Review Committee at AUB was secured before the initiation of this study. The data collection occurred between November 2016 and February 2017.
Sampling
We targeted patients with diabetes and chronic high blood pressure. To validate an instrument, the recommended respondent-to-item ratio ranges from 5:1 (50 participants for a 10-item questionnaire) to 30:1 [62]. For this study, we used the 15:1 ratio. Further, the recommended minimum sample size for conducting structural equational modeling [52] is 100–150 observations [63–66]. Thus our minimum sample size was 180 patients. All 35 attending physicians and 11 registered nurses actively engaged in primary care services at AUBMC-FMC were targeted.
Recruitment and data collection
The research assistant identified hypertensive and diabetic patients visiting the clinic, handed the consent form to those who accepted to participate, and interviewed them using the structured survey instrument. Providers were recruited by email, followed by a face-to-face reminder and were prompted to fill the survey online.
We used three different slightly modified versions of the survey for: patient, physician, and nurse. The instrument contained the same vignette, and a questionnaire of two parts. Part A captured demographic characteristics including age, gender, level of education and number of co-morbidities for patients, and years in practice, country of training for providers as well as use of electronic technology in daily lives (independent variables). Part B, contained constructs from the TAM including: intention to use EPP (outcome variable) and service features likely to be used, perceived ease of use, perceived usefulness and social influence (predictor variables). (Appendices A-C).
Data analysis
Descriptive frequencies for categorical variables or means and standard deviations for ordinal variables were calculated. Exploratory factor analysis (EFA) and structural equational modeling (SEM) [52] were used to test the reliability and validity of the TAM framework. SPSS version 23.0 was used for descriptive statistics, and exploratory factor analysis [67] and AMOS version 21.0 was used to test the hypothesized structural model of the TAM framework [68]. (Appendix D: Hypothesis testing using the TAM framework).
Statistical significance was set at p < .05.
EFA and SEM were only carried out for patients, as the sample size of physicians and nurses was too small [65]. Factors explaining variability with eigenvalues smaller than one were not used. Further, we took the factor loading of .5 as a significant cut-off [69].
The STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) guidelines were used to ensure the reporting of this observational study [70] (Appendix E).
Results
Participant characteristics
Participants consisted of 199 patients, thus more than the target sample of 180, and 17 providers.
Mean age of patients was 65.1 (SD = 13.8, range = 25–92) years, two thirds (62.31%) were males, and 68.84% finished high school level or less; one third (35.68%) reported not using ET in daily activities (Table 1).
Table 1.
Characteristic | N (199) | % | M | SD | Range |
---|---|---|---|---|---|
Age | 65.1 | 13.8 | 25–92 | ||
Sex | |||||
Male | 124 | 62.31 | |||
Female | 75 | 37.69 | |||
Education | |||||
Less than High School | 64 | 32.16 | |||
High School | 73 | 36.68 | |||
College degree | 33 | 16.58 | |||
University degree | 29 | 14.58 | |||
Native Language | |||||
Arabic | 194 | 97.49 | |||
English | 5 | 2.51 | |||
Comorbidities | |||||
1 | 78 | 39.2 | |||
2 | 61 | 30.65 | |||
More than 2 | 60 | 30.15 | |||
Use of electronic technology in daily life* | |||||
Mobile web-based portals | 56 | 28.14 | |||
SMS | 125 | 62.81 | |||
App-based portals | 83 | 41.71 | |||
Social media | 73 | 36.68 | |||
Other e-services (i.e. online banking) | 9 | 4.52 | |||
None of the above | 71 | 35.68 |
Note. *: frequencies and percentages do not add to 199 and 100 respectively as patients chose more than one option
Mean age of providers was 39.5 (SD = 9.5, range = 27–54) years and 94.12% were females. The mean number of years in practice was 12.4 (SD = 8.1, Range = 0–25) years, and all had one form or another of daily ET activities (Table 2).
Table 2.
Variable | N = 17 | % | M | SD | Range |
---|---|---|---|---|---|
Age | 39.5 | 9.6 | 27–54 | ||
Sex | |||||
Male | 1 | 5.88 | |||
Female | 16 | 94.12 | |||
Years in Practice | 12.4 | 8.1 | 0–25 | ||
Country of Training | |||||
Lebanon | 11 | 64.71 | |||
Foreign-trained | 1 | 5.88 | |||
Use of electronic technology in daily life* | |||||
Mobile web-based portals | 16 | 94.12 | |||
SMS | 11 | 64.7 | |||
App-based portals | 11 | 64.7 | |||
Social media | 16 | 94.12 | |||
Other e-services (i.e. online banking) | 11 | 64.7 |
Note. *: frequencies and percentages do not add to 17 and 100 respectively as providers chose more than one option
Users acceptance of EPP
Half of the patients intended to use EPP (Fig. 2). When patients were asked about the intention to use various features of the portal, the mean intention to use each feature varied between 3.2 and 3.7 (Table 3). Most patients (88%) perceived the usefulness of the portal. Among the various items that measure the usefulness of the portal use, the importance of saving time ranked highest (M = 3.6, SD = .9) and the usefulness of the portal during critical times of the disease ranked least (M = 2.4, SD = .8). Only 42% of patients perceived the ease of use of the portal in all aspects of posting information, communicating with the physician, and finding information. Most patients (95%) indicated that social influence will have a positive effect on intention to use while the mean privacy concern was 2.1 (SD = .9).
Table 3.
Item | n | % | M | SD |
---|---|---|---|---|
Behavioral Intention of Use | ||||
I intend to use EEP to view my medical record. | 3.7 | 1.1 | ||
I intend to use EPP to book and reschedule an appointment. | 3.7 | 1.1 | ||
I intend to use EPP to refill medication | 3.6 | 1.1 | ||
I intend to use EPP to enter my daily weight, daily blood glucose, daily physical exercise activity. | 3.2 | 1.2 | ||
I intend to use EPP to receive targeted education from my family physician enabling me to self-manage my disease. | 3.7 | 1.0 | ||
Perceived Ease of Use | ||||
Using EPP will be easy for me to understand. | 2.5 | 1.5 | ||
It will be easy for me to post information on EPP. | 2.5 | 1.5 | ||
I will find it easy to communicate with my primary care physicians using EPP. | 2.5 | 1.5 | ||
I will find the information posted by primary care physicians on EPP easy to follow. | 2.6 | 1.5 | ||
Perceived Usefulness | ||||
Using EPP will give me greater control over my diabetes/high blood pressure. | 3.3 | .9 | ||
Using EPP will save me time. | 3.6 | .9 | ||
Using EPP will make it easier for me to have a healthier life. | 3.4 | .9 | ||
Using EPP will support me during a critical time of my disease. | 2.4 | .8 | ||
Privacy Concern | ||||
If I use EPP, I will be concerned about my information privacy. | 2.1 | .9 | ||
Social Influence | ||||
If my friends are using EPP and find it worth it, I would use it too. | 190 | 95.48 |
Concerning providers, 73% intended to use EPP (Fig. 2), 82.4% intended to post educational material, 70.6% intended to encourage their patients to use the portal for daily recording of weight and blood pressure, and 76.5% intended to encourage patients to use the EPP for administrative tasks, such as booking appointments and refilling medications. As for social influence, 70.59 indicated it has positive effect on intention to use and the mean privacy concern was 3.6 (SD = 1.1) (Table 4).
Table 4.
Characteristic | n | % | M | SD |
---|---|---|---|---|
Behavioral Intention of Use | ||||
I intend to encourage patients to use the appointment booking and medication refill service. | 13 | 76.5 | ||
I intend to encourage my patients to daily record their weight, daily blood pressure and daily blood glucose. | 12 | 70.6 | ||
I will post patient education to assist them self-manage their disease. | 14 | 82.4 | ||
Perceived Ease of Use | ||||
It will be easy for me to post information on EPP. | 3.5 | 0.6 | ||
I will find it easy to communicate with patients using EPP. | 3.2 | 0.9 | ||
Perceived Usefulness | ||||
Using EPP will give me greater control over my patient’s chronic disease. | 4.0 | 0.6 | ||
Using EPP will save me time. | 3.3 | 1.1 | ||
Using EPP will make it easier for me to interact with patients. | 3.6 | 0.9 | ||
Using EPP will support my patients during a critical time of their disease. | 3.5 | 0.8 | ||
Social Influence | ||||
If my colleagues are using EPP and find it worth it, I would use it too. | 12 | 70.59 | ||
Privacy Concern | ||||
I would be concerned about the information privacy of my patients. | 3.6 | 1.1 |
Figure 2 shows patients vs. healthcare providers’ acceptance of the portal based on TAM’s constructs. Providers (M = .77, SD = .44) were more likely to perceive the ease of use than patients (M = .42, SD = .5), <.05, CI [−.623, −.081]; and more privacy concerns (M = 3.67, SD = 1.11) as compared to patients (M = 2.13, SD = .9), p < .001, CI [−2.16, −.91] (Table 4). There were no statistically significant differences between providers and patients when it comes to intention to use, perceived usefulness of the portal, and social influence.
Validity, reliability and structural equation model
TAM model reliability revealed an excellent Cronbach Alpha of α=.91. To check the internal construct validity, EFA was performed using principal component analysis with Varimax rotation and Kaiser normalization [65]. Three components explained 73.48% of the total variance with an intrinsic value above 1, with a Kaiser-Meyer-Olkin (KMO) sample adequacy of .89. Bartlett’s test of sphericity was statistically significant χ2(78) = 2401.406, p < .001.
Two items (“enter daily weight..” & “receive targeted education ..”) had factor loadings less than .5, thus dropped from the analysis.
First, Behavioral Intention of Use, included three items (Q1, 2 & 3), and explained 14.9% of the variance. It reflected administrative tasks that the portal will facilitate as opposed to the traditional provider encounter. Second, Perceived Ease of Use, included four items (Q4, 5, 6 & 7), and explained 50.74% of the variance. It described the ease of use of the portal to communicate with the provider. Third, Perceived Usefulness, included four items (Q8, 9, 10 & 11), and explained 7.84% of the variance. These items described the use of the portal for better health and better control of chronic diseases and support during critical times (Table 5).
Table 5.
Items | Loadings | Cronbach’s α |
---|---|---|
Behavioral Intention of Use | .815 | |
View my medical record [Q1] | .751 | |
Book and reschedule an appointment [Q2] | .807 | |
Refill medication [Q3] | .812 | |
Perceived Ease of Use | .985 | |
Using EPP will be easy for me to understand [Q4] | .928 | |
It will be easy for me to post information on EPP [Q5] | .940 | |
I will find it easy to communicate with my primary care physicians using EPP [Q6] | .941 | |
I will find the information posted by primary care physicians on EPP easy to follow [Q7] | .921 | |
Perceived Usefulness | .816 | |
Using EPP will give me greater control over my diabetes/high blood pressure [Q9] | .809 | |
Using EPP will save me time [Q10] | .507 | |
Using EPP will make it easier for me to have a healthier life [Q11] | .804 | |
Using EPP will support me during a critical time of my disease [Q12] | .668 |
A covariance-based SEM with maximum likelihood was estimated. Figure 3 exhibits the structural model and Fig. 4 shows the analytical results. Fit measures indicated acceptable fit: 푥2/푑푓 = 1.9, Tucker Lewis index (TLI) = .97, Comparative Fit index (CFI) = .976, Goodness of Fit Index (GFI) = .918, and Root 153 Mean Square Error of Approximation (RMSEA) = .068. The factors extracted and used in the SEM had also acceptable composite reliabilities (CR) and average variances extracted (AVE): Behavioral Intention of Use had a CR = .83 AVE = .62 . Perceived Usefulness had a CR = .96 and AVE = .87. Perceived Ease of Use had a CR = .8 and AVE = .5. A significant negative correlation between age and education was observed, r(197) = − .339, p < .001. As education increased, the perceived ease of use of the EPP increased; and as age increased, using EPP became more difficult. Perceived ease of use increased by .37 standard deviations for every one standard deviation increase in education level, while it decreased by .4 standard deviations for every one standard deviation increase in age. An increase in the perceived ease of use of the EPP predicted an increased perception of the usefulness of the EPP. The standardized regression weight for perceived ease of use on perceived usefulness was .49. Perceived usefulness acted as a mediator between perceived ease of use and behavioral intention of use. Higher reports for both perceived ease of use and perceived usefulness predicted an increase in the behavioral intention of use of the EPP. The standardized regression weights for perceived ease of use and perceived usefulness on the behavioral intention of use were .27 and .51, respectively. Perceived usefulness had more predictive value than perceived ease of use to explain the behavioral intention of use of the EPP.
Discussion
This study is one of the scarce studies that measure users’ acceptance of EPPs and validate the TAM theoretical model in an Arab country. Given that different cultures react differently to the use of EPP and given the rise in its use, it was important to examine the intention to use to provide decision-makers with an empirical tool that would potentially enhance the actual use. Globally, portal developers, researchers, and practitioners would also benefit from the findings when targeting patients from different cultural backgrounds [71].
We found that providers (physicians and nurses) valued the usefulness of EPP (82%). Our providers were overly optimistic about the perceived usefulness of EPP as compared to a study by Kelly et al. [71], who found that 53% of health care providers valued EPP as a tool to improve patient quality of care. It is possible that this is partially due to the Lebanese culture, which is often rather quick to adopt a positive attitude toward innovation in general [72] and is a novelty-seeking culture, especially among individuals with higher educational attainment [73]. This finding has yet to be tested in actual use as intention and actual use may not be concordant. In fact, in a study conducted by Makarem and Antoun [74] in the same setting, 87.2% of physicians indicated that email was useful for communication, yet only 5.1% used email to communicate with their patients. As for perceived ease of use, 77% of our providers indicated that EPP would be easy to use. This ease of use of EPP and the ability to learn new technology easily by providers can be an important determinant of the actual use [20]. However, further studies are needed to confirm those expectations. Due to the small sample size of providers, we were not able to conduct SEM. Al-Adwan [75] used the TAM model to explore determinants of physician’s adoption of ET in hospitals in Jordan showed that the model explained 64.5% of variance in physician’s behavioral intention.
The intention to use among patients was 52%, lower than 69% [76] and 84.1% [77] reported in the literature. To our knowledge, this is the first study to explore the intention to use the EPP among patients in an Arab region. The lower intention to use is concerning because we expect that actual use will be even less. In a study conducted in Saudi Arabia among diabetic patients, Belcher,Vess, and Johnson [78] explored the use of EPP among diabetic patients and shed light on various limitations associated with actual use among the Arab population. Basic factors such as Internet access, language, and material content may be principal factors for suboptimal use. While the Internet is widely proliferated in most Arab countries, some sub-group of the population may still not have access to the Internet [79]. Patient portal communication is often in English and not all patients may be well versed in the English language [78]. Even among those that are well versed, some may have difficulties understanding medical terms. Wang et al. [80] showed that even top-rated materials often use a language that exceeds the average reading ability. Thus, investing in simplifying messages and tailoring them to the patient’s situation need to be carefully considered during implementation.
We examined the reliability and validity of the TAM model. Taylor and Tod (1995) indicate that a robust model should be able to explain a reasonable proportion of the variance in behavioral intention or use [45]. In this study, we found that the TAM had excellent reliability (Cronbach Alpha of α=.91). The validity test (EFA) showed that three components explained 73.48% of the variance, which means that the constructs of the TAM model have a considerably large explanatory power to predict intention to use in an Arab country. However, other models need to be validated in this region such as the Unified Theory of Acceptance and Use of Technology (UTAUT). Further, more contextual factors need to be added to existing models. to explain why technology is accepted or rejected in this specific population.
We found that the perceived usefulness of EPP mostly drives the intent to use. Such a finding is echoed in other studies using the TAM model [81–83]. To bolster EPP use, individuals need to be able to understand the purpose of the technology, which is to provide information when and where it is needed to improve outcomes and patient safety. Hence, organizational efforts focusing not only on promoting the acquisition of the technology but also on marketing the added value of this technology is needed. For example, in our study, patients valued the importance of EPP in controlling their health conditions, promoting their healthy living, and saving them time. Thus, displaying posters in waiting and exam rooms showing patients the usefulness of EPP in facilitating appointment taking, medication refill, and communicating with their physicians can encourage them to use the EPP needs to be considered [84].
We found the perceived ease of use indirectly influenced perceived usefulness. Naturally, When the system is user-friendly and simple, it will likely be successfully used. The human interface with technology matters [85, 86]. For instance, if access to the content of EPP is aesthetically simple, clear and follows a logical process for navigating the system, patients are more likely to use it [87]. Hence, every effort needs to simplify the process of utilization, including training, coaching, and providing continuous support [88, 89].
The digital divide by age and education among our patients were also common observations in studies done in developed countries. For example, in a study carried out on diabetic veterans in North Carolina, USA, lower age, and some college education were more interested in learning how to use EPP [90]. Special considerations need to be taken while addressing older age individuals or those with less educational attainment such as posting educational materials sufficient for a grade 6 reading level, larger fonts, more illustrations, and fewer words can make the EPP more accessible [91–93]. Furthermore, providers need to be proactive by encouraging patients to constantly check their EPP, as this will increase use [94].
Several weaknesses need to be disclosed. We conducted this study with available patients at the AUBMC-FMC, which is a highly recognized organization in Lebanon, capturing patients from higher socioeconomic status or those working in the organization, thus limiting its generalizability to the overall population of Lebanon. Survey completion was voluntary; it is possible that those interested in the topic were more likely to accept our invitation thus possible selection bias. The available small sample of providers prevented us from conducting SEM.
When this study was conducted, the EPP was still under construction. Currently, the system has been launched. Looking forward, longitudinal studies focusing on actual EPP use will be needed. Greenhalgh et al. [95] pointed that likely the optimistic view on the perceived usefulness will be tapered upon the use of the portal, or the perceived ease of use will be influenced with how friendly the system is to patients.
Conclusions
The most important contribution of this study is that it is the first to report on the acceptability of the patient portal among Lebanese patients and providers, where research is scarce. Further, we were able to successfully and empirically test the predicting factors influencing the intention to use EPP using the TAM model. Based on these findings, we suggest several approaches that can be implemented to encourage the acceptance and utilization of EPP.
Summary points
What was already known on the topic:
Electronic Patient Portals (EPPs) are one promising form of web-based technology that can be used to mitigate difficulties in booking appointments, renewing medications, and facilitate patients’ interactions with their providers. EPP technology has been successfully rolled out in the daily practice of many developed countries.
The Technology Acceptance Model is a robust and popular framework used to identify factors influencing the adoption of technology. The TAM model has been validated in many countries to assist global developers in increasing the adoption of their technology.
What this study adds:
This study is one of the scarce studies that measure users’ acceptance of EPPs in an Arab country. Half of the patients and 73% of providers intend to use EPP. The structural equation modeling showed two components of TAM explaining the intention to use EPP. Perceived ease of use and perceived usefulness, where the later had more predictive value than the former.
This study also validated the TAM theoretical model among a sample of patients in a high-middle income Arab country, Lebanon.
Supplementary information
Acknowledgements
Not applicable.
Abbreviations
- AUB
American University of Beirut
- AUBMC-FMC
American University of Beirut Medical Center- Family Medicine Clinic
- AVE
Average Variances Extracted
- CFI
Comparative Fit index
- CI
Confidence Interval
- CR
Composite reliabilities
- EFA
Exploratory factor analysis
- EPPs
Electronic Patient Portals
- ET
Electronic technology
- GFI
Goodness of Fit Index
- KMO
Kaiser-Meyer-Olkin
- RMSEA
Root Mean Square Error of Approximation
- SD
Standard Deviation
- SEM
Structural Equation Modeling
- STROBE
The STrengthening the Reporting of OBservational studies in Epidemiology
- TAM
Technology Acceptance Model
- TLI
Tucker Lewis index
Authors’ contributions
All authors have made a substantial, direct, intellectual contribution to this study. GHA: study concept and design, data analysis and interpretation, and drafting of the manuscript. JA: study concept, interpretation of data, and critical revision of the manuscript for important intellectual content. KB: data analysis and interpretation, editing and critical revision of the manuscript. SH: data analysis and interpretation and critical revision of the manuscript. HN: data collection. All authors have read and approved the manuscript.
Funding
This study was funded by a grant from the Medical Practice Plan at the American University of Beirut Medical Center. This funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The approval of the Ethical Review Committee at the American University of Beirut was secured before the initiation of this study. We sought oral consent from participants. Only those who consented were included in the study.
Consent for publication
Not applicable. The manuscript doesn’t contain any individual identifying data.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Gladys N. Honein-AbouHaidar, Email: gh30@aub.edu.lb
Jumana Antoun, Email: ja46@aub.edu.lb.
Karim Badr, Email: karim.badr@lau.edu.
Sani Hlais, Email: sanihlais@gmail.com.
Houry Nazaretian, Email: hn28@aub.edu.lb.
Supplementary information
Supplementary information accompanies this paper at 10.1186/s12911-020-1047-x.
References
- 1.Glynn L, Casey M, Walsh J, Hayes PS, Harte RP, Heaney D. Patients’ views and experiences of technology based self-management tools for the treatment of hypertension in the community: a qualitative study. BMC Fam Pract. 2015;16:119. doi: 10.1186/s12875-015-0333-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Statista.com. Mobile App Usage- etc. 2015 [11/01/2016]. Available from: http://www.statista.com/topics/1002/mobile-app-usage/.
- 3.Bundorf MK, Wagner TH, Singer SJ, Baker LC. Who searches the internet for health information? Health Serv Res. 2006;41(3 Pt 1):819–836. doi: 10.1111/j.1475-6773.2006.00510.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Powell J, Inglis N, Ronnie J, Large S. The characteristics and motivations of online health information seekers: cross-sectional survey and qualitative interview study. J Med Internet Res. 2011;13(1):e20. doi: 10.2196/jmir.1600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Kolodychuk NL, Wong M, Chimento G, Adams T, Gastanaduy M, Waddell BS. Web-based patient portal access in an orthopedic adult reconstruction patient population. Arthroplasty today. 2019;5(1):83–87. doi: 10.1016/j.artd.2019.01.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Internet Res. 2014;16(4):e104. doi: 10.2196/jmir.2968. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.El-Gayar O, Timsina P, Nawar N, Eid W. Mobile applications for diabetes self-management: status and potential. J Diabetes Sci Technol. 2013;7(1):247–262. doi: 10.1177/193229681300700130. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Kebede Mihiretu, Schuett Cora, Pischke Claudia. The Role of Continuous Glucose Monitoring, Diabetes Smartphone Applications, and Self-Care Behavior in Glycemic Control: Results of a Multi-National Online Survey. Journal of Clinical Medicine. 2019;8(1):109. doi: 10.3390/jcm8010109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Lim C, Berry A, Hirsch T, Hartzler AH, Wagner E, Ludman E, et al. “It just seems outside my health”: How Patients with Chronic Conditions Perceive Communication Boundaries with Providers. 2016. [DOI] [PMC free article] [PubMed]
- 10.Skar L, Soderberg S. Patients' complaints regarding healthcare encounters and communication. Nurs Open. 2018;5(2):224–232. doi: 10.1002/nop2.132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Goldzweig CL, Orshansky G, Paige NM, Towfigh AA, Haggstrom DA, Miake-Lye I, et al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med. 2013;159(10):677–687. doi: 10.7326/0003-4819-159-10-201311190-00006. [DOI] [PubMed] [Google Scholar]
- 12.Ricciardi L, Mostashari F, Murphy J, Daniel JG, Siminerio EP. A national action plan to support consumer engagement via e-health. Health Aff (Millwood) 2013;32(2):376–384. doi: 10.1377/hlthaff.2012.1216. [DOI] [PubMed] [Google Scholar]
- 13.Dendere R, Slade C, Burton-Jones A, Sullivan C, Staib A, Janda M. Patient portals facilitating engagement with inpatient electronic medical records: a systematic review. J Med Internet Res. 2019;21(4):e12779. doi: 10.2196/12779. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Beaudoin DE, Rocha RA, Tse T. Enhancing access to patient education information: a pilot usability study. AMIA Annu Symp Proc. 2005;892. [PMC free article] [PubMed]
- 15.Kupchunas WR. Personal health record: new opportunity for patient education. Orthop Nurs. 2007;26(3):185–191. doi: 10.1097/01.NOR.0000276971.86937.c4. [DOI] [PubMed] [Google Scholar]
- 16.Leveille SG, Huang A, Tsai SB, Allen M, Weingart SN, Iezzoni LI. Health coaching via an internet portal for primary care patients with chronic conditions: a randomized controlled trial. Med Care. 2009;47(1):41–47. doi: 10.1097/MLR.0b013e3181844dd0. [DOI] [PubMed] [Google Scholar]
- 17.Ammenwerth Elske, Schnell-Inderst Petra, Hoerbst Alexander. The Impact of Electronic Patient Portals on Patient Care: A Systematic Review of Controlled Trials. Journal of Medical Internet Research. 2012;14(6):e162. doi: 10.2196/jmir.2238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Coughlin SS, Prochaska JJ, Williams LB, Besenyi GM, Heboyan V, Goggans DS, et al. Patient web portals, disease management, and primary prevention. Risk Manage Healthc Policy. 2017;10:33. doi: 10.2147/RMHP.S130431. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Jhamb M, Cavanaugh KL, Bian A, Chen G, Ikizler TA, Unruh ML, et al. Disparities in electronic health record patient portal use in nephrology clinics. Clin J Am Soc Nephrol. 2015:CJN. 01640215. [DOI] [PMC free article] [PubMed]
- 20.Kruse Clemens Scott, Argueta Darcy A, Lopez Lynsey, Nair Anju. Patient and Provider Attitudes Toward the Use of Patient Portals for the Management of Chronic Disease: A Systematic Review. Journal of Medical Internet Research. 2015;17(2):e40. doi: 10.2196/jmir.3703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Sarkar U, Karter AJ, Liu JY, Adler NE, Nguyen R, Lopez A, et al. Social disparities in internet patient portal use in diabetes: evidence that the digital divide extends beyond access. JAMIA. 2011;18(3):318–321. doi: 10.1136/jamia.2010.006015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Demiris G, Afrin LB, Speedie S, Courtney KL, Sondhi M, Vimarlund V, et al. Patient-centered applications: use of information technology to promote disease management and wellness. A white paper by the AMIA knowledge in motion working group. JAMIA. 2008;15(1):8–13. doi: 10.1197/jamia.M2492. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kaelber DC, Jha AK, Johnston D, Middleton B, Bates DW. A research agenda for personal health records (PHRs) JAMIA. 2008;15(6):729–736. doi: 10.1197/jamia.M2547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Luzio S, Piehlmeier W, Tovar C, Eberl S, Lätzsch G, Fallböhmer E, et al. Results of the pilot study of DIADEM—A comprehensive disease management programme for type 2 diabetes. Diabetes Res Clin Pract. 2007;76(3):410–417. doi: 10.1016/j.diabres.2006.09.025. [DOI] [PubMed] [Google Scholar]
- 25.Kruse CS, Argueta DA, Lopez L, Nair A. Patient and provider attitudes toward the use of patient portals for the management of chronic disease: a systematic review. J Med Internet Res. 2015;17(2):e40. doi: 10.2196/jmir.3703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Neuner J, Fedders M, Caravella M, Bradford L, Schapira M. Meaningful use and the patient portal: patient enrollment, use, and satisfaction with patient portals at a later-adopting center. Am J Med Qual. 2015;30(2):105–113. doi: 10.1177/1062860614523488. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Turvey C, Klein D, Fix G, Hogan TP, Woods S, Simon SR, et al. Blue button use by patients to access and share health record information using the Department of Veterans Affairs' online patient portal. J Am Med Inform Assoc. 2014;21(4):657–663. doi: 10.1136/amiajnl-2014-002723. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Goel MS, Brown TL, Williams A, Cooper AJ, Hasnain-Wynia R, Baker DW. Patient reported barriers to enrolling in a patient portal. J Am Med Inform Assoc. 2011;18(Supplement_1):i8–i12. doi: 10.1136/amiajnl-2011-000473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Goel MS, Brown TL, Williams A, Hasnain-Wynia R, Thompson JA, Baker DW. Disparities in enrollment and use of an electronic patient portal. J Gen Intern Med. 2011;26(10):1112–1116. doi: 10.1007/s11606-011-1728-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Irizarry Taya, DeVito Dabbs Annette, Curran Christine R. Patient Portals and Patient Engagement: A State of the Science Review. Journal of Medical Internet Research. 2015;17(6):e148. doi: 10.2196/jmir.4255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Smith SG, O’conor R, Aitken W, Curtis LM, Wolf MS, Goel MS. Disparities in registration and use of an online patient portal among older adults: findings from the LitCog cohort. J Am Med Inform Assoc. 2015;22(4):888–895. doi: 10.1093/jamia/ocv025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Tieu Lina, Sarkar Urmimala, Schillinger Dean, Ralston James D, Ratanawongsa Neda, Pasick Rena, Lyles Courtney R. Barriers and Facilitators to Online Portal Use Among Patients and Caregivers in a Safety Net Health Care System: A Qualitative Study. Journal of Medical Internet Research. 2015;17(12):e275. doi: 10.2196/jmir.4847. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Zhao JY, Song B, Anand E, Schwartz D, Panesar M, Jackson GP, et al. Barriers, facilitators, and solutions to optimal patient portal and personal health record use: a systematic review of the literature. AMIA Annu Symp Proc. 2017;2017:1913–1922. [PMC free article] [PubMed] [Google Scholar]
- 34.Gordon Nancy P, Hornbrook Mark C. Differences in Access to and Preferences for Using Patient Portals and Other eHealth Technologies Based on Race, Ethnicity, and Age: A Database and Survey Study of Seniors in a Large Health Plan. Journal of Medical Internet Research. 2016;18(3):e50. doi: 10.2196/jmir.5105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Sarkar U, Karter AJ, Liu JY, Adler NE, Nguyen R, Lopez A, et al. The literacy divide: health literacy and the use of an internet-based patient portal in an integrated health system-results from the diabetes study of northern California (DISTANCE) J Health Commun. 2010;15(Suppl 2):183–196. doi: 10.1080/10810730.2010.499988. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.An JY. Theory development in health care informatics: information and communication technology acceptance model (ICTAM) improves the explanatory and predictive power of technology acceptance models. Stud Health Technol Inform. 2006;122:63–67. [PubMed] [Google Scholar]
- 37.Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. Mis Quart. 1989;13(3):319–340. doi: 10.2307/249008. [DOI] [Google Scholar]
- 38.McKibbon KA, Lokker C, Handler SM, Dolovich LR, Holbrook AM, O'Reilly D, et al. Enabling medication management through health information technology (Health IT). Evid Rep Technol Assess (Full Rep). 2011;(201):1–951. [PMC free article] [PubMed]
- 39.Or CK, Karsh BT. A systematic review of patient acceptance of consumer health information technology. JAMIA. 2009;16(4):550–560. doi: 10.1197/jamia.M2888. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Peek ST, Wouters EJ, van Hoof J, Luijkx KG, Boeije HR, Vrijhoef HJ. Factors influencing acceptance of technology for aging in place: a systematic review. Int J Med Inform. 2014;83(4):235–248. doi: 10.1016/j.ijmedinf.2014.01.004. [DOI] [PubMed] [Google Scholar]
- 41.Samaradiwakara G, Gunawardena C. Comparison of existing technology acceptance theories and models to suggest a well improved theory/model. Int Tech Sci J. 2014;1(1):21–36. [Google Scholar]
- 42.Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Manag Sci. 1989;35(8):982–1003. doi: 10.1287/mnsc.35.8.982. [DOI] [Google Scholar]
- 43.Kripanont N. Examining a technology acceptance model of internet usage by academics within Thai business schools: Victoria University. 2007. [Google Scholar]
- 44.Venkatesh, Morris, Davis, Davis User Acceptance of Information Technology: Toward a Unified View. MIS Quarterly. 2003;27(3):425. doi: 10.2307/30036540. [DOI] [Google Scholar]
- 45.Taylor S, Todd PA. Understanding information technology usage: a test of competing models. Inf Syst Res. 1995;6(2):144–176. doi: 10.1287/isre.6.2.144. [DOI] [Google Scholar]
- 46.Access PO. Patient online Access 2016 [cited 2016. Available from: http://myrecord.org.uk.
- 47.Andrews L, Gajanayake R, Sahama T. The Australian general public's perceptions of having a personally controlled electronic health record (PCEHR) Int J Med Inform. 2014;83(12):889–900. doi: 10.1016/j.ijmedinf.2014.08.002. [DOI] [PubMed] [Google Scholar]
- 48.Archer N, Fevrier-Thomas U, Lokker C, McKibbon KA, Straus SE. Personal health records: a scoping review. JAMIA. 2011;18(4):515–522. doi: 10.1136/amiajnl-2011-000105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Hagglund M, Koch S. Commentary: Sweden rolls out online access to medical records and is developing new e-health services to enable people to manage their care. BMJ. 2015;350:h359. doi: 10.1136/bmj.h359. [DOI] [PubMed] [Google Scholar]
- 50.Borycki E, Househ F, Kushniruk A, Nohr C, Takeda H. Empowering patients: making health information and systems safer for patients and the public. Yearbook Med Inform. 2012;21(01):56–64. doi: 10.1055/s-0038-1639431. [DOI] [PubMed] [Google Scholar]
- 51.Rimpilainen S. A review of electronic health records systems around the world. 2015. [Google Scholar]
- 52.Rasmi M, Alazzam MB, Alsmadi MK, Almarashdeh IA, Alkhasawneh RA, Alsmadi S. Healthcare professionals’ acceptance electronic health records system: critical literature review (Jordan case study). Int J Healthc Manag. 2018:1–13.
- 53.Bodolica V, Spraggon M. Toward patient-centered care and inclusive health-care governance: a review of patient empowerment in the UAE. Public Health. 2019;169:114–124. doi: 10.1016/j.puhe.2019.01.017. [DOI] [PubMed] [Google Scholar]
- 54.Weber AS, Turjoman R, Shaheen Y, Al Sayyed F, Hwang MJ, Malick F. Systematic thematic review of e-health research in the Gulf cooperation council (Arabian gulf): Bahrain, Kuwait, Oman, Qatar, Saudi Arabia and United Arab Emirates. J Telemed Telecare. 2016;23(4):452–459. doi: 10.1177/1357633X16647894. [DOI] [PubMed] [Google Scholar]
- 55.Lakkis NA, Mahmassani DM, Hamadeh GN. Diabetes quality of care at a university community in Beirut. J Eval Clin Pract. 2015;21(5):824–830. doi: 10.1111/jep.12386. [DOI] [PubMed] [Google Scholar]
- 56.Mensing C, Boucher J, Cypress M, Weinger K, Mulcahy K, Barta P, et al. National standards for diabetes self-management education. Diabetes Care. 2006;29(Suppl 1):S78–S85. [PubMed] [Google Scholar]
- 57.Alexander CS, Becker HJ. The use of vignettes in survey research. Public Opin Q. 1978;42(1):93–104. doi: 10.1086/268432. [DOI] [Google Scholar]
- 58.Cavanagh GF, Fritzsche DJ. Using vignettes in business ethics research. 1985. [Google Scholar]
- 59.Lysonski S, Gaidis W. A cross-cultural comparison of the ethics of business students. J Bus Ethics. 1991;10(2):141–150. doi: 10.1007/BF00383617. [DOI] [Google Scholar]
- 60.Weber J. Scenarios in business ethics research: review, critical assessment, and recommendations. Bus Ethics Q. 1992;2(2):137–160. doi: 10.2307/3857568. [DOI] [Google Scholar]
- 61.Evans SC, Roberts MC, Keeley JW, Blossom JB, Amaro CM, Garcia AM, et al. Vignette methodologies for studying clinicians' decision-making: validity, utility, and application in ICD-11 field studies. Int J Clin Hlth Psyc. 2015;15(2):160–170. doi: 10.1016/j.ijchp.2014.12.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Tsang S, Royse CF, Terkawi AS. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi J Anaesth. 2017;11(Suppl 1):S80–Ss9. doi: 10.4103/sja.SJA_203_17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Anderson JC, Gerbing DW. The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika. 1984;49(2):155–173. doi: 10.1007/BF02294170. [DOI] [Google Scholar]
- 64.Ding L, Velicer WF, Harlow LL. Effects of estimation methods, number of indicators per factor, and improper solutions on structural equation modeling fit indices. Struct Equ Model Multidiscip J. 1995;2(2):119–143. doi: 10.1080/10705519509540000. [DOI] [Google Scholar]
- 65.Tabachnick BG, Fidell LS, Ullman JB. Using multivariate statistics: Pearson Boston, MA. 2007. [Google Scholar]
- 66.Tinsley HE, Tinsley DJ. Uses of factor analysis in counseling psychology research. J Couns Psychol. 1987;34(4):414. doi: 10.1037/0022-0167.34.4.414. [DOI] [Google Scholar]
- 67.IBMCorp. IBM SPSS Statistics for Windows, version 24.0. IBM Corp:. Armonk, NY, USA. 2016.
- 68.Arbuckle JL. IBM SPSS Amos 21. Chicago, IL: Amos Development Corporation; 2012. [Google Scholar]
- 69.Hair JF, Anderson RE, Babin BJ, Black WC. Multivariate data analysis: a global perspective (Vol. 7). Upper Saddle River, NJ: Pearson; 2010.
- 70.von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. STROBE initiative. The Strengthening the reporting of observational studies in epidemiology (STROBE)statement: guidelines for reporting observational studies. J Clin Epidemiol. 2008;61(4):344–349. doi: 10.1016/j.jclinepi.2007.11.008. [DOI] [PubMed] [Google Scholar]
- 71.Kelly MM, Dean SM, Carayon P, Wetterneck TB, Hoonakker PL. Healthcare team perceptions of a portal for parents of hospitalized children before and after implementation. Appl Clin Inform. 2017;26(01):265–278. doi: 10.4338/ACI-2016-11-RA-0194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Hadhri W, Arvanitis R, M’Henni H. Determinants of innovation activities in small and open economies: the Lebanese business sector. J Innov Econ Manag. 2016;3:77–107. doi: 10.3917/jie.021.0077. [DOI] [Google Scholar]
- 73.El Mustapha H, Hoppe T, Bressers H. Consumer renewable energy technology adoption decision-making; comparing models on perceived attributes and attitudinal constructs in the case of solar water heaters in Lebanon. 2017. 347–357 p.
- 74.Makarem NN, Antoun J. Email communication in a developing country: different family physician and patient perspectives. Libyan J Med. 2016;11(1):32679. doi: 10.3402/ljm.v11.32679. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Al-Adwan A Understanding Physicians’ Adoption of EMR: An Extended Technology Acceptance Model the Case of: Jordan. 2013.
- 76.Ahlers-Schmidt CR, Nguyen M. Parent intention to use a patient portal as related to their children following a facilitated demonstration. Telemed E-Health. 2013;19(12):979–981. doi: 10.1089/tmj.2013.0041. [DOI] [PubMed] [Google Scholar]
- 77.Haun JN, Patel NR, Lind JD, Antinori N. Large-scale survey findings inform patients’ experiences in using secure messaging to engage in patient-provider communication and self-care management: a quantitative assessment. J Med Internet Res. 2015;17(12):e282. doi: 10.2196/jmir.5152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Belcher T, Vess J, Johnson E. Using patient portal messaging to improve glycemic control in adult patients with diabetes in Saudi Arabia. OJNI. 2019;23(1).
- 79.Dajani D, Yaseen SG. The applicability of technology acceptance models in the Arab business setting. J Bus Retail Manage Res. 2016;10(3).
- 80.Wang DS, Jani AB, Sesay M, Tai CG, Lee DK, Echt KV, et al. Video-based educational tool improves patient comprehension of common prostate health terminology. Cancer. 2015;121(5):733–740. doi: 10.1002/cncr.29101. [DOI] [PubMed] [Google Scholar]
- 81.Noblin AM, Wan TT, Fottler M. Intention to use a personal health record: a theoretical analysis using the technology acceptance model. Int J Healthc Technol Manag. 2013;14(1–2):73–89. doi: 10.1504/IJHTM.2013.055085. [DOI] [Google Scholar]
- 82.Silvestre A-L, Sue VM, Allen JY. If you build it, will they come? The Kaiser Permanente model of online health care. Health Aff. 2009;28(2):334–344. doi: 10.1377/hlthaff.28.2.334. [DOI] [PubMed] [Google Scholar]
- 83.Tavares J, Oliveira T. New integrated model approach to understand the factors that drive electronic health record portal adoption: cross-sectional National Survey. J Med Internet Res. 2018;20(11):e11032. doi: 10.2196/11032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Ward K, Hawthorne K. Do patients read health promotion posters in the waiting room? A study in one general practice. Br J Gen Pract. 1994;44(389):583–585. [PMC free article] [PubMed] [Google Scholar]
- 85.Saleem JJ, Patterson ES, Militello L, Render ML, Orshansky G, Asch SM. Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc. 2005;12(4):438–447. doi: 10.1197/jamia.M1777. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Shaw RJ, Horvath MM, Leonard D, Ferranti JM, Johnson CM. Developing a user-friendly interface for a self-service healthcare research portal: cost-effective usability testing. Health Syst. 2015;4(2):151–158. doi: 10.1057/hs.2014.26. [DOI] [Google Scholar]
- 87.Lazard AJ, Watkins I, Mackert MS, Xie B, Stephens KK, Shalev H. Design simplicity influences patient portal use: the role of aesthetic evaluations for technology acceptance. JAMIA. 2016;23(e1):e157–ee61. doi: 10.1093/jamia/ocv174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Latulipe C, Gatto A, Nguyen HT, Miller DP, Quandt SA, Bertoni AG, et al, editors. Design considerations for patient portal adoption by low-income, older adults. Proc 33rd Ann ACM Conf Hum Factors Comput Syst; 2015: ACM. [DOI] [PMC free article] [PubMed]
- 89.Kruse CS, Bolton K, Freriks G. The effect of patient portals on quality outcomes and its implications to meaningful use: a systematic review. J Med Internet Res. 2015;17(2):e44. doi: 10.2196/jmir.3171. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Cho AH, Arar NH, Edelman DE, Hartwell PH, Oddone EZ, Yancy WS., Jr Do diabetic veterans use the internet? Self-reported usage, skills, and interest in using my HealtheVet web portal. Telemed e-Health. 2010;16(5):595–602. doi: 10.1089/tmj.2009.0164. [DOI] [PubMed] [Google Scholar]
- 91.Alpert JM, Desens L, Krist AH, Aycock RA, Kreps GL. Measuring health literacy levels of a patient portal using the CDC's clear communication index. Health Promot Pract. 2017;18(1):140–149. doi: 10.1177/1524839916643703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Davis TC, Williams MV, Marin E, Parker RM, Glass J. Health literacy and cancer communication. CA Cancer J Clin. 2002;52(3):134–149. doi: 10.3322/canjclin.52.3.134. [DOI] [PubMed] [Google Scholar]
- 93.Kreps GL, Neuhauser L. New directions in eHealth communication: opportunities and challenges. Patient Educ Couns. 2010;78(3):329–336. doi: 10.1016/j.pec.2010.01.013. [DOI] [PubMed] [Google Scholar]
- 94.Powell KR. Patient-perceived facilitators of and barriers to electronic portal use: a systematic review. CIN. 2017;35(11):565–573. doi: 10.1097/CIN.0000000000000377. [DOI] [PubMed] [Google Scholar]
- 95.Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.