Abstract
Background
In England, almost all general practices (GPs) have implemented GP online services such as electronic personal health records (ePHRs) that allow people to schedule appointments, request repeat prescriptions, and access parts of their medical records. The overall adoption rate of GP online services has been low, reaching just 28% in October 2019. In a previous study, Abd-Alrazaq et al adopted a model to assess the factors that influence patients’ use of GP online services in England. According to the previous literature, the predictive power of the Abd-Alrazaq model could be improved by proposing new associations between the existing variables in the model.
Objective
This study aims to improve the predictive power of the Abd-Alrazaq model by proposing new relationships between the existing variables in the model.
Methods
The Abd-Alrazaq model was amended by proposing new direct, mediating, moderating, and moderated mediating effects. The amended model was examined using data from a previous study, which were collected by a cross-sectional survey of a convenience sample of 4 GPs in West Yorkshire, England. Structural equation modeling was used to examine the theoretical model and hypotheses.
Results
The new model accounted for 53% of the variance in performance expectancy (PE), 76% of the variance in behavioral intention (BI), and 49% of the variance in use behavior (UB). In addition to the significant associations found in the previous study, this study found that social influence (SI) and facilitating conditions (FCs) are associated with PE directly and BI indirectly through PE. The association between BI and UB was stronger for younger women with higher levels of education, income, and internet access. The indirect effects of effort expectancy (EE), perceived privacy and security (PPS), and SI on BI were statistically stronger for women without internet access, patients with internet access, and patients without internet access, respectively. The indirect effect of PPS on BI was stronger for patients with college education or diploma than for those with secondary school education and lower, whereas the indirect effect of EE on BI was stronger for patients with secondary school education or lower than for those with college education or a diploma.
Conclusions
The predictive power of the Abd-Alrazaq model improved by virtue of new significant associations that were not examined before in the context of ePHRs. Further studies are required to validate the new model in different contexts and to improve its predictive power by proposing new variables. The influential factors found in this study should be considered to improve patients’ use of ePHRs.
Keywords: health records, personal; patient portal; medical informatics
Introduction
Background
An electronic personal health record (ePHR) has been defined by the Markle Foundation as “an electronic application through which individuals can access, manage and share their health information, and that of others for whom they are authorized, in a private, secure and confidential environment” [1]. Several services can also be provided by more advanced ePHRs, such as requesting repeat prescriptions, booking appointments, viewing test results, and messaging providers [2-4]. ePHRs have the potential to empower patients [5,6], improve patient self-management and medication adherence [7,8], enhance the rapport and communication between patients and health care providers [9,10], ease access to health services [11,12], avoid duplicated tests and medical images [9,11], and decrease adverse events [4,9,11,13].
In England, almost all general practices (GPs) have implemented GP online services, that is, ePHRs that allow people to schedule appointments, request repeat prescriptions, and access coded information in their medical records, such as demographics, medications, allergies, and test results [14]. The number of providers offering GP online services is growing [15].
Research Problems and Aims
Despite the aforementioned potential benefits of ePHRs, the overall adoption rate of GP online services has been low, reaching just 28% in October 2019 [16]. To improve the adoption and implementation of ePHRs, it is important to identify the factors that influence individuals’ use of the system [17-23]. A recent systematic review of 97 studies found that more than 150 factors could affect patients’ acceptance and adoption of ePHRs [24]. Unfortunately, none of these studies were carried out in the United Kingdom and included a number of shortcomings, namely, few studies were theory based [21,25-28], many focused on factors affecting patients’ intention to use ePHRs instead of actual use [29-32], many assessed factors affecting self-reported use rather than actual use [28,33-36], almost all examined independent and dependent variables at one point in time using the same data collection instrument and were therefore at risk of common method bias [26,33,37], and almost all the studies did not differentiate between factors affecting initial use and continuing use of ePHRs. Therefore, Abd-Alrazaq et al [38] conducted a cross-sectional survey to assess the factors that influence patients’ use of ePHRs in England. The study identified several significant factors (performance expectancy [PE], effort expectancy [EE], perceived privacy and security [PPS], behavioral intention [BI], and some moderators), which were able to predict 48% of the variance in use behavior (UB). On the basis of previous research, we propose an amended model that we expect will predict UB more accurately. This study aims to improve the predictive power of the Abd-Alrazaq model by proposing new relationships between the variables existing in the model.
Theoretical Foundation
In a previous study [38], the Unified Theory of Acceptance and Use of Technology (UTAUT) [39] was selected from 12 models as the theoretical foundation. The selection process was based on 6 predefined criteria: 4 criteria related to the goodness of the theory (ie, logical consistency, explanatory power, falsifiability, and parsimony), and 2 criteria related to the applicability of the theory on the phenomena of interest (ie, population and type of behavior). Multimedia Appendix 1 [27,29,37,39-65] elaborates on the selection process of the appropriate theory. Abd-Alrazaq et al [38] adapted UTAUT to the context of ePHRs by removing experience and voluntariness and adding PPS, education, income, and internet access to the model (Multimedia Appendix 2). Their justifications for these adaptations are provided in Multimedia Appendix 3.
Given that the study did not find a significant association between social influence (SI) and BI, the authors recommended that researchers examine other associations of SI [38]. Several studies have found that SI positively affects PE [66-68]. In other words, individuals who perceive that using technology is recommended by those important to them are more likely to perceive that the technology is useful. Therefore, this study proposes that SI directly affects PE and indirectly affects BI through PE.
The 2019 Abd-Alrazaq model [38] could be criticized for failing to hypothesize that facilitating conditions (FCs) are associated with BI. This argument is in line with the findings of Venkatesh et al [69], who proposed this relationship in the extended Unified Theory of Acceptance and Use of Technology (UTAUT2) framework, which is suitable for the consumer context [69]. Several studies have found that FCs are also associated with PE [70-72]. Accordingly, this study proposed that FCs directly affect both PE and BI and indirectly affect BI through PE.
The study by Abd-Alrazaq et al [38] also highlighted the need to assess the effect of moderators on indirect relationships (ie, moderated mediation) in the context of ePHRs. To address this recommendation, this study hypothesized that all mediating effects are moderated by sex, education, income, and internet access. To the best of our knowledge, no studies have assessed the moderating effects of these variables on the relationship between BI and UB. Thus, we explored the moderating effect of age, sex, education, income, and internet access on the relationship between BI and UB. Our proposed model and hypotheses are presented in Figure 1 and Table 1, respectively. The conceptual definitions of the constructs in the proposed model are presented in Multimedia Appendix 4.
Table 1.
Hypothesis # | Hypothesis |
H1 | PPSa positively affects PEb. |
H2 | PPS positively affects BIc. |
H3 | PPS indirectly and positively affects BI through PE. |
H4 | The positive relationship between PPS and PE is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a higher level of education and lower income and with internet access. |
H5 | The positive relationship between PPS and BI is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a higher level of education and lower income and with internet access. |
H6 | The indirect effect of PPS on BI is moderated by sex, education, income, and internet access, such that the influence is stronger for women with a higher level of education and lower income and with internet access. |
H7 | EEd positively affects PE. |
H8 | EE positively affects BI. |
H9 | EE indirectly and positively affects BI through PE. |
H10 | The positive relationship between EE and PE is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and without internet access. |
H11 | The positive relationship between EE and BI is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and without internet access. |
H12 | The indirect effect of EE on BI is moderated by sex, education, income, and internet access, such that the influence is stronger for women with a lower level of education and income and without internet access. |
H13 | SIe positively affects PE. |
H14 | SI indirectly and positively affects BI through PE. |
H15 | The positive relationship between SI and PE is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and with internet access. |
H16 | The indirect effect of SI on BI is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and with internet access. |
H17 | FCsf positively affect PE. |
H18 | FCs positively affect BI. |
H19 | FCs positively affect UBg. |
H20 | FCs indirectly and positively affect BI through PE. |
H21 | The positive relationship between FCs and PE is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and without internet access. |
H22 | The positive relationship between FCs and BI is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and without internet access. |
H23 | The positive relationship between FCs and UB is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and without internet access. |
H24 | The indirect effect of FCs on BI is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and without internet access. |
H25 | The indirect effect of FCs on UB is moderated by age, sex, education, income, and internet access, such that the influence is stronger for older women with a lower level of education and income and without internet access. |
H26 | PE positively affects BI. |
H27 | The positive relationship between PE and BI is moderated by age and sex, such that the influence is stronger for younger men with a lower level of education, higher income, and internet access |
H28 | BI positively affects UB. |
H29 | The positive relationship between BI and UB is moderated by age, sex, education, income, and internet access, such that the influence is stronger for younger women with a higher level of education and income and with internet access. |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
gUB: use behavior.
Methods
Study Design and Setting
This study used secondary data analysis from data collected by Abd-Alrazaq et al [38] using a cross-sectional survey of 4 West Yorkshire GPs (Multimedia Appendix 5). Health Research Authority approval was granted before starting data collection (REC reference: 17/SC/0323).
Measurement
All variables except UB were measured using self-administered questionnaires. The questionnaires were composed of 29 questions adopted from previous research (Multimedia Appendix 6). A panel of experts evaluated the face validity and content validity of the questions, and based on their suggestions, the questionnaire was amended and sent via email to 37 patients for pilot testing. The questionnaire was subsequently amended slightly because of the issues reported by patients (Multimedia Appendix 7). UB was measured objectively using system logs by extracting data on the number of times that each participant logged into the system during the 6 months after completing the questionnaire. One open-ended question was added to the questionnaire to obtain qualitative data that enabled the exploration of additional factors. The qualitative data were analyzed using thematic analysis, and the results have been reported elsewhere.
Recruitment
A convenience sampling approach was used to recruit patients. Patients were eligible to participate if they were living in England, were registered at 1 of the 4 GP practices, were aged 18 years or older, and had not used GP online services before (nonusers). The questionnaire was delivered to eligible participants visiting 1 of the 4 GP practices during the study period. Data on participants’ use of GP online services were extracted from the system logs after 6 months of completing the questionnaire.
Statistical Analysis
Before assessing the proposed model, it is a prerequisite to check normality [73,74], linearity [73], multicollinearity [73], and common method bias [75,76]. Univariate normality was examined by assessing skewness and kurtosis [73,77]. This study checked the linearity between each proposed relationship using scatterplot graphs [73] and the curve estimation procedure [78]. Multicollinearity was assessed in this study using tolerance, which refers to the proportion of the variability of one predictor that is unexplained by other predictors [73,77]. We checked the common method bias using Harman single-factor test [75]. All the aforementioned analyses were carried out using SPSS v.22 (IBM).
The theoretical model and hypotheses were examined using structural equation modeling (SEM). In SEM, models consist of 2 elements: a measurement model in which the relationships between observed variables and latent variables are examined, and a structural model in which the relationships proposed among the latent variables are assessed [73,79]. Although the measurement model in this study is identical to the original study [38], it was reassessed just for the sake of completeness. The measurement model was examined in terms of 3 aspects: model fit, construct reliability, and construct validity [73,77]. The structural model was then assessed for model fit, predictive power, and strength of relationships [77,79,80]. The strength of relationships was tested using different approaches depending on the type of the proposed effect. To be more precise, path coefficients were checked to examine direct effects [81]. Mediating effects were examined by assessing the indirect effects of using bootstrapping. The moderating effect for the metric moderator (ie, age) was examined using the interaction effect method [73,82]. The moderating effects for the nonmetric moderator (sex) were tested using multigroup SEM [73,74,82]. Moderated mediating effects were assessed using multigroup SEM for indirect effects. All analyses were conducted using the Analysis of Moment Structures v.24 (IBM) software.
Results
Participants’ Characteristics
The response rate was 78.0% (624/800). As shown in Multimedia Appendix 8, the mean age of participants was 44.2 (SD 1.89) years. Most participants were White (498/624, 79.8%) and had internet access (528/624, 84.6%). About half of the sample (284/624, 45.5%) had an income level of less than US $25,000 per year. The most prominent education levels among respondents were bachelor’s degrees (174/624, 27.9%), college or diploma (165/624, 26.4%), and secondary school (147/624, 23.6%). There were no significant differences between participants and the target population in terms of age, sex, and ethnicity (P=.21, P=.06, and P=.64, respectively; Multimedia Appendix 8). Thus, the risk of nonresponse bias is minimal.
Normality, Linearity, Multicollinearity, and Common Method Bias
Histograms presented in Multimedia Appendix 9 show no severe skewness and kurtosis for all items. This finding was confirmed by the absolute values of skewness and kurtosis, which were considerably less than the cutoff points of 3 and 10, respectively [77] (Multimedia Appendix 10).
According to the scatterplots shown in Multimedia Appendix 11, there was an indication of possible nonlinearity for only 2 relationships: the effect of BI and FCs on UB. However, the results of the curve estimation procedure showed that the F values for all proposed relationships in the linear model were significant and higher than the F values of the proposed relationships in the 10 nonlinear models, indicating that all proposed relationships between variables are linear (Multimedia Appendix 12).
As shown in Multimedia Appendix 13, all values of tolerance are within the predetermined cutoff point (≥0.2) [83], indicating that there is no serious multicollinearity between independent variables.
With regard to the common method bias, 5 factors emerged from the Harman single-factor test; a single factor was able to explain less than half of the variance (47.3%; Multimedia Appendix 14). This means that there are no concerns regarding the presence of the common method bias in this study.
Measurement Model
Model Fit
Nine indices were used to assess the absolute model fit (chi-square/df, goodness-of-fit index, adjusted goodness-of-fit index, root mean square error of approximation, p of Close Fit, and standardized root mean square residual) and incremental fit (normed-fit index, comparative fit index, and Tucker-Lewis index) [73,77]. Given that the measurement model in this study is identical to the modified measurement model in the original study, the results of the fit indices were the same between the 2 studies and were within their suggested levels (Multimedia Appendix 15). This indicates that the measurement model adequately fits the collected data.
Construct Reliability
Three measures were used to assess the construct reliability: Cronbach alpha (α), composite reliability (CR), and average variance extracted (AVE). Yielded values of α, CR, and AVE for each construct were within their recommended values of ≥.70, ≥.70, and ≥.50, respectively (Multimedia Appendix 16) [73,77]. This means that the measurement items are consistent and reproducible in measuring what it is assumed to measure.
Construct Validity
Two components of construct validity were examined in this study: convergent validity and discriminant validity [73,77]. The convergent validity was examined by checking factor loadings and the AVE [73]. As shown in Multimedia Appendix 17, the values of factor loading and AVE for all items considerably exceeded the thresholds of .70 and .50, respectively [73]. These results indicate that each item relates strongly to the latent variable that it is assumed to measure.
Discriminant validity was assessed by checking intercorrelation coefficients, comparing the square root of AVE with the intercorrelation coefficients, and comparing loadings and cross-loadings [73,77,81]. Multimedia Appendix 18 shows that the intercorrelation coefficients (off-diagonal values) are located within acceptable ranges (<.85) [84]. Furthermore, each value of the square root of AVE for a construct (values on the diagonal) is higher than all intercorrelation coefficients between that construct and each other construct (Multimedia Appendix 18). As shown in Multimedia Appendix 19, the loading of each item on its construct was higher than the cross-loadings in rows and columns. The results of the three measures indicate that items of each construct are not related to the other constructs that it is not supposed to measure; therefore, the measurement model has acceptable discriminant validity.
Structural Model
Model Fit and Predictive Power
The indices that were used to assess the fit of the measurement model were used again to assess the fit of the structural model. As shown in Multimedia Appendix 20, all fit indices were within the recommended values, indicating that the structural model adequately fits the collected data. The model was able to predict about 0.53 of the variance in PE, 0.76 of the variance in BI, and 0.49 of the variance in UB (Figure 2).
Strengths of Relationships
Direct Effects
As seen in Figure 2 and detailed in Table 2, all proposed direct effects were statistically significant, except for the effect of FCs on BI (β=.05, P=.08). Specifically, PPS was significantly associated with PE (β=.39) and BI (β=.23). The paths from EE to PE and BI were statistically significant (β=.25 and β=.15, respectively). There was a statistically significant relationship between SI and PE (β=.13). FCs were significantly associated with PE (β=.13) and UB (β=.25). The relationship between PE and BI was statistically significant (β=.57). BI and UB were significantly associated (β=.53). To sum up, the following hypotheses were supported: H1, H2, H7, H8, H13, H17, H19, H26, and H28 (Table 2).
Table 2.
Hypothesis # | Path | Standardized estimate (β) | 95% CI | P value |
H1 | PPSa→PEb | .39 | 0.32 to 0.46 | <.001 |
H2 | PPS→BIc | .23 | 0.17 to 0.29 | <.001 |
H7 | EEd→PE | .25 | 0.18 to 0.32 | <.001 |
H8 | EE→BI | .15 | 0.10 to 0.21 | <.001 |
H13 | SIe→PE | .13 | 0.04 to 0.22 | <.001 |
H17 | FCsf→PE | .13 | 0.06 to 0.20 | <.001 |
H18 | FCs→BI | .05 | −0.003 to 0.10 | .08 |
H19 | FCs→UBg | .25 | 0.20 to 0.30 | <.001 |
H26 | PE→BI | .57 | 0.51 to 0.64 | <.001 |
H28 | BI→UB | .53 | 0.47 to 0.58 | <.001 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
gUB: use behavior.
Mediating Effects
With regard to the mediating effects, results showed that PE significantly mediated the effect of PPS, EE, SI, and FCs on BI (β=.22, β=.14, β=.09, and β=.07, respectively; Table 3). Accordingly, H3, H9, H14, and H20 were supported in this study.
Table 3.
Hypothesis # | Indirect effect | Standardized estimate (β) | 95% CI | P value |
H3 | PPSa→PEb→BIc | .22 | 0.18-0.28 | <.001 |
H9 | EEd→PE→BI | .15 | 0.10-0.19 | <.001 |
H14 | SIe→PE→BI | .09 | 0.04-0.14 | <.001 |
H20 | FCsf→PE→BI | .07 | 0.03-0.11 | .002 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Moderating Effects
With respect to the moderating effects, the effect of EE and FCs on BI statistically increased with increasing age (P=.03, P<.001, respectively; Table 4). In contrast, the effect of PE on BI and the effect of BI on UB statistically decreased with increasing age (P<.001, for both moderating effects).
Table 4.
Hypothesis # | Interaction effect | Standardized estimate (β) | P value |
H4 | PPSa×age→PEb | .18 | .66 |
H5 | PPS×age→BIc | −.02 | .25 |
H10 | EEd×age→PE | .14 | .22 |
H11 | EE×age→BI | .05 | .03 |
H15 | SIe×age→PE | .03 | .45 |
H21 | FCsf×age→PE | .21 | .30 |
H22 | FCs×age→BI | .03 | .10 |
H23 | FCs×age→UBg | .16 | <.001 |
H27 | PE×age→BI | −.10 | <.001 |
H29 | BI×age→UB | −.21 | <.001 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
gUB: use behavior.
Concerning the moderating effects of sex, the association between PE and BI was statistically stronger for men than for women (β=.59 vs β=.50, P=.004; Table 5). The path from BI to UB was statistically stronger for women than for men (β=.53 vs β=.03, P=.001).
Table 5.
Hypothesis # | Hypothesized path | Men | Women | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H4 | PPSa→PEb | .41 | <.001 | .32 | <.001 | .81 |
H5 | PPS→BIc | .25 | <.001 | .21 | <.001 | .39 |
H10 | EEd→PE | .22 | <.001 | .26 | <.001 | .12 |
H11 | EE→BI | .17 | <.01 | .17 | <.01 | .19 |
H15 | SIe→PE | .068 | .30 | .17 | <.001 | .09 |
H21 | FCsf→PE | .08 | .23 | .16 | <.01 | .14 |
H22 | FCs→BI | .05 | .35 | .04 | .33 | .86 |
H23 | FCs→UBg | .34 | <.001 | .24 | <.001 | .32 |
H27 | PE→BI | .59 | <.001 | .50 | <.001 | .004 |
H29 | BI→UB | .29 | <.001 | .53 | <.001 | .001 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
gUB: use behavior.
In relation to the moderating effect of education (Tables 6-8), the association between EE and PE was statistically stronger for the “secondary school or lower” group than for the “bachelor or higher” group (β=.31 vs β=.01, P=.049). The association between EE and BI was statistically weaker for the “bachelor or higher” group than for the “secondary school or lower” group (β=−.08 vs β=.13, P=.04) and for the college group (β=−.08 vs β=.12, P=.02; Tables 6-8). The path from FCs to UB was statistically stronger for the “secondary school or lower” group than for the college group (β=.38 vs β=.29, P=.003) and the “bachelor or higher” group (β=.38 vs β=.21, P=.03). The relationship between BI and UB was statistically stronger for the “bachelor or higher” group than for the “secondary school or lower” group (β=.48 vs β=.14, P<.001) and the college group (β=.48 vs β=.39, P=.003). The relationship between BI and UB was statistically stronger for the college group than for the “secondary school or lower” group (β=.39 vs β=.14, P<.001).
Table 6.
Hypothesis # | Hypothesized path | Secondary school or lower | College or diploma | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H4 | PPSa→PEb | .22 | <.001 | .25 | <.001 | .41 |
H5 | PPS→BIc | .15 | .01 | .28 | <.001 | .18 |
H10 | EEd→PE | .31 | <.001 | .14 | .045 | .93 |
H11 | EE→BI | .13 | .02 | .12 | .008 | .43 |
H15 | SIe→PE | .10 | .13 | .14 | .047 | .42 |
H21 | FCsf→PE | .20 | .004 | .07 | .31 | .56 |
H22 | FCs→BI | .05 | .40 | .02 | .64 | .82 |
H23 | FCs→UBg | .38 | <.001 | .29 | <.001 | .003 |
H27 | PE→BI | .55 | <.001 | .62 | <.001 | .53 |
H29 | BI→UB | .14 | .04 | .39 | <.001 | .001 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
gUB: use behavior.
Table 8.
Hypothesis # | Hypothesized path | College or diploma | Bachelor or higher | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H4 | PPSa→PEb | .25 | <.001 | .18 | .03 | .12 |
H5 | PPS→BIc | .28 | <.001 | .28 | <.001 | .19 |
H10 | EEd→PE | .14 | .045 | .01 | .89 | .17 |
H11 | EE→BI | .12 | .008 | −.08 | .20 | .02 |
H15 | SIe→PE | .14 | .047 | .17 | .02 | >.99 |
H21 | FCsf→PE | .07 | .31 | .18 | .02 | .17 |
H22 | FCs→BI | .02 | .64 | .004 | .95 | .91 |
H23 | FCs→UBg | .29 | <.001 | .21 | .002 | .26 |
H27 | PE→BI | .62 | <.001 | .59 | <.001 | .06 |
H29 | BI→UB | .39 | <.001 | .48 | <.001 | .003 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
gUB: use behavior.
Table 7.
Hypothesis # | Hypothesized path | Secondary school or lower | Bachelor or higher | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H4 | PPSa→PEb | .22 | <.001 | .18 | .03 | .98 |
H5 | PPS→BIc | .15 | .01 | .28 | <.001 | .07 |
H10 | EEd→PE | .31 | <.001 | .01 | .89 | .049 |
H11 | EE→BI | .13 | .02 | −.08 | .20 | .04 |
H15 | SIe→PE | .10 | .13 | .17 | .02 | .37 |
H21 | FCsf→PE | .20 | .004 | .18 | .02 | .27 |
H22 | FCs→BI | .05 | .40 | .004 | .95 | .82 |
H23 | FCs→UBg | .38 | <.001 | .21 | .002 | .03 |
H27 | PE→BI | .55 | <.001 | .59 | <.001 | .24 |
H29 | BI→UB | .14 | .04 | .48 | <.001 | .001 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
gUB: use behavior.
As shown in Tables 9-11, the association between FCs and UB was statistically stronger for patients with low-income than for patients with moderate income (β=.42 vs β=.23, P=.04) and higher income (β=.42 vs β=.07, P=.03). The path between FCs and UB was statistically stronger for patients with moderate income and those with high income (β=.23 vs β=.07, P=.003). The relationship between BI and UB was statistically stronger for patients with high income than for those with low income (β=.61 vs β=.43, P=.008) and middle income (β=.61 vs β=.41, P=.03).
Table 9.
Hypothesis # | Hypothesized path | Low incomea | Middle incomeb | P value for chi-square difference test | ||||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
||
H4 | PPSc→PEd | .38 | <.001 | .40 | <.001 | .71 | ||
H5 | PPS→BIe | .24 | <.001 | .27 | <.001 | .91 | ||
H10 | EEf→PE | .18 | <.001 | .32 | <.001 | .07 | ||
H11 | EE→BI | .14 | <.001 | .21 | <.001 | .41 | ||
H15 | SIg→PE | .14 | .006 | .13 | .07 | .98 | ||
H21 | FCsh→PE | .22 | <.001 | .06 | .40 | .43 | ||
H22 | FCs→BI | .08 | .09 | .06 | .31 | .96 | ||
H23 | FCs→UBi | .42 | <.001 | .23 | <.001 | .04 | ||
H27 | PE→BI | .53 | <.001 | .52 | <.001 | .40 | ||
H29 | BI→UB | .43 | <.001 | .41 | <.001 | .87 |
aLow income: <US $25,000.
bMedium income: US $25,000-US $50,999.
cPPS: perceived privacy and security.
dPE: performance expectancy.
eBI: behavioral intention.
fEE: effort expectancy.
gSI: social influence.
hFC: facilitating condition.
iUB: use behavior.
Table 11.
Hypothesis # | Hypothesized path | Middle incomea | High incomeb | P value for chi-square difference test | |||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
|
H4 | PPSc→PEd | .40 | <.001 | .39 | <.001 | .83 | |
H5 | PPS→BIe | .27 | <.001 | .23 | <.001 | .75 | |
H10 | EEf→PE | .32 | <.001 | .24 | .01 | .22 | |
H11 | EE→BI | .21 | <.001 | .09 | .13 | .21 | |
H15 | SIg→PE | .13 | .07 | .19 | .054 | .51 | |
H21 | FCsh→PE | .06 | .40 | −.11 | .29 | .18 | |
H22 | FCs→BI | .06 | .31 | .03 | .63 | .96 | |
H23 | FCs→UBi | .23 | <.001 | .07 | .40 | .003 | |
H27 | PE→BI | .52 | <.001 | .66 | <.001 | .07 | |
H29 | BI→UB | .41 | <.001 | .61 | <.001 | .03 |
aMedium income: US $25,000-US $50,999.
bHigh income: ≥US $51,000.
cPPS: perceived privacy and security.
dPE: performance expectancy.
eBI: behavioral intention.
fEE: effort expectancy.
gSI: social influence.
hFC: facilitating condition.
iUB: use behavior.
Table 10.
Hypothesis # | Hypothesized path | Low incomea | High incomeb | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H4 | PPSc→PEd | .38 | <.001 | .39 | <.001 | .92 |
H5 | PPS→BIe | .24 | <.001 | .23 | <.001 | .81 |
H10 | EEf→PE | .18 | <.001 | .24 | .01 | .60 |
H11 | EE→BI | .14 | <.001 | .09 | .13 | .53 |
H15 | SIg→PE | .14 | .006 | .19 | .054 | .45 |
H21 | FCsh→PE | .22 | <.001 | −.11 | .29 | .06 |
H22 | FCs→BI | .08 | .09 | .03 | .63 | .96 |
H23 | FCs→UBi | .42 | <.001 | .07 | .40 | .03 |
H27 | PE→BI | .53 | <.001 | .66 | <.001 | .12 |
H29 | BI→UB | .43 | <.001 | .61 | <.001 | .008 |
aLow income: <US $25,000.
bHigh income: ≥US $51,000.
cPPS: perceived privacy and security.
dPE: performance expectancy.
eBI: behavioral intention.
fEE: effort expectancy.
gSI: social influence.
hFC: facilitating condition.
iUB: use behavior.
With respect to the moderating effect of internet access (Table 12), the paths EE→BI and FCs→UB were statistically stronger for patients without internet access than for those with internet access (P=.03, P<.001, respectively). In contrast, the paths PE→BI and BI→UB were statistically stronger for patients with internet access than for those without internet access (P=.005 and P=.002, respectively). According to the results of all moderating effects, the following hypotheses were partially supported: H10, H11, H23, H27, and H29.
Table 12.
Hypothesis # | Hypothesized path | Internet access | No internet access | P value for chi-square difference test | ||||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
||
H4 | PPSa→PEb | .40 | <.001 | .35 | <.001 | .68 | ||
H5 | PPS→BIc | .21 | <.001 | .30 | .002 | .93 | ||
H10 | EEd→PE | .25 | <.001 | .24 | .02 | .36 | ||
H11 | EE→BI | .10 | <.001 | .27 | .007 | .03 | ||
H15 | SIe→PE | .14 | <.001 | .07 | .51 | .26 | ||
H21 | FCsf→PE | .12 | .006 | .22 | .06 | .89 | ||
H22 | FCs→BI | .04 | .17 | .07 | .46 | .89 | ||
H23 | FCs→UBg | .20 | .03 | .34 | <.001 | <.001 | ||
H27 | PE→BI | .59 | <.001 | .39 | <.001 | .005 | ||
H29 | BI→UB | .51 | <.001 | .31 | .004 | .002 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFCs: facilitating conditions.
gUB: use behavior.
Moderated Mediating Effects
With regard to the proposed moderated mediations, the indirect effects of EE and SI on BI were statistically stronger for women than for men (P=.03 and P=.01, respectively; Table 13). The indirect effect of PPS on BI was stronger for patients with college or diploma compared with those with secondary school and lower (Tables 14-16). In contrast, the indirect effect of EE on BI was stronger for patients with secondary school or lower than for those with college or diploma (Tables 14-16). There was no moderating effect of income on all indirect effects (Tables 16-19). As shown in Table 20, the indirect effect of PPS on BI is statistically stronger for patients with internet access (P<.001). The indirect effect of EE on BI was statistically stronger for patients without internet access (P=.03). Accordingly, the following hypotheses were partially supported: H6, H12, and H16.
Table 13.
Hypothesis # | Hypothesized path | Men | Women | P value for chi-square difference test | ||||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
||
H6 | PPSa→PEb→BIc | .21 | <.001 | .19 | <.001 | .24 | ||
H12 | EEd→PE→BI | .11 | <.001 | .16 | <.001 | .03 | ||
H16 | SIe→PE→BI | .03 | .18 | .10 | <.001 | .01 | ||
H24 | FCsf→PE→BI | .04 | .23 | .10 | .004 | .06 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Table 14.
Hypothesis # | Hypothesized path | Secondary school or lower | College or diploma | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H6 | PPSa→PEb→BIc | .12 | <.001 | .30 | .002 | .007 |
H12 | EEd→PE→BI | .17 | <.001 | .01 | .90 | .045 |
H16 | SIe→PE→BI | .06 | .11 | .08 | .02 | .45 |
H24 | FCsf→PE→BI | .11 | .007 | .04 | .31 | .49 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Table 16.
Hypothesis # | Hypothesized path | College or diploma | Bachelor or higher | P value for chi-square difference test | ||||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
||
H6 | PPSa→PEb→BIc | .30 | .002 | .11 | .04 | .16 | ||
H12 | EEd→PE→BI | .01 | .90 | .08 | .09 | .16 | ||
H16 | SIe→PE→BI | .08 | .02 | .10 | .03 | .59 | ||
H24 | FCsf→PE→BI | .04 | .31 | .10 | .05 | .14 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Table 19.
Hypothesis # | Hypothesized path | Middle income | High income | P value for chi-square difference test | ||||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
||
H6 | PPSa→PEb→BIc | .21 | <.001 | .27 | .002 | .45 | ||
H12 | EEd→PE→BI | .19 | .002 | .16 | .03 | .84 | ||
H16 | SIe→PE→BI | .07 | .09 | .13 | .04 | .30 | ||
H24 | FCsf→PE→BI | .03 | .37 | −.07 | .22 | .17 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Table 20.
Hypothesis # | Hypothesized path | Internet access | No internet access | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H6 | PPSa→PEb→BIc | .25 | <.001 | .02 | .72 | .001 |
H12 | EEd→PE→BI | .10 | .02 | .15 | <.001 | .03 |
H16 | SIe→PE→BI | .08 | <.001 | .03 | .42 | .06 |
H24 | FCsf→PE→BI | .07 | .004 | .09 | .04 | .54 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Table 15.
Hypothesis # | Hypothesized path | Secondary school or lower | Bachelor or higher | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H6 | PPSa→PEb→BIc | .12 | <.001 | .11 | .04 | .75 |
H12 | EEd→PE→BI | .17 | <.001 | .08 | .09 | .81 |
H16 | SIe→PE→BI | .06 | .11 | .10 | .03 | .27 |
H24 | FCsf→PE→BI | .11 | .007 | .10 | .05 | .26 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Table 17.
Hypothesis # | Hypothesized path | Low income | Middle income | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H6 | PPSa→PEb→BIc | .20 | <.001 | .21 | <.001 | .84 |
H12 | EEd→PE→BI | .10 | <.001 | .19 | .002 | .13 |
H16 | SIe→PE→BI | .07 | .01 | .07 | .09 | .90 |
H24 | FCsf→PE→BI | .12 | .002 | .03 | .37 | .32 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Table 18.
Hypothesis # | Hypothesized path | Low income | High income | P value for chi-square difference test | ||
|
|
Standardized estimate (β) | P value | Standardized estimate (β) | P value |
|
H6 | PPSa→PEb→BIc | .20 | <.001 | .27 | .002 | .56 |
H12 | EEd→PE→BI | .10 | <.001 | .16 | .03 | .37 |
H16 | SIe→PE→BI | .07 | .01 | .13 | .04 | .28 |
H24 | FCsf→PE→BI | .12 | .002 | −.07 | .22 | .06 |
aPPS: perceived privacy and security.
bPE: performance expectancy.
cBI: behavioral intention.
dEE: effort expectancy.
eSI: social influence.
fFC: facilitating condition.
Discussion
Principal Findings
This study aimed to improve the predictive power of a model proposed by Abd-Alrazaq et al [38] by proposing and examining new relationships between the variables existing in that model. The predictive power of the new model was slightly higher than that of the Abd-Alrazaq model for PE (53% vs 51%) and UB (49% vs 48%), but it was exactly the same in both models for BI (76%).
With regard to the direct effects, there was no considerable difference between the new model and the Abd-Alrazaq model for the following paths PE→BI (0.57 vs 0.57), EE→BI (0.15 vs 0.16), PPS→BI (0.23 vs 0.24), FCs→UB (0.25 vs 0.25), and BI→UB (0.53 vs 0.53). Compared with the Abd-Alrazaq model, the current model showed a considerable decrease in the effect of EE (0.25 vs 0.34) and PPS (0.39 vs 0.49) on PE; however, both paths were still significant in the current model. This decrease resulted from proposing 2 new predictors for PE (ie, SI and FCs) in the current model, which were significant. The only direct path that was nonsignificant was FCs→BI in the current model. This finding is in line with the findings of a study conducted by Tavares and Oliveira, who did not find a significant association between FCs and BI to use ePHRs [40]. Venkatsh et al [39] attributed this nonsignificant path to the fact that this effect disappears when a model includes both PE and EE.
Compared with the Abd-Alrazaq model, the current model showed a decrease in the indirect associations between BI and each of EE (0.15 vs 0.20) and PPS (0.22 vs 0.28) through PE. However, both indirect effects are still significant in the current model. This decrease resulted from proposing 2 new predictors for PE (ie, SI and FCs) in the current model. Two new indirect paths were found SI→PE→BI and FCs→PE→BI. This means that patients who perceive that important others believe they should use GP online services are more likely to perceive it as a useful system; therefore, they are more likely to intend to use it. Furthermore, patients who believe that an organizational and technical infrastructure exists to support the use of GP online services are more likely to perceive it as a useful system and are therefore more likely to intend to use it.
All proposed moderating effects that are common between the new model and the Abd-Alrazaq model were comparable between both models. In addition to the significant moderating effects found in the Abd-Alrazaq model, this study found that the association between BI and UB is significantly moderated by age, sex, education, income, and internet access and that the association between EE and PE is moderated by education. Specifically, the association between BI and UB is stronger for younger women with higher levels of education, income, and internet access, and the association between EE and PE is stronger for patients with lower levels of education.
With regard to the moderated mediations proposed in the new model, this study found that the indirect effect of EE on BI through PE was statistically stronger for women without internet access. The indirect effect of PPS on BI was stronger for patients with college education or diploma compared with those with secondary school education and lower, whereas the indirect effect of EE on BI was stronger for patients with secondary school or lower than for those with college education or diplomas. Furthermore, the indirect effect of SI on BI through PE was stronger for patients without internet access. Last but not least, the indirect effect of PPS on BI through PE was statistically stronger for patients with internet access.
Theoretical and Practical Contributions
This study is one of the very few theory-based studies conducted to identify the factors that affect patients’ use of ePHRs or patient portals [21,25-27]. The predictive power of the new model (49%) is higher than that of the previous models proposed in our previous study (48%) and other studies conducted in the context of ePHRs: Tavares and Oliveira (26.8%) [40] and Hsieh (42.7%) [85]. Moreover, the predictive power of the new model is higher than that of the original UTAUT model (48%) [39]. Accordingly, this study contributes to the literature by providing the most predictive model to explain the adoption of ePHRs to date.
To the best of our knowledge, this is the first study in the context of ePHRs that examined the direct effect of SI and FCs on PE, their indirect effects on BI through PE, the moderation effects on the association between BI and UB, and the moderated effects on indirect relationships. This extends our understanding of the complex associations between the factors that affect the adoption of ePHRs.
In addition to the practical contributions reported in the previous study [38], this study provides some contributions based on the newly proposed relationships. People who are important to patients (eg, family members, friends, physicians, and caregivers) can play an important role in enhancing their perceived usefulness of the system and their intention to use it. The influence of these important people is more evident on women than on men. Interventions aimed at increasing the uptake of online access could harness the influence of such individuals to encourage patients to use such services. For example, GPs could prompt the recurrent users of the system to become ePHR champions and speak to their friends or family members about their experiences. GPs could also train practice staff to offer these services to their patients routinely in their communications, and campaigns aimed at increasing ePHR uptake could use social influencing techniques, such as celebrity endorsements. As FCs are directly associated with perceived usefulness of ePHRs, and this, in turn affects BIs, steps should be taken to improve the degree to which patients believe that an organizational and technical infrastructure exists to support their use. For example, the National Health Service app has demonstrated an efficient infrastructure supporting the patient registration process, which enables patients to sign up to access their records online without needing to visit their GP surgery [15]. Instead of registration requiring patients to show evidence of their identity to practice staff, they can instead register by uploading a photograph of identifying documentation and taking a short selfie video on their mobile device. Other potential approaches to targeting FCs include the provision of online educational materials, 24/7 technical support, or drop-in training sessions at GP practices.
Research Limitations
The proposed model was examined using data collected from 4 GP practices that have implemented the same system (SystmOnline); therefore, our findings may not be generalizable to other systems (eg, Patient Access and i-Patient). Nonetheless, the findings may still be applicable to other ePHRs because all participants were nonusers, and these systems offer the same services to the patients. Consequently, participants would be unlikely to have different perceptions of the different systems.
This study focused on the factors that influence the initial use of ePHRs, given that the system is new in England and has a low adoption rate. Thus, the generalizability of the findings in the context of the continuing use of ePHRs is limited. Given that the study used secondary data, it was not possible to assess the effect of new factors, such as those recommended by Abd-Alrazaq et al [38].
Sampling bias may be a concern in this study owing to the convenience sampling technique used to recruit the participants [37,86]. This study showed that there was no statistically significant difference between the participants and nonparticipants in terms of age, sex, and ethnicity. Accordingly, our findings may be generalizable to GPs, similar to the 4 GPs in this study.
Recommendations for Future Research
The applicability of the proposed model to other contexts should be examined in further studies. Specifically, researchers may assess the applicability of the model to other providers of GP online services (eg, Patient Access), specific platforms (eg, mobiles, tablets, and computers), other settings (eg, hospitals), and other cities or countries.
Further studies are required to validate the new significant associations proposed in this study, such as SI→PE, FCs→PE, and SI→PE→BI. In addition, future studies should endeavor to improve the predictive power of the current model by adding other factors such as awareness of the system, health status, perceived severity, patient satisfaction, and patient activation level.
It is well known that the eventual success of information technology depends on continued use more than initial use [33,87-89]. There is a lack of studies that have assessed factors affecting the continuing use of ePHRs or even consumer health information technologies (CHITs). Therefore, we prompt researchers to develop and examine a theoretical model that explains the variables affecting the continuing use of ePHRs and CHITs.
This study did not assess series mediations, such as the indirect effect of EE on UB through PE and BI (ie, EE→PE→BI→UB). Furthermore, to the best of our knowledge, such effects have not been examined in previous studies in the context of ePHRs and CHITs. This highlights a need to assess such effects.
Conclusions
This study slightly improved the predictive power of the Abd-Alrazaq model. More importantly, the improved model showed new significant relationships that were not examined before in the ePHR context, such as the direct effect of SI and FCs on PE, their indirect effects on BI through PE, moderation effect of age, sex, educational level, income, and internet access on the association between BI and UB, and the moderating effects on some indirect relationships. These findings extend our understanding of the complex associations between factors affecting the adoption of ePHRs. The predictive power of 49% indicates that there are other, as yet unidentified, factors that affect the use of ePHRs. Further studies are required to validate the new model in different contexts and to improve its predictive power by proposing new factors. Interventions could focus on the role of significant others (eg, health care professionals, friends, and family members) in influencing web access usage, for example, by discussing the potential benefits of such services with patients.
Acknowledgments
The authors would like to thank Dr Peter Gardner and Dr Tracey Farragher for their supervision during the study and Dr Hamish Fraser for his help in the initial stages of the study, especially for his contribution to the development of the study design and setting up links with practices.
Abbreviations
- AVE
average variance extracted
- BI
behavioral intention
- CHIT
consumer health information technology
- EE
effort expectancy
- ePHR
electronic personal health record
- FC
facilitating condition
- GP
general practice
- H
hypothesis
- PE
performance expectancy
- PPS
perceived privacy and security
- SEM
structural equation modeling
- SI
social influence
- UB
use behavior
- UTAUT
Unified Theory of Acceptance and Use of Technology
Appendix
Selection of theory.
The previous model.
Justification of adaptation of UTAUT.
Conceptual definitions of constructs.
Characteristics of the four general practices.
Measures of constructs.
Questionnaire.
Participants' characteristics.
Histograms.
Values of skewness and kurtosis.
Scatterplot graphs.
Curve estimation procedure.
Tolerance values.
Harman’s single-factor test.
Results of fit indices of the measurement model.
Results of construct reliability.
Results of convergent validity.
Intercorrelation coefficients and squared roots of AVE.
Item loadings and cross-loadings.
Results of fit indices of the structural model.
Footnotes
Conflicts of Interest: None declared.
References
- 1.The Personal Health Working Group: Final Report. Markle: Advancing America's Future. 2003. [2020-09-04]. https://www.markle.org/sites/default/files/final_phwg_report1.pdf.
- 2.Pai HH, Lau F, Barnett J, Jones S. Meeting the health information needs of prostate cancer patients using personal health records. Curr Oncol. 2013 Dec;20(6):e561–9. doi: 10.3747/co.20.1584. http://www.current-oncology.com/index.php/oncology/article/view/1584/1338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Tulu B, Trapp AC, Strong DM, Johnson SA, Hoque M, Trudel J, Garber L. An analysis of patient portal utilization: what can we learn about online patient behavior by examining portal click data? Health Syst. 2017 Dec 19;5(1):66–79. doi: 10.1057/hs.2015.5. [DOI] [Google Scholar]
- 4.McMillan B, Eastham R, Brown B, Fitton R, Dickinson D. Primary care patient records in the United Kingdom: past, present, and future research priorities. J Med Internet Res. 2018 Dec 19;20(12):e11293. doi: 10.2196/11293. https://www.jmir.org/2018/12/e11293/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Laranjo L, Rodolfo I, Pereira AM, de Sá AB. Characteristics of innovators adopting a national personal health record in Portugal: cross-sectional study. JMIR Med Inform. 2017 Oct 11;5(4):e37. doi: 10.2196/medinform.7887. https://medinform.jmir.org/2017/4/e37/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ose D, Kunz A, Pohlmann S, Hofmann H, Qreini M, Krisam J, Uhlmann L, Jacke C, Winkler EC, Salize H, Szecsenyi J. A personal electronic health record: study protocol of a feasibility study on implementation in a real-world health care setting. JMIR Res Protoc. 2017 Mar 2;6(3):e33. doi: 10.2196/resprot.6314. https://www.researchprotocols.org/2017/3/e33/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Rice R. Healthcare leaders' lived experiences regarding the implementation of electronic personal health records. Walden University. 2014. [2020-09-11]. https://www.researchgate.net/publication/340135954_Patients'_Adoption_of_Electronic_Personal_Health_Records_in_England_Secondary_data_analysis.
- 8.Vermeir P, Degroote S, Vandijck D, van Tiggelen H, Peleman R, Verhaeghe R, Mariman A, Vogelaers D. The patient perspective on the effects of medical record accessibility: a systematic review. Acta Clin Belg. 2017 Jun;72(3):186–94. doi: 10.1080/17843286.2016.1275375. [DOI] [PubMed] [Google Scholar]
- 9.Alyami M, Song Y. Removing Barriers in Using Personal Health Record Systems. 15th International Conference on Computer and Information Science; ICIS'16; June 26-29, 2016; Okayama, Japan. 2016. [DOI] [Google Scholar]
- 10.Ochoa IA, Kitayama K, Uijtdehaage S, Vermillion M, Eaton M, Carpio F, Serota M, Hochman ME. Patient and provider perspectives on the potential value and use of a bilingual online patient portal in a Spanish-speaking safety-net population. J Am Med Inform Assoc. 2017 Nov 1;24(6):1160–4. doi: 10.1093/jamia/ocx040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Morton A. Examining Acceptance of an Integrated Personal Health Record (PHR) University of Maryland. 2012. [2020-09-11]. https://dl.acm.org/doi/book/10.5555/2395584.
- 12.Pagliari C, Detmer D. Electronic Personal Health Records: Emergence and Implications for the UK. Nuffield Trust. 2007. [2020-09-11]. https://www.nuffieldtrust.org.uk/files/2017-01/electronic-personal-health-records-uk-web-final.pdf.
- 13.Pagliari C, Detmer D, Singleton P. Potential of electronic personal health records. Br Med J. 2007 Aug 18;335(7615):330–3. doi: 10.1136/bmj.39279.482963.AD. http://europepmc.org/abstract/MED/17703042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Online Health and Prescription Services. United Kingdom National Health Service. 2016. [2020-09-04]. https://www.nhs.uk/using-the-nhs/nhs-services/gps/gp-online-services/
- 15.GP Online Services. United Kingdom National Health Service. 2016. [2020-09-04]. https://www.nhs.uk/using-the-nhs/about-the-nhs/how-to-access-your-health-records/
- 16.Patient Online Management Information (POMI) NHS Digital. 2018. [2020-09-04]. https://digital.nhs.uk/data-and-information/data-collections-and-data-sets/data-collections/pomi.
- 17.Fung V, Ortiz E, Huang J, Fireman B, Miller R, Selby JV, Hsu J. Early experiences with e-health services (1999-2002): promise, reality, and implications. Med Care. 2006 May;44(5):491–6. doi: 10.1097/01.mlr.0000207917.28988.dd. [DOI] [PubMed] [Google Scholar]
- 18.Huygens MW, Vermeulen J, Friele RD, van Schayck OC, de Jong JD, de Witte LP. Internet services for communicating with the general practice: barely noticed and used by patients. Interact J Med Res. 2015 Nov 24;4(4):e21. doi: 10.2196/ijmr.4245. https://www.i-jmr.org/2015/4/e21/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kaelber DC, Jha AK, Johnston D, Middleton B, Bates DW. A research agenda for personal health records (PHRs) J Am Med Inform Assoc. 2008;15(6):729–36. doi: 10.1197/jamia.M2547. http://europepmc.org/abstract/MED/18756002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Logue MD, Effken JA. Modeling factors that influence personal health records adoption. Comput Inform Nurs. 2012 Jul;30(7):354–62. doi: 10.1097/NXN.0b013e3182510717. [DOI] [PubMed] [Google Scholar]
- 21.Najaftorkaman M, Ghapanchi A, Talaei-Khoei A. Analysis of Research in Adoption of Person-Centred Healthcare Systems: the Case of Online Personal Health Record. 25th Australasian Conference on Information Systems; CIS'14; December 8-10, 2014; Auckland, New Zealand. 2014. [Google Scholar]
- 22.Or CK, Karsh B, Severtson DJ, Burke LJ, Brown RL, Brennan PF. Factors affecting home care patients' acceptance of a web-based interactive self-management technology. J Am Med Inform Assoc. 2011;18(1):51–9. doi: 10.1136/jamia.2010.007336. http://europepmc.org/abstract/MED/21131605. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Sanders MR, Winters P, Fortuna RJ, Mendoza M, Berliant M, Clark L, Fiscella K. Internet access and patient portal readiness among patients in a group of inner-city safety-net practices. J Ambul Care Manage. 2013;36(3):251–9. doi: 10.1097/JAC.0b013e31829702f9. [DOI] [PubMed] [Google Scholar]
- 24.Abd-Alrazaq AA, Bewick B, Farragher T, Gardner P. Factors that affect the use of electronic personal health records among patients: a systematic review. Int J Med Inform. 2019 Jun;126:164–75. doi: 10.1016/j.ijmedinf.2019.03.014. [DOI] [PubMed] [Google Scholar]
- 25.Andrews L, Gajanayake R, Sahama T. The Australian general public's perceptions of having a personally controlled electronic health record (PCEHR) Int J Med Inform. 2014 Dec;83(12):889–900. doi: 10.1016/j.ijmedinf.2014.08.002. [DOI] [PubMed] [Google Scholar]
- 26.Assadi V. Adoption of Integrated Personal Health Record Systems: a Self-determination Theory Perspective. McMaster University. 2013. [2020-09-11]. https://www.researchgate.net/publication/318739488_Consumer_Adoption_of_Personal_Health_Record_Systems_A_Self-Determination_Theory_Perspective. [DOI] [PMC free article] [PubMed]
- 27.Emani S, Yamin CK, Peters E, Karson AS, Lipsitz SR, Wald JS, Williams DH, Bates DW. Patient perceptions of a personal health record: a test of the diffusion of innovation model. J Med Internet Res. 2012 Nov 5;14(6):e150. doi: 10.2196/jmir.2278. https://www.jmir.org/2012/6/e150/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Or CK, Karsh B. A systematic review of patient acceptance of consumer health information technology. J Am Med Inform Assoc. 2009;16(4):550–60. doi: 10.1197/jamia.M2888. http://europepmc.org/abstract/MED/19390112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Abramson E, Patel V, Edwards A, Kaushal R. Consumer perspectives on personal health records: a 4-community study. Am J Manag Care. 2014 Apr;20(4):287–96. https://www.ajmc.com/pubMed.php?pii=85477. [PubMed] [Google Scholar]
- 30.Nambisan P. Factors that impact patient web portal readiness (PWPR) among the underserved. Int J Med Inform. 2017 Jun;102:62–70. doi: 10.1016/j.ijmedinf.2017.03.004. [DOI] [PubMed] [Google Scholar]
- 31.Ozok AA, Wu H, Gurses AP. Exploring patients’ use intention of personal health record systems: implications for design. Int J Hum-Comput Int. 2017 Jan 6;33(4):265–79. doi: 10.1080/10447318.2016.1277637. [DOI] [Google Scholar]
- 32.Razmak J, Bélanger C. Using the technology acceptance model to predict patient attitude toward personal health records in regional communities. Info Technol People. 2018 Apr 3;31(2):306–26. doi: 10.1108/ITP-07-2016-0160. [DOI] [Google Scholar]
- 33.Gebauer L, Söllner M, Leimeister J. Towards Understanding the Formation of Continuous It Use. 34h International Conference on Information Systems; CIS'13; December 15-18, 2013; Milan, Italy. 2013. [Google Scholar]
- 34.Legris P, Ingham J, Collerette P. Why do people use information technology? A critical review of the technology acceptance model. Info Manag. 2003 Jan;40(3):191–204. doi: 10.1016/S0378-7206(01)00143-4. [DOI] [Google Scholar]
- 35.Rodman D. Meaningful Use: the Utilization of Patient Portals. D'Youville College. 2015. [2020-09-11]. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4141030/
- 36.Turner M, Kitchenham B, Brereton P, Charters S, Budgen D. Does the technology acceptance model predict actual use? A systematic literature review. Inform Software Tech. 2010 May;52(5):463–79. doi: 10.1016/j.infsof.2009.11.005. [DOI] [Google Scholar]
- 37.Bhattacherjee A. Social Science Research: Principles, Methods, and Practices. Creative Commons Attribution. 2012. [2020-09-11]. http://scholarcommons.usf.edu/
- 38.Abd-Alrazaq A, Bewick BM, Farragher T, Gardner P. Factors affecting patients' use of electronic personal health records in England: cross-sectional study. J Med Internet Res. 2019 Jul 31;21(7):e12373. doi: 10.2196/12373. https://www.jmir.org/2019/7/e12373/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Q. 2003;27(3):425. doi: 10.2307/30036540. [DOI] [Google Scholar]
- 40.Tavares J, Oliveira T. Electronic health record patient portal adoption by health care consumers: an acceptance model and survey. J Med Internet Res. 2016 Mar 2;18(3):e49. doi: 10.2196/jmir.5069. https://www.jmir.org/2016/3/e49/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Taylor S, Todd P. Understanding information technology usage: a test of competing models. Inf Syst Res. 1995 Jun;6(2):144–176. doi: 10.1287/isre.6.2.144. [DOI] [Google Scholar]
- 42.Baird A. Extending Adoption of Innovation Theory with Consumer Influence the Case of Personal Health Records (PHRs) and Patient Portals. Arizona State University. [2020-09-14]. https://eric.ed.gov/?id=ED549969.
- 43.Lazard AJ, Watkins I, Mackert MS, Xie B, Stephens KK, Shalev H. Design simplicity influences patient portal use: the role of aesthetic evaluations for technology acceptance. J Am Med Inform Assoc. 2016 Apr;23(e1):e157–61. doi: 10.1093/jamia/ocv174. http://europepmc.org/abstract/MED/26635314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Torres CA. Examining the role of anxiety and apathy in health consumers' intentions to use patient health portals for personal health information management. Florida State University. [2020-09-14]. http://diginole.lib.fsu.edu/islandora/object/fsu%3A253944.
- 45.Greene K, Hale J, Rubin D. A test of the theory of reasoned action in the context of condom use and AIDS. Commun Res. 1997 Jan;10(1):21–33. doi: 10.1080/08934219709367656. [DOI] [Google Scholar]
- 46.Park HS. Relationships among attitudes and subjective norms: testing the theory of reasoned action across cultures. Commun Stud. 2009 May 22;51(2):-. doi: 10.1080/10510970009388516. https://www.tandfonline.com/doi/abs/10.1080/10510970009388516. [DOI] [Google Scholar]
- 47.Shepherd G, O'keefe D. Separability of attitudinal and normative influences on behavioral intentions in the Fishbein-Ajzen model. J Soc Psychol. 2010 Jul;122(2):287–8. doi: 10.1080/00224545.1984.9713496. [DOI] [Google Scholar]
- 48.Davis F. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly. 1989 Sep;13(3):319. doi: 10.2307/249008. [DOI] [Google Scholar]
- 49.Hale JL, Householder BJ, Greene KL. The persuasion Handbook: Developments in Theory and Practice. Thousand Oaks: Sage Publications; 2002. The theory of reasoned action. [Google Scholar]
- 50.Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs: Prentice Hall; 1986. [Google Scholar]
- 51.Chang M, Cheung W. Determinants of the intention to use Internet/WWW at work: a confirmatory study. Inf Manag. 2001 Nov;39(1):1–14. doi: 10.1016/S0378-7206(01)00075-1. [DOI] [Google Scholar]
- 52.Compeau D, Higgins C. Computer self-efficacy: development of a measure and initial test. MIS Q. 1995 Jun;19(2):189. doi: 10.2307/249688. [DOI] [Google Scholar]
- 53.Taylor S, Todd P. Assessing IT usage: the role of prior experience. MIS Q. 1995 Dec;19(4):561. doi: 10.2307/249633. [DOI] [Google Scholar]
- 54.Munro S, Lewin S, Swart T, Volmink J. A review of health behaviour theories: how useful are these for developing interventions to promote long-term medication adherence for TB and HIV/AIDS? BMC Public Health. 2007 Jun 11;7:104. doi: 10.1186/1471-2458-7-104. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-7-104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Venkatesh V, Bala H. Technology acceptance model 3 and a research agenda on interventions. Dec Sci. 2008 May;39(2):273–315. doi: 10.1111/j.1540-5915.2008.00192.x. [DOI] [Google Scholar]
- 56.Assadi V. Adoption of integrated personal health record systems: a self-determination theory perspective. McMaster University. 2013. [2020-09-15]. https://macsphere.mcmaster.ca/handle/11375/13530. [DOI] [PMC free article] [PubMed]
- 57.Bagozzi R. The legacy of the technology acceptance model and a proposal for a paradigm shift. JAIS. 2007 Apr;8(4):244–54. doi: 10.17705/1jais.00122. [DOI] [Google Scholar]
- 58.Gartrell K. Factors Associated with Electronic Personal Health Record Use among Registered Nurses for Their Own Health Management. University of Maryland. [2020-09-14]. https://archive.hshsl.umaryland.edu/handle/10713/4174.
- 59.Rastogi R, Chourey PS, Muhitch MJ. The maize glutamine synthetase GS1-2 gene is preferentially expressed in kernel pedicels and is developmentally-regulated. Plant Cell Physiol. 1998 Apr;39(4):443–6. doi: 10.1093/oxfordjournals.pcp.a029388. [DOI] [PubMed] [Google Scholar]
- 60.Whetstone M, Goldsmith R. Factors influencing intention to use personal health records. Intl J of Pharm & Health Mrkt. 2009 Apr 03;3(1):8–25. doi: 10.1108/17506120910948485. [DOI] [Google Scholar]
- 61.Or CK. Development of a model of consumer health information technology acceptance of patients with chronic illness. University of Wisconsin-Madison. 2013. [2020-09-25]. https://books.google.com.qa/books/about/Development_of_a_Model_of_Consumer_Healt.html?id=F7gIAQAAMAAJ&redir_esc=y.
- 62.Cimperman M, Makovec Brenčič M, Trkman P. Analyzing older users' home telehealth services acceptance behavior-applying an Extended UTAUT model. Int J Med Inform. 2016 Jun;90:22–31. doi: 10.1016/j.ijmedinf.2016.03.002. [DOI] [PubMed] [Google Scholar]
- 63.Beekens FH. Acceptance of e-health Technology: A Patient Perspective. Delft, Netherlands: Delft University of Technology; 2011. [Google Scholar]
- 64.de Veer AJ, Peeters JM, Brabers AE, Schellevis FG, Rademakers JJ, Francke AL. Determinants of the intention to use e-Health by community dwelling older people. BMC Health Serv Res. 2015 Mar 15;15:103. doi: 10.1186/s12913-015-0765-8. https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-015-0765-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Mekawie NM. Factors affecting adoption of eHealth in Egypt. Middlesex University. 2013. [2020-09-15]. https://eprints.mdx.ac.uk/12334/1/NMMekawie%20thesis.pdf.
- 66.Karahanna E, Straub D. The psychological origins of perceived usefulness and ease-of-use. Info Manag. 1999 Apr;35(4):237–50. doi: 10.1016/S0378-7206(98)00096-2. doi: 10.1016/S0378-7206(98)00096-2. [DOI] [Google Scholar]
- 67.Kulviwat S, Bruner G, Al-Shuridah O. The role of social influence on adoption of high tech innovations: the moderating effect of public/private consumption. J Bus Res. 2009 Jul;62(7):706–12. doi: 10.1016/j.jbusres.2007.04.014. doi: 10.1016/j.jbusres.2007.04.014. [DOI] [Google Scholar]
- 68.Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci. 2000 Feb;46(2):186–204. doi: 10.1287/mnsc.46.2.186.11926. [DOI] [Google Scholar]
- 69.Venkatesh V, Thong JY, Xu X. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS Q. 2012;36(1):157. doi: 10.2307/41410412. [DOI] [Google Scholar]
- 70.Bateson J, Hui M. Perceived control as a crucial perceptual dimension of the service experience: an experimental study. J Consum Res. 1991;18(2) [Google Scholar]
- 71.Lee J. A key to marketing financial services: the right mix of products, services, channels and customers. J Serv Mark. 2002 Jun;16(3):238–58. doi: 10.1108/08876040210427227. [DOI] [Google Scholar]
- 72.Koenig-Lewis N, Palmer A, Moll A. Predicting young consumers' take up of mobile banking services. Int J Bank Mark. 2010 Jul 27;28(5):410–32. doi: 10.1108/02652321011064917. [DOI] [Google Scholar]
- 73.Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis: With Readings. Seventh Edition. Essex, UK: Pearson Education; 2010. [Google Scholar]
- 74.Snijders T, Bosker R. A Beginner's Guide to Structural Equation Modeling. Third Edition. New York, USA: Routledge; 1999. [Google Scholar]
- 75.Podsakoff PM, MacKenzie SB, Lee J, Podsakoff NP. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol. 2003 Oct;88(5):879–903. doi: 10.1037/0021-9010.88.5.879. [DOI] [PubMed] [Google Scholar]
- 76.Podsakoff PM, MacKenzie SB, Podsakoff NP. Sources of method bias in social science research and recommendations on how to control it. Annu Rev Psychol. 2012;63:539–69. doi: 10.1146/annurev-psych-120710-100452. [DOI] [PubMed] [Google Scholar]
- 77.Kline R. Principles and Practice of Structural Equation Modeling. Fourth Edition. New York, USA: Guilford Press; 2015. [Google Scholar]
- 78.Alanazi A. A Comprehensive Model to Explaining Users' Acceptance and Intention to Use Electronic Health Records (EHR) in Rehabilitation Facilities in Saudi Arabia. University of Pittsburgh. 2015. [2020-09-11]. http://d-scholarship.pitt.edu/25740/
- 79.Byrne B. Structural Equation Modeling With AMOS: Basic Concepts, Applications, and Programming. New York, USA: Routledge; 2016. [Google Scholar]
- 80.Kamarulzaman Y. The Adoption of Internet Shopping for Travel Services. Cardiff University. 2006. [2020-09-11]. https://orca.cf.ac.uk/55606/1/U584036.pdf.
- 81.Chin W. Modern Methods for Business Research. Mahwah, USA: Lawrence Erlbaum Associates; 1998. The partial least squares approach to structural equation modeling; pp. 295–336. [Google Scholar]
- 82.Field A. Discovering Statistics Using SPSS. London, UK: Sage; 2017. [Google Scholar]
- 83.Menard S. Applied Logistic Regression Analysis. Thousand Oaks, CA: Sage; 1995. Applied logistic regression analysis. [Google Scholar]
- 84.Brown T. Confirmatory Factor Analysis for Applied Research. Second Edition. New York, USA: Guilford Publications; 2014. [Google Scholar]
- 85.Hsieh H, Kuo Y, Wang S, Chuang B, Tsai C. A study of personal health record user's behavioral model based on the PMT and UTAUT integrative perspective. Int J Environ Res Public Health. 2016 Dec 23;14(1):-. doi: 10.3390/ijerph14010008. https://www.mdpi.com/resolver?pii=ijerph14010008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Zikmund W, Babin B, Carr J, Griffin M. Business Research Methods. Ninth Edition. New York, USA: Cengage Learning; 2013. [Google Scholar]
- 87.Bhattacherjee A. Understanding information systems continuance: an expectation-confirmation model. MIS Q. 2001 Sep;25(3):351. doi: 10.2307/3250921. [DOI] [Google Scholar]
- 88.Forquer HA, Christensen JL, Tan AS. Predicting continuance-findings from a longitudinal study of older adults using an eHealth newsletter. Health Commun. 2014;29(9):937–46. doi: 10.1080/10410236.2013.833580. http://europepmc.org/abstract/MED/24446900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Nijland N, van Gemert-Pijnen JE, Kelders SM, Brandenburg BJ, Seydel ER. Factors influencing the use of a web-based application for supporting the self-care of patients with type 2 diabetes: a longitudinal study. J Med Internet Res. 2011 Sep 30;13(3):e71. doi: 10.2196/jmir.1603. https://www.jmir.org/2011/3/e71/ [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Selection of theory.
The previous model.
Justification of adaptation of UTAUT.
Conceptual definitions of constructs.
Characteristics of the four general practices.
Measures of constructs.
Questionnaire.
Participants' characteristics.
Histograms.
Values of skewness and kurtosis.
Scatterplot graphs.
Curve estimation procedure.
Tolerance values.
Harman’s single-factor test.
Results of fit indices of the measurement model.
Results of construct reliability.
Results of convergent validity.
Intercorrelation coefficients and squared roots of AVE.
Item loadings and cross-loadings.
Results of fit indices of the structural model.