Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2017 Mar 8.
Published in final edited form as: J Am Board Fam Med. 2016 Sep-Oct;29(5):592–603. doi: 10.3122/jabfm.2016.05.160046

Patterns of Electronic Portal Use among Vulnerable Patients in a Nationwide Practice-based Research Network: From the OCHIN Practice-based Research Network (PBRN)

Lorraine S Wallace 1, Heather Angier 1, Nathalie Huguet 1, James A Gaudino 1, Alex Krist 1, Marla Dearing 1, Marie Killerby 1, Miguel Marino 1, Jennifer E DeVoe 1
PMCID: PMC5341130  NIHMSID: NIHMS851276  PMID: 27613792

Abstract

Background

Underserved patient populations experience barriers to accessing and engaging within the complex health care system. Electronic patient portals have been proposed as a potential new way to improve access and engagement. We studied patient portal use for 12 consecutive months (365 days) among a large, nationally distributed, underserved patient population within the OCHIN (originally created as the Oregon Community Health Information Network and renamed OCHIN as other states joined) practice-based research network (PBRN).

Methods

We retrospectively assessed adoption and use of Epic’s MyChart patient portal in the first 12 months after MyChart was made available to the OCHIN PBRN. We examined electronic health record data from 36,549 patients aged ≥18 years who were offered a MyChart access code between May 1, 2012, and April 30, 2013, across the OCHIN PBRN in 13 states.

Results

Overall, 29% of patients offered an access code logged into their MyChart account. Superusers (minimum of 2 logins per month over a 12-month period) accounted for 6% of users overall. Men, nonwhite patients, Hispanic patients, Spanish-speaking patients, and those with the lowest incomes were significantly less likely to activate. Publicly insured and uninsured patients were also less likely to log in to their MyChart account, but once activated they were more likely than privately insured patients to use MyChart functions.

Conclusions

Our findings suggest that, compared with others, certain patient groups may be less interested in using patient portals or may have experienced significant barriers that prevented use. Making portal access available is a first step. Additional studies need to specifically identify health system–, clinic-, and patient-level barriers and facilitators to portal adoption and use.

Keywords: Ambulatory Care Facilities, Electronic Health Records, Hispanic Americans, Information Services, Medical Assistance, Medically Uninsured, Oregon, Poverty, Practice-based Research, Retrospective Studies, Vulnerable Populations


Underserved patient populations experience barriers to accessing and engaging within the complex health care system, and there are significant disparities in access to care and health outcomes across the United States. Widespread use of electronic health records (EHRs) and other technologies now offer new opportunities for patients to become more active participants in their health care. Patient engagement technologies, such as patient portals, have been proposed as 1 viable solution to overcome health disparities.1 Portals allow patients to securely perform a wide range of tasks, including retrieving laboratory results, scheduling appointments, renewing prescriptions, and contacting their health care provider to ask questions. As practices strive to meet national standards for transforming health care and meaningful use benchmarks,2 an increasing number are offering patient portals integrated into their EHR. There is a need to understand better the evolving patient portal landscape and whether portals are reaching underserved populations as has been hoped.

To date, a handful of studies have explored various aspects of patient portal use. Collectively, studies across varying geographic regions have reported differences in use of and access to patient portal systems.37 Most early studies describing patient portal users focused on patient populations with chronic health problems.811 This previous research identified certain sociodemographics associated with a higher likelihood of use, including young age, white race, female sex, and advanced levels of education. A few studies specific to under-served patients have suggested that underserved populations may be struggling to access these electronic patient engagement resources. For example, in a large cohort of underserved patients in New York City, Ancker et al3 found significant racial and ethnic disparities among patients both receiving an access activation code and using electronic patient portals. However, other studies using focus groups with underserved patient populations12,13 reported more encouraging results regarding interest in and acceptance of using personal health portals. Most previous research has been limited to examining electronic portal activation and/or overall use without assessing patterns of use, frequency of use, or types of activities performed while using the portal over time.47,14 It is likely that patients who do not log into and use their personal health portal shortly after receiving an access code will not use this service. Thus adoption of the electronic portal immediately after activation is most likely essential for sustainable and continuous utilization of electronic health portals. The purpose of this study was to characterize longitudinal portal use during the first 12 consecutive months (365 days) after initial access to MyChart among a large, underserved adult patient population receiving care at clinics within the OCHIN practice-based research network (PBRN).

Methods

Data Source and Study Population

We created an EHR data set that linked data from all OCHIN PBRN practices. OCHIN was originally created as the Oregon Community Health Information Network and renamed OCHIN as other states joined.15,16 All OCHIN member clinics, organized and managed within unique service areas, share a centrally hosted, linked instance of the EpicCare EHR. Practices in the OCHIN network installed Epic’s English-language personal health record MyChart starting in 2010 (Epic Care and MyChart; Epic Systems, Verona, Wisconsin).

To be included in the analysis, a patient had to be aged ≥18 years and offered a MyChart access code for the first time between May 1, 2012, and April 30, 2013. This time period was selected to include the 12 months just before MyChart codes became automatically provided to all patients. During this 12-month period, leaders at each clinic system were responsible for deciding when and how MyChart was offered to patients, thus creating a “natural experiment.” At the time of the study, MyChart was not available in Spanish.

Study Variables

Because we were interested in the early adoption and use of MyChart, our analyses were limited to the first 12 months (365 days) after initial access to MyChart. Both OCHIN’s EHR and MyChart were queried to generate data for this study. The MyChart database was queried to identify patients who were offered an activation code. To capture and characterize patient MyChart log-on frequency over 12 months, 4 categories were constructed: never, once, 2 to 23 times, and ≥24 times. “Superusers” were defined as logging into MyChart a minimum of 24 times (an average of 2 times/month) over a 12-month period.17

Patient-initiated MyChart activities among those who logged into their accounts were categorized as follows: (1) viewing, (2) online requests or services, and (3) communication. Viewing actions included viewing test results, medications, allergies, current health issues, immunizations, preventive care, medical history, conditions, letters, medical visit summaries and upcoming appointments, and printing a wallet card. Online requests or services included completing any of the following activities: requesting a refill, requesting or canceling an appointment, updating sociodemographic data, and downloading a summary record. Communication actions included completing either of the following: communicating with health care team or asking questions regarding prescriptions, medical tests, visit follow-up, or other nonurgent medical queries.

The following patient sociodemographic characteristics (at the time of receiving initial MyChart access code) were extracted from OCHIN’s EHR: sex, age, federal poverty level (FPL), race/ethnicity, preferred language, number of primary care visits, health insurance type, and chronic disease status. We documented formal diagnosis of the following chronic conditions: myocardial infarction, congestive heart disease, peripheral vascular disease, cerebrovascular disease, dementia, chronic pulmonary disease, rheumatic disease, peptic ulcer disease, mild liver disease, diabetes with and without chronic complications, hemiplegia or paraplegia, renal disease, malignancy/cancer, moderate or severe liver disease, metastatic solid tumor carcinoma, and human immunodeficiency virus. Chronic disease frequency was stratified as follows: 0, 1, or ≥2.

Data Analysis

Differences in patient sociodemographic characteristics across the 4 log-in categories (never, once, 2–23 times, ≥24 times) were initially tested using χ2 tests. To model the association of patient sociodemographic characteristics across the 4 frequency of log-in categories, we used a maximum likelihood multinomial logit regression model,18 with “never logged in” as the reference group. This type of regression technique models a 4-level categorical outcome assuming proportional odds and produces risk ratio measures of association in place of odds ratios. All patient sociodemographic characteristics were included as covariates in the models. Clustering of patients within service areas was accounted for using robust clustered sandwich estimators of variance19 to estimate risk ratios and accompanying 95% confidence intervals.

To estimate the association of patients’ sociodemographic characteristics with patient-initiated portal activities, adjusted incidence rate ratios were calculated using separate count, zero-inflated Poisson regression models for each of the 3 portal activities as a function of patients’ characteristics. The Vuong20 test indicated that the zero-inflated Poisson regression models provided a better fit to the data than standard Poisson regression for each patient-initiated MyChart activity because of the number of excess zeros and data dispersion. Separate zero-inflated Poisson models with all patient characteristics included as covariates were created for each of the 3 MyChart activities, and each accounted for clustering of patients within service areas through robust clustered sandwich estimators. Statistical analyses were performed using STATA, version 12.1 (StataCorp, College Station, TX) and R version 3.2.1 (The R Foundation; available from https://www.r-project.org/); all statistical tests were 2-sided, and significance was defined as P < .05. This study was approved by the Oregon Health & Science University’s Institutional Review Board.

Results

Patient Sociodemographic Characteristics across MyChart Log-in Categories

A total of 36,549 patients from OCHIN PBRN clinics in 13 states (Alaska, California, Indiana, Massachusetts, Minnesota, Montana, North Carolina, Nevada, Ohio, Oregon, Texas, Washington, and Wisconsin) comprised the final sample. As outlined in Table 1, the majority of patients who received a MyChart access code but did not log on were female (60.9%), white (84.9%), non-Hispanic (81.9%), identified English as their preferred language (88.4%), and did not have a chronic condition (59.8%). Approximately one third of the sample was 50 to 64 years old (28.2%), uninsured (34.2%), and living on less than 100% of the FPL (37.9%).

Table 1.

Baseline Patient Sociodemographic Characteristics of OCHIN Community Network Adults ≥18 Years of Age Who Were Issued a MyChart Access Code

Patient Logins
Sociodemographic characteristics Refused or Never Logged in 1 2–23 ≥24
Total patients 26,204 (71.7) 1,724 (4.7) 6,557 (17.9) 2,604 (5.7)
Sex
 Female 15,965 (60.9) 1,114 (64.6) 4,242 (64.7) 1,399 (67.8)
 Male 10,239 (39.1) 610 (35.4) 2,315 (35.3) 665 (32.2)
Age (years)
 18–29 5,783 (22.1) 342 (19.8) 1,147 (17.5) 336 (16.3)
 30–39 4,721 (18.0) 345 (20.0) 1,231 (18.8) 377 (18.3)
 40–49 4,616 (17.6) 341 (19.8) 1,170 (17.8) 348 (16.9)
 50–64 7,391 (28.2) 499 (28.9) 2,069 (31.6) 709 (34.4)
 65–74 2,361 (9.0) 149 (8.6) 737 (11.2) 229 (11.1)
 ≥75 1,332 (5.1) 48 (2.8) 203 (3.1) 65 (3.1)
Race
 White 22,241 (84.9) 1,554 (90.1) 6,066 (92.5) 1,960 (95)
 Nonwhite 3,084 (11.8) 129 (7.5) 361 (5.5) 78 (3.8)
 Unknown 879 (3.4) 41 (2.4) 130 (2.0) 26 (1.3)
Ethnicity
 Non-Hispanic 21,451 (81.9) 1,557 (90.3) 6,045 (92.2) 1,930 (93.5)
 Hispanic 3,825 (14.6) 114 (6.6) 369 (5.6) 98 (4.7)
 Unknown 928 (3.5) 53 (3.1) 143 (2.2) 36 (1.7)
Health Insurance
 Private 6,035 (23) 586 (34) 2,283 (34.8) 506 (24.5)
 Public 11,120 (42.4) 590 (34.2) 2,248 (34.3) 945 (45.8)
 Uninsured 8,973 (34.2) 542 (31.4) 2015 (30.7) 612 (29.7)
 Unknown 76 (0.3) 6 (0.3) 11 (0.2) 1 (0.0)
Number of primary care visits during study period
 0 1,286 (4.9) 62 (3.6) 148 (2.3) 5 (0.2)
 1 5,615 (21.4) 301 (17.5) 888 (13.5) 55 (2.7)
 2 4,317 (16.5) 317 (18.4) 1,230 (18.8) 143 (6.9)
 3 or 4 5,836 (22.3) 410 (23.8) 1,834 (28.0) 406 (19.7)
 5–8 5,569 (21.3) 374 (21.7) 1,614 (24.6) 744 (36.0)
 >8 3,581 (13.7) 260 (15.1) 843 (12.9) 711 (34.4)
Household income
 <100% FPL 9,940 (37.9) 529 (30.7) 1942 (29.6) 724 (35.1)
 100–199% FPL 3,624 (13.8) 226 (13.1) 1042 (15.9) 391 (18.9)
 200–399% FPL 869 (3.3) 115 (6.7) 469 (7.2) 147 (7.1)
 ≥400% FPL 2,022 (7.7) 176 (10.2) 850 (13) 224 (10.9)
 Unknown 9,749 (37.2) 678 (39.3) 2,254 (34.4) 578 (28.0)
Preferred language
 English 23,161 (88.4) 1,658 (96.2) 6,390 (97.5) 2,019 (97.8)
 Other 882 (3.4) 39 (2.3) 96 (1.5) 32 (1.6)
 Spanish 2161 (8.2) 27 (1.6) 71 (1.1) 13 (0.6)
Number of chronic conditions§
 0 15,669 (59.8) 1,058 (61.4) 3,844 (58.6) 888 (43.0)
 1 6,420 (24.5) 441 (25.6) 1759 (26.8) 664 (32.2)
 ≥2 4,115 (15.7) 225 (13.1) 954 (14.5) 512 (24.8)

Data are n (%).

All comparisons within groups using χ2 test were significant at P < .001.

Includes male-to-female transgender patients.

Includes female-to-male transgender patients.

§

Across all entire sample, the most common chronic diseases were chronic pulmonary disease, diabetes without chronic complications, and mild liver disease.

FPL, federal poverty level.

Of the 36,549 patients offered a MyChart access code, 71.7% never logged in, 4.7% patients logged in once, 17.9% logged in 2 to 23 times, and 5.7% patients logged in ≥24 times over the course of the first 12 months. Please see Appendix. The average number of MyChart log-in events among those who logged in once was 16.3 (standard deviation, 29.8), the median number of logins was 7, and the number of logins over the 12-month follow-up ranged from 1 to 1055 (data not shown).

Table 2 displays adjusted relative risks by patient characteristics across the 3 MyChart use categories (logged in once, logged in 2 to 23 times, and logged in ≥24 times). Overall, men, nonwhite patients, and Hispanic patients were significantly less likely to log in once, 2 to 23 times, or ≥24 times than women, white patients, or non-Hispanic patients. Patients carrying public insurance were less likely to log in than those with private insurance across all MyChart usage categories. Patients with income levels >100% of the FPL were more likely to log in ≥1 time than those below the FPL level. The number of visits during the 12 months following receipt of the initial MyChart access code was strongly associated with an increased likelihood of MyChart activation and with more frequent My-Chart logins. In fact, adjusted relative risks were well over 3 among patients logging in and ≥24 times, with a suggested “dose response” among these portal users as numbers of clinic visits also increased. Spanish-speaking patients were consistently less likely to log in once, 2 to 23 times, and ≥24 times compared with English-speaking patients. Though less consistent, speakers of other languages were also less likely to use the portal. After adjusting for other characteristics, the number of chronic conditions was not associated with the likelihood of MyChart log-in frequency, except those with 1 condition were significantly more likely to be superusers (≥24 logins).

Table 2.

Adjusted Relative Risk of Using MyChart Once, 2 to 23 Times, and ≥24 Times, by Patient Sociodemographic Characteristics

Risk Ratio (95% Confidence Interval)
Sociodemographic Characteristics Logged in Once (n = 1,724) Logged in 2–23 Times (n = 6,557) Logged in ≥24 Times (n = 2,604)
Sex
 Female* 1.00 1.00 1.00
 Male 0.81 (0.69–0.96) 0.81 (0.72–0.91) 0.80 (0.72–0.90)
Age group (years)
 18–29 1.00 1.00 1.00
 30–39 1.23 (1.00–1.53) 1.29 (1.16–1.43) 1.21 (1.01–1.46)
 40–49 1.21 (0.96–1.54) 1.20 (1.05–1.39) 1.01 (0.77–1.31)
 50–64 1.04 (0.79–1.36) 1.22 (1.04–1.44) 1.09 (0.87–1.38)
 65–74 1.10 (0.72–1.68) 1.65 (1.21–2.24) 1.17 (0.87–1.57)
 ≥75 0.64 (0.35–1.17) 0.85 (0.56–1.27) 0.52 (0.34–0.81)
Race
 White 1.00 1.00 1.00
 Nonwhite 0.61 (0.38–0.99) 0.45 (0.27–0.75) 0.25 (0.15–0.43)
 Unknown 0.93 (0.56–1.56) 1.02 (0.70–1.48) 0.86 (0.57–1.29)
Ethnicity
 Non-Hispanic 1.00 1.00 1.00
 Hispanic 0.68 (0.50–0.94) 0.61 (0.44–0.84) 0.51 (0.35–0.74)
 Unknown 0.89 (0.60–1.30) 0.66 (0.53–0.83) 0.71 (0.42–1.21)
Health insurance
 Private 1.00 1.00 1.00
 Public 0.64 (0.53–0.77) 0.56 (0.45–0.70) 0.76 (0.60–0.98)
 Uninsured 0.81 (0.66–1.00) 0.80 (0.67–0.96) 1.01 (0.78–1.31)
 Unknown 1.33 (0.66–2.69) 1.04 (0.40–2.67) 4.12 (0.36–47.1)
Number of primary care visits during study period
 0 1.00 1.00 1.00
 1 1.09 (0.69–1.72) 1.2 (0.79–1.84) 2.60 (1.18–5.76)
 2 1.54 (0.98–2.42) 2.19 (1.42–3.38) 8.78 (4.04–19.1)
 3 or 4 1.60 (1.02–2.49) 2.60 (1.64–4.13) 19.3 (9.06–41.1)
 5–8 1.68 (1.07–2.63) 2.64 (1.64–4.25) 39.1 (18.3–83.5)
 >8 1.94 (1.17–3.20) 2.31 (1.34–3.99) 59.4 (26.9–131.3)
Household income
 <100% FPL 1.00 1.00 1.00
 100–199% FPL 1.05 (0.90–1.22) 1.22 (1.10–1.36) 1.50 (1.34–1.68)
 200–399% FPL 1.90 (1.48–2.44) 1.89 (1.59–2.23) 2.62 (2.05–3.35)
 ≥400% FPL 1.39 (1.08–1.79) 1.68 (1.39–2.02) 1.64 (1.29–2.08)
 Unknown 1.13 (0.91–1.41) 0.94 (0.70–1.27) 0.94 (0.62–1.45)
Language
 English 1.00 1.00 1.00
 Other 0.79 (0.48–1.31) 0.60 (0.36–0.99) 0.82 (0.45–1.48)
 Spanish 0.23 (0.12–0.43) 0.17 (0.090–0.31) 0.10 (0.038–0.28)
Number of chronic conditions
 0 1.00 1.00 1.00
 1 0.99 (0.90–1.10) 1.02 (0.90–1.16) 1.26 (1.07–1.48)
 ≥2 0.82 (0.64–1.05) 0.86 (0.71–1.05) 1.16 (0.86–1.57)

These are risk ratios, not odds ratios. We fit a maximum-likelihood multinomial logit model to estimate probability of (1) having no MyChart use, (2) logging in once on MyChart, or (3) logging in more than once on MyChart. The risk ratio is then the ratio of 2 probabilities conditional on the covariate of interest. This multinomial model included all covariates included in the table, and the risk ratios are all in reference to “no MyChart use.” Models accounted for clustering of patients within service areas by including robust clustered sandwich estimators of variance to estimate rate ratio confidence intervals. The bold values are statistically significant at P < .05.

*

Includes male-to-female transgender patients.

Includes female-to-male transgender patients.

FPL, federal poverty level.

MyChart Activities

Table 3 shows the means and ranges of the viewing, online, and communicating activities. Of the 10,345 patients who logged into MyChart at least once, 91.8% of patients (n = 9492) performed viewing activities (eg, viewing test results, medications, allergies, current action health issues, immunizations, preventive care, medical history, conditions, letters, medical visit summaries and upcoming appointments, and printing a wallet card; median, 16 times for 2–23 MyChart logins and 57 times for ≥24 MyChart logins); 60.9% of patients (n = 6296) used the request function (eg, requesting a refill, requesting or canceling an appointment, updating sociodemographic data, and downloading a summary record; median, 1 time for 2–23 MyChart logins and 7 times for ≥24 My-Chart logins); and 58.7% of patients (n = 6074) used the communicating function (eg, communicating with health care team and asking prescription-related, nonurgent medical-related, medical test–related, or follow-up questions; median, 1 time for 2–23 MyChart logins and 12 times for ≥24 MyChart logins).

Table 3.

MyChart Activity as a Function of Login Group

Activity, Mean (Minimum, Maximum)
Logged in Once Logged in 2–23 Times Logged in ≥24 Times
Viewing activities
 Test results 0.44 (0, 12) 3.17 (0, 22) 12.30 (0, 122)
 Medications 0.53 (0, 10) 2.58 (0, 19) 9.51 (0, 148)
 Allergies 0.51 (0, 6) 2.35 (0, 15) 7.29 (0, 57)
 Current health issues 0.49 (0, 2) 2.14 (0, 15) 6.01 (0, 56)
 Print wallet card 0.03 (0, 1) 0.14 (0, 5) 0.52 (0, 14)
 Immunizations 0.52 (0, 6) 2.36 (0, 15) 7.13 (0, 56)
 Preventive care 0.30 (0, 11) 1.86 (0, 16) 6.88 (0, 58)
 Medical history 0.23 (0, 2) 0.93 (0, 13) 2.70 (0, 55)
 My conditions 0.52, (0, 6) 2.44 (0, 15) 7.63 (0, 58)
 Letters 0.12 (0, 2) 0.58 (0, 11) 2.20 (0, 97)
 After-visit summary 0.06 (0, 1) 0.44 (0, 10) 2.00 (0, 69)
 Upcoming appointments 0.13 (0, 10) 1.32 (0, 16) 7.68 (0, 146)
 All viewing activities 3.89 (0, 64) 20.30 (0, 133) 71.86 (0, 547)
Online requests or services
 Request a refill 0.03 (0, 2) 0.36 (0, 13) 2.77 (0, 82)
 Request or cancel an appointment 0.09 (0, 3) 1.00 (0, 14) 5.99 (0, 96)
 Update demographics (address, phone, E-mail) 0.03 (0, 1) 0.19 (0, 7) 0.75 (0, 13)
 Download summary record 0.03 (0, 1) 0.09 (0, 4) 0,21 (0, 12)
 All online activities 0.19 (0, 4) 1.64 (0, 17) 9.73 (0, 116)
Communication activities
 Communicating with health care team 0.14 (0, 3) 1.34 (0, 16) 9.46 (0, 147)
 Nonurgent medical question 0.05 (0, 2) 0.64 (0, 13) 5.31 (0, 113)
 Prescription question 0.01 (0, 2) 0.16 (0, 8) 1.17 (0, 23)
 Test results question <0.01 (0, 2) 0.08 (0, 4) 0.31 (0, 9)
 Visit follow-up question <0.01 (0, 1) 0.09 (0, 8) 0.57 (0, 28)
 All communicating activities 0.22 (0, 5) 2.32 (0, 29) 16.83 (0, 258)

Among those with 2 to 23 MyChart logins, the most common viewing activities were viewing test results, followed by viewing medications and viewing health conditions. Similarly, among superusers, the most common viewing activities were viewing test results, followed by viewing medications and viewing upcoming appointments. For both groups (2–23 and ≥24 logins), the most commonly request function activities were requesting or canceling an appointment, requesting a medication refill, and updating demographic information. Communication activities were most frequently used for communicating with health care teams, asking nonurgent medical questions, and asking prescription-related questions for user both groups (2–23 and ≥24 MyChart log-ins).

Table 4 displays adjusted incidence rate ratios from 3 separate zero-inflated Poisson models examining associations between patients’ sociodemographic characteristics and viewing, requesting, and communicating portal activities. Viewing activities were less likely among men than among women. Older patients (age ≥ 65 years) initiated fewer requesting and viewing activities, whereas patients aged 40 to 74 years used the portal for communicating more than did patients <40 years. Both nonwhites and Hispanics had lower rates of communicating activities compared with whites and non-Hispanics, respectively. Publicly insured patients were more likely to use all 3 activities compared with privately insured patients, whereas uninsured patients had higher rates of requesting and viewing activities compared with privately insured patients. Compared with patients with fewer primary care visits during the study period, those with more visits were more likely to initiate requesting and viewing activities. Patients with the highest number of primary care visits (>8) during the study period were far more likely to partake in communication-related activities compared with those with fewer primary care visits. Patients with ≥1 chronic condition were also more likely to participate in all 3 activities compared with patients without chronic conditions.

Table 4.

Adjusted Incidence Rates for MyChart Activities by Patient Sociodemographic Characteristics

Incidence Rate Ratios (95% CIs)
Sociodemographic Characteristics Requesting Viewing Communicating
Sex
 Female 1.00 1.00 1.00
 Male 0.99 (0.93–1.05) 0.93 (0.88–0.98) 0.97 (0.88–1.08)
Age group (years)
 18–29 1.00 1.00 1.00
 30–39 0.98 (0.87–1.11) 0.99 (0.89–1.10) 1.12 (0.97–1.28)
 40–49 1.00 (0.91–1.10) 0.98 (0.91–1.07) 1.22 (1.11–1.35)
 50–64 1.03 (0.93–1.15) 0.94 (0.89–0.99) 1.31 (1.15–1.48)
 65–74 0.78 (0.67–0.91) 0.82 (0.74–0.90) 1.25 (1.04–1.49)
 ≥75 0.70 (0.57–0.86) 0.79 (0.67–0.94) 0.98 (0.77–1.25)
Race
 White 1.00 1.00 1.00
 Nonwhite 0.94 (0.79–1.11) 0.94 (0.81–1.10) 0.69 (0.60–0.79)
 Unknown 0.96 (0.82–1.11) 1.05 (0.87–1.25) 0.8 (0.59–1.09)
Ethnicity
 Non-Hispanic 1.00 1.00 1.00
 Hispanic 1.00 (0.88–1.13) 0.97 (0.89–1.05) 0.78 (0.67–0.91)
 Unknown 0.68 (0.56–0.84) 0.85 (0.69–1.05) 1.23 (0.88–1.71)
Health insurance
 Private 1.00 1.00 1.00
 Public 1.33 (1.20–1.47) 1.16 (1.08–1.25) 1.23 (1.11–1.35)
 Uninsured 1.23 (1.08–1.40) 1.13 (1.05–1.23) 1.13 (0.99–1.28)
 Unknown 2.2 (0.81–5.97) 1.77 (0.84–3.72) 0.69 (0.25–1.87)
Number of primary care visits during study period
 0 1.00 1.00 1.00
 1 1.35 (0.87–2.08) 0.99 (0.78–1.25) 0.86 (0.37–2.01)
 2 1.69 (1.05–2.71) 1.24 (0.99–1.54) 1.11 (0.48–2.57)
 3 or 4 2.37 (1.62–3.46) 1.53 (1.26–1.87) 1.33 (0.61–2.90)
 5–8 3.33 (2.23–4.97) 2.05 (1.66–2.52) 1.87 (0.87–4.03)
 >8 4.91 (3.26–7.40) 2.59 (2.12–3.17) 2.69 (1.22–5.92)
Household income
 <100% FPL 1.00 1.00 1.00
 100–199% FPL 1.07 (0.98–1.17) 0.99 (0.94–1.05) 1.07 (0.96–1.19)
 200–399% FPL 1.18 (0.97–1.44) 1.02 (0.90–1.16) 1.24 (1.00–1.53)
 ≥400% FPL 1.00 (0.89–1.14) 1.04 (0.94–1.15) 1.00 (0.91–1.10)
 Unknown 0.96 (0.78–1.17) 0.95 (0.82–1.10) 0.98 (0.79–1.22)
Preferred language
 English 1.00 1.00 1.00
 Spanish 1.03 (0.81–1.33) 1.01 (0.81–1.26) 0.8 (0.56–1.14)
 Other 1.04 (0.82–1.33) 1.09 (0.93–1.29) 1.13 (0.94–1.36)
Number of chronic conditions
 0 1.00 1.00 1.00
 1 1.13 (1.02–1.26) 1.14 (1.08–1.21) 1.09 (1.02–1.16)
 ≥2 1.19 (1.08–1.31) 1.20 (1.09–1.32) 1.10 (1.00–1.21)

Only patients who logged into MyChart were included in these models. These are incidence rate ratios, not odds ratios. We fit a separate zero-inflated maximum-likelihood Poisson model to estimate the number of each of the 3 activities. Models accounted for clustering of patients within service areas by including robust clustered sandwich estimators of variance to estimate rate ratio confidence intervals. Bold values are statistically significant at P < .05.

CI, confidence interval; FPL, federal poverty level.

Discussion

In this study of underserved patients located in 13 states across the United States during an initial patient portal rollout period when participating clinic systems could use various portal recruitment strategies, we found that a majority of patients receiving an access code from their health care provider never attempted to log in to the MyChart platform. Interestingly, the OCHIN patients studied here were much less likely to activate their MyChart account compared with similar patient populations. For instance, more than two thirds of primary care patients at a large, urban, Midwestern practice activated their electronic patient portal,6 whereas 60% of patients receiving care at federally qualified health centers in the greater New York City area activated their electronic patient portal.3

Mirroring previous studies,3,6 patients carrying public health insurance (mainly Medicaid or Medicare) or without coverage were less likely to activate MyChart than privately insured patients. While these patients were less likely to activate their My-Chart accounts, however, once they logged in they utilized the functionalities of the portal generally more often. Most patients who activated their accounts had logged into MyChart more than once, suggesting they found the portal helpful. The findings from this preliminary study characterizing MyChart adoption and use suggest both the need to better understand specific barriers and facilitators experienced by underserved patients in using patient portals and to identify best practices by health systems and providers in recruiting and retaining patients to use portals, such as the importance of encouraging all patients to activate their accounts upon receipt of a portal access code.

Notwithstanding, it is important to recognize known barriers to access to and use of patient portal systems, including limited access to the necessary technology, low functional health literacy, and concerns regarding the privacy and security of personal health information.12,21,22 These results point to the potential need for developing, testing, and implementing systematic strategies to facilitate initial activation and use of personal portals by patients. Clinical practices, in partnership with community organizations and technology companies, could perhaps offer electronic portal activation and demonstration workshops to patients, where they could set up their accounts with active support and instruction.

This study is, to our knowledge, the first to report patient characteristics and practices of My-Chart superusers (defined as logging into MyChart a minimum of 24 times [an average of 2 times/month] over a 12-month period).14 Overall, 29% of patients logged into MyChart; however, superusers represented 6% of those who logged in. As could be expected, superusers were more likely to view pages within MyChart compared with those logging in on a less frequent basis. Superusers were also much more likely to use the features provided by MyChart, such as communicating with providers and requesting-related activities. To date, few studies have examined the frequency of use of different functions available in patient’s electronic portals.4,7 Jhamb et al4 found that provider communication among portal users occurred approximately twice a year, a sharp contrast with superusers in our study, suggesting that frequent portal users (superusers) tend to be more actively involved in their health care.

Similar to previous studies, we found that female, white, non-Hispanic, English-speaking, and younger patients were more likely to access and use the MyChart portal. These disparities persisted in each of the log-in frequency groups, but differences were not as prevalent across types of MyChart activities performed, especially among users of different age groups. Few studies have examined the link between health care utilization and use of patient portals. We found a linear relationship of increasing relative risk ratios for logging in as the number of clinic encounters also increased, especially—and not surprisingly—among superusers. Interestingly, and contrary to previous findings,11,23 the presence of chronic health conditions was not associated with the likelihood of logging in to MyChart. Compared with those without chronic conditions, however, patients with chronic conditions were more likely to participate in all 3 types of MyChart activities.

These results should be considered in the context of several limitations. First, we did not study the influences of different health system, clinic, and provider factors on portal adoption, use, and retention. In particular, during this period, a natural experiment of sorts occurred, during which different participating health systems or service areas, clinics, and providers had the option of using different strategies and levels of effort to recruit and retain patient portal users. For example, whereas some clinics may have offered MyChart activation during clinic check-in through support staff or by mail or E-mail, others may have had providers directly recruiting their patients face-to-face or using other methods. While we accounted for patient clustering in service areas to adjust for some of these differences to study the effects of patient characteristics, we did not evaluate system- or provider-level impacts. Second, our findings are based on 1 patient portal, MyChart, and may not be generalizable to other electronic systems or patient populations. However, our findings are likely to be robust for this population since they are based on the study of a large cohort of diverse underserved patients seen at a wide range of safety-net clinics throughout 13 states nationally. Third, though it is clear that portal users were more likely to use MyChart functions if they had chronic diseases, we did not evaluate whether those with more recent chronic disease or other diagnoses might be more likely to use the portal during the initial stages of their diagnostic workups or treatments. Fourth, at the time of the study, the MyChart Spanish-language portal was not available. As a result, the study sample included a small proportion of Spanish-speaking patients.

Despite these limitations, our findings provide important insights into barriers and facilitators of consistent electronic portal use by a diverse group of underserved patients. Future studies need to identify best practices for helping patients better understand the value of using patient portals in managing their health care and to pinpoint patient-and care system–level barriers that impede portal use while recognizing that some patients will not or cannot use them. In particular, future studies need to evaluate strategies that further facilitate first use, especially among racial and other minorities, men, older adults, and those who are publicly insured or uninsured, as critical step toward increasing electronic portal use. Finally, as patient portal use continues to increase, additional research is warranted to specify how patient portal use can be further leveraged to improve patient and clinical outcomes and transform health care delivery.

Acknowledgments

Funding: Support for this study was provided by the National Cancer Institute (grant R01 CA181452 and R01 CA168795) and the Patient-Centered Outcomes Research Institute (grant CDRN-1306-04716).

Appendix

Patient Sociodemographic Characteristics Associated with Odds of Not Performing Each MyChart Activity

Odds Ratio (95% Confidence Interval)
Sociodemographic Characteristics Requesting Viewing Communicating
Sex
 Female 1.00 1.00 1.00
 Male 1.21 (1.10–1.32) 1.24 (1.12–1.38) 1.22 (1.12–1.34)
Age group (years)
 18–29 1.00 1.00 1.00
 30–39 0.81 (0.74–0.88) 0.80 (0.73–0.88) 0.74 (0.67–0.83)
 40–49 0.87 (0.77–0.99) 0.87 (0.77–0.99) 0.81 (0.71–0.93)
 50–64 0.86 (0.74–0.99) 0.86 (0.73–1.01) 0.78 (0.68–0.91)
 65–74 0.72 (0.58–0.88) 0.69 (0.53–0.90) 0.68 (0.53–0.88)
 ≥75 1.34 (0.98–1.83) 1.35 (0.93–1.94) 1.29 (0.90–1.84)
Race
 White 1.00 1.00 1.00
 Nonwhite 2.37 (1.47–3.83) 2.40 (1.51–3.81) 2.41 (1.46–3.98)
 Unknown 1.07 (0.75–1.53) 1.02 (0.75–1.39) 1.18 (0.87–1.60)
Ethnicity
 Non-Hispanic 1.00 1.00 1.00
 Hispanic 1.57 (1.15–2.14) 1.65 (1.23–2.21) 1.63 (1.22–2.16)
 Unknown 1.30 (1.07–1.57) 1.47 (1.21–1.79) 1.35 (1.13–1.61)
Health insurance
 Private 1.00 1.00 1.00
 Public 1.48 (1.28–1.71) 1.60 (1.30–1.96) 1.54 (1.28–1.86)
 Uninsured 1.13 (0.98–1.31) 1.19 (1.00–1.42) 1.15 (0.99–1.34)
 Unknown 1.03 (0.40–2.71) 0.99 (0.43–2.30) 0.34 (0.15–0.77)
Number of primary care visits during study period
 0 1.00 1.00 1.00
 1 1.03 (0.67–1.56) 0.85 (0.57–1.26) 0.57 (0.41–0.79)
 2 0.49 (0.34–0.71) 0.48 (0.33–0.69) 0.32 (0.22–0.46)
 3 or 4 0.36 (0.25–0.53) 0.39 (0.26–0.57) 0.24 (0.17–0.35)
 5–8 0.28 (0.19–0.40) 0.33 (0.23–0.49) 0.20 (0.14–0.28)
 >8 0.24 (0.16–0.37) 0.31 (0.20–0.48) 0.17 (0.11–0.27)
Starting household income
 <100% FPL 1.00 1.00 1.00
 100–199% FPL 0.82 (0.73–0.92) 0.79 (0.73–0.86) 0.77 (0.70–0.84)
 200–399% FPL 0.63 (0.53–0.75) 0.51 (0.43–0.59) 0.58 (0.49–0.67)
 ≥400% FPL 0.66 (0.55–0.80) 0.63 (0.53–0.75) 0.65 (0.54–0.78)
 Unknown 1.09 (0.84–1.41) 1.05 (0.78–1.42) 1.13 (0.80–1.58)
Preferred language
 English 1.00 1.00 1.00
 Spanish 1.65 (1.06–2.55) 1.47 (0.87–2.46) 1.69 (1.07–2.67)
 Other 6.17 (3.35–11.4) 6.07 (3.35–11.0) 5.74 (2.96–11.1)
Number of chronic conditions
 0 1.00 1.00 1.00
 1 0.89 (0.81–0.97) 0.94 (0.85–1.05) 0.92 (0.82–1.03)
 ≥2 0.98 (0.81–1.18) 1.07 (0.89–1.28) 1 (0.80–1.25)

Only patients who logged into MyChart were included in these models. Note that these are odds ratio for the odds of not performing an activity given an individual had logged in. These odds were modeled as part of individual zero-inflated maximum-likelihood Poisson models to estimate both (1) the odds of not performing an activity and (2) the number of each of the 3 activities. Bold values are significant at P < .05.

FPL, federal poverty level.

Footnotes

Conflict of interest: none declared.

References

  • 1.Turner-Lee N, Smedley BD, Miller J. Minorities, mobile broadband and the management of chronic diseases. Washington, DC: Joint Center for Political and Economic Studies; 2012. [Google Scholar]
  • 2.Carayon P, Hoonakker P, Cartmill R, Hassol A. Final contract report. Rockville MD: Agency for Healthcare Rsearch and Quality; 2015. Using health information technology (IT) in practice redesign: impact of health IT on workflow. Patient-reported health IT and workflow. AHRQ publication no. 15– 0043-EF. [Google Scholar]
  • 3.Ancker JS, Barron Y, Rockoff ML, et al. Use of an electronic patient portal among disadvantaged populations. J Gen Intern Med. 2011;26:1117–23. doi: 10.1007/s11606-011-1749-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Jhamb M, Cavanaugh KL, Bian A, et al. Disparities in electronic health record patient portal use in nephrology clinics. Clin J Am Soc Nephrol. 2015;10:2013–22. doi: 10.2215/CJN.01640215. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Mikles SP, Mielenz TJ. Characteristics of electronic patient-provider messaging system utilisation in an urban health care organisation. J Innov Health Inform. 2015;22:214–21. doi: 10.14236/jhi.v22i1.75. [DOI] [PubMed] [Google Scholar]
  • 6.Goel MS, Brown TL, Williams A, Hasnain-Wynia R, Thompson JA, Baker DW. Disparities in enrollment and use of an electronic patient portal. J Gen Intern Med. 2011;26:1112–6. doi: 10.1007/s11606-011-1728-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Smith SG, O’Conor R, Aitken W, Curtis LM, Wolf MS, Goel MS. Disparities in registration and use of an online patient portal among older adults: findings from the LitCog cohort. J Am Med Inform Assoc. 2015;22:888–95. doi: 10.1093/jamia/ocv025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Wade-Vuturo AE, Mayberry LS, Osborn CY. Secure messaging and diabetes management: experiences and perspectives of patient portal users. J Am Med Inform Assoc. 2013;20:519–25. doi: 10.1136/amiajnl-2012-001253. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Riippa I, Linna M, Ronkko I, Kroger V. Use of an electronic patient portal among the chronically ill: an observational study. J Med Internet Res. 2014;16:e275. doi: 10.2196/jmir.3722. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Harrison TG, Wick J, Ahmed SB, et al. Patients with chronic kidney disease and their intent to use electronic personal health records. Can J Kidney Health Dis. 2015;2:23. doi: 10.1186/s40697-015-0058-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Jones JB, Weiner JP, Shah NR, Stewart WF. The wired patient: patterns of electronic patient portal use among patients with cardiac disease or diabetes. J Med Internet Res. 2015;17:e42. doi: 10.2196/jmir.3157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Dhanireddy S, Walker J, Reisch L, Oster N, Delbanco T, Elmore JG. The urban underserved: attitudes towards gaining full access to electronic medical records. Health Expect. 2014;17:724–32. doi: 10.1111/j.1369-7625.2012.00799.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Zarcadoolas C, Vaughon WL, Czaja SJ, Levy J, Rockoff ML. Consumers’ perceptions of patient-accessible electronic medical records. J Med Internet Res. 2013;15:e168. doi: 10.2196/jmir.2507. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Palen TE, Ross C, Powers JD, Xu S. Association of online patient access to clinicians and medical records with use of clinical services. JAMA. 2012;308:2012–9. doi: 10.1001/jama.2012.14126. [DOI] [PubMed] [Google Scholar]
  • 15.Devoe JE, Gold R, Spofford M, et al. Developing a network of community health centers with a common electronic health record: description of the Safety Net West Practice-based Research Network (SNW-PBRN) J Am Board Fam Med. 2011;24:597–604. doi: 10.3122/jabfm.2011.05.110052. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Devoe JE, Sears A. The OCHIN community information network: bringing together community health centers, information technology, and data to support a patient-centered medical village. J Am Board Fam Med. 2013;26:271–8. doi: 10.3122/jabfm.2013.03.120234. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Phelps RG, Taylor J, Simpson K, Samuel J, Turner AN. Patients’ continuing use of an online health record: a quantitative evaluation of 14,000 patient years of access data. J Med Internet Res. 2014;16:e241. doi: 10.2196/jmir.3371. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Greene WH. Econometric analysis. 7. Upper Saddle River, NJ: Prentice Hall; 2012. [Google Scholar]
  • 19.Williams RL. A note on robust variance estimation for cluster-correlated data. Biometrics. 2000;56:645–6. doi: 10.1111/j.0006-341x.2000.00645.x. [DOI] [PubMed] [Google Scholar]
  • 20.Vuong QH. Likelihood ratio tests for model selection and nonnested hypotheses. Econometrica. 1989;57:307–33. [Google Scholar]
  • 21.Goel MS, Brown TL, Williams A, Cooper AJ, Hasnain-Wynia R, Baker DW. Patient reported barriers to enrolling in a patient portal. J Am Med Inform Assoc. 2011;18(Suppl 1):i8–12. doi: 10.1136/amiajnl-2011-000473. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Kruse CS, Argueta DA, Lopez L, Nair A. Patient and provider attitudes toward the use of patient portals for the management of chronic disease: a systematic review. J Med Internet Res. 2015;17:e40. doi: 10.2196/jmir.3703. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Weingart SN, Rind D, Tofias Z, Sands DZ. Who uses the patient Internet portal? The PatientSite experience. J Am Med Inform Assoc. 2006;13:91–5. doi: 10.1197/jamia.M1833. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES