Skip to main content
HHS Author Manuscripts logoLink to HHS Author Manuscripts
. Author manuscript; available in PMC: 2019 Jul 1.
Published in final edited form as: Urol Pract. 2017 Jun 3;5(4):279–285. doi: 10.1016/j.urpr.2017.05.002

Patient Portal Usage in Pediatric Urology: Is it Meaningful Use for Everyone?

Ruth A Bush 1,2, Andrew C Richardson 3, Diana Cardona-Grau 4, Hena Din 5, Cynthia L Kuelbs 6, George J Chiang 7,8
PMCID: PMC6010344  NIHMSID: NIHMS893390  PMID: 29938212

Abstract

Introduction

The Affordable Care Act promotes multiple directives for meaningful use of the Electronic Health Record, such as patient/provider portals, to increase patient engagement. Although portal use is common within adult healthcare, little information exists regarding pediatric portal use. We examined pediatric urology patient portal enrollment and activation patterns at a tertiary pediatric hospital in Southern California by race/ethnicity, preferred language, gender, and residential region.

Methods

Retrospective Electronic Health Record analysis of enrollment in patient portal from January 2010 to May 2016 among 10,464 patients with at least one outpatient urology clinic visit. Differences in adoption rates were examined using logistic regression for the following categories: activated (or caregiver activated); code accepted not activated; declined; or activated/then deactivated.

Results

Overall, 46.5% of patients/caregivers activated the portal. Primarily Spanish-speaking patients were less likely to activate (OR 0.25, p <.001) than English-speaking patients. Males (OR 0.89, p =.004); those self-identifying racially as Other (not White, Asian, or African American) (OR 0.47, p <.001); and Hispanic patients (OR 0.49, p <.001) were less likely to activate. Suburban patients were up to 3 times more likely to activate portals than central urban patients depending on the region (OR 2.94, p <.001). Multivariate logistic regression demonstrated Spanish-speaking patients were 3 times less likely to activate while controlling for demographic and region variables.

Conclusions

Primary language and socioeconomic factors may be significant barriers to portal adoption. Patient education to reduce these barriers may increase portal acceptance and increase meaningfulness to the portal for patients/parents and providers.

Keywords: electronic health record, health information technology, meaningful use, patient engagement, patient portal

Introduction

The patient portal is, “a secure online website that gives patients convenient 24-hour access to personal health information.”1 Patient portals (referred here as portals) allow patients to send secure messages to clinical staff, view patient-specific educational materials, schedule appointments, request prescription refills, and manage bills.2 As part of the Affordable Care Act, multiple directives for meaningful use of the Electronic Health Record (EHR) have been promoted including the increased use and adoption of a portal with the goal of optimizing efficiency of care.3 Although portals are increasingly common, there is little information regarding their use as an engagement tool connecting patients, caregivers, and healthcare teams as partners.47

Adult patients who identify as racial and ethnic minorities tend to underutilize portals for a variety of reasons including: a lack of interest in the technology; not feeling the portal was helpful; physicians not discussing the portal with them; or lack of a computer or internet access.8 Parents of children with chronic conditions, who use multiple healthcare systems and providers, report portal underutilization and suggest increased use by both providers and patients may alleviate caregiver stress and the portal may serve as a potential modality for chronic care education and as a means to provide more effective patient/provider communication.912

In order for the portal to become a patient engagement tool, patients must first register and be willing to utilize the portal.7 This study will examine patient portal enrollment and activation patterns at a tertiary pediatric hospital in Southern California by race/ethnicity, preferred language, gender, and residential region. Given past findings within adult patient populations, it is hypothesized that racial/ethnic minorities will have low portal activation rates in a pediatric population. Findings of this study will help researchers and providers understand characteristics of portal use and disuse as well as identify factors to increase portal activation.

Methods

All procedures were approved by the appropriate administrative and university institutional review boards for the protection of human subjects.

Study Setting

The study was conducted at a tertiary pediatric hospital and its affiliated network, which draws from 3 counties in Southern California, serving more than 750,000 children,13 and has approximately 4,900 unique outpatient visits per year. The pediatric hospital is located near an international border and its patients’ racial/ethnic composition is approximately 45% Hispanic/Latino, 35% White, and 10% Asian.13 The study focused pediatric urology division patients. The pediatric urology division is the primary referral provider for the geographic area and manages care for children with chronic disease, resulting in a heterogeneous, robust patient sample in which to examine adoption patterns.

Patient medical care is tracked through the Epic EHR system (Verona, WI), which incorporates emergency department (ED), inpatient, outpatient (including satellite clinics), laboratory, and radiology input into an integrated system, sharing records within the organization. The Epic EHR has been fully operational at this location since 2010, while the portal called MyChart was first introduced in late 2010. An institutional-wide program incorporating pamphlets, targeted mailings (English/Spanish), flyers, and clinical staff directed patient education to encourage portal enrollment was conducted from 2011 to 2012.

Patient Portal Activation

MyChart’s institutional configuration requires access to an internet connected computer and an up-to-date browser (such as Internet Explorer). MyChart includes the ability to securely email a physician’s office, access test results, view a child’s health summary, request prescription refills, request primary-care appointments, and view all scheduled appointments. Activation was a two- step process in which clinical staff provided an activation code to patient caregivers (or patients 12 or older) during their office visit, which allowed them to login and create a user name and password. Patients were also able to access MyChart through an iPhone or Android application, but were limited to viewing test results, upcoming appointments personal health summary, and messaging providers. Patients younger than 12 required a parent or legal guardian to activate an account. Pediatric patients age 12 or older, with parental permission, could their own accounts, though access to particular functions may have been limited by their parents. All of the enrollment materials as well as the MyChart portal were available in English and Spanish. Interpretation services were available for those needing assistance in other languages.

Patients

Activation of Epic’s MyChart patient portal was retrospectively assessed from December 2010 to May 2016 for all patients with at least one visit with an outpatient urology visit using activation audit data. EHR data was examined from 10,464 patients aged 2 to 18 (calculated using date of birth and date of data extraction) who had at least one urology appointment and who met one of four portal activation categories: (1) activated (or caretaker activated) MyChart access code; (2) accepted but did not activate a code; (3) declined activation; or (4) activated and then deactivated their account. Demographic variables extracted included the patient’s gender, preferred language, race, ethnicity, and zip code. Zip codes were used to assign patients within geographical regions.

Statistical Analysis

Available median total household income and benefits census data by zip code14 were downloaded and matched with patient zip code. Summary statistics were calculated and associations among categorical demographic variables and the four portal status categories were analyzed using Pearson chi-square. Once bivariate relationships were identified, using a cutoff of a chi-square p-value of less than 0.05 as significant, an enter logistic regression model was used in which all significant variables were entered simultaneously to examine the interrelationship and the effect of identified variables on activation status (activated/not activated). The enter method is appropriate when there is a strong hypothesis about which variables belong in the model and produces an adjusted odds ratio, which takes into account the inter-relationship among many demographic variables. Activation was defined as having used a code and having a presently active account, while those who had refused, had not activated their code, or deactivated their code after activation were classified as not activated. All statistical analysis was conducted using SPSS version 24.15

Results

During the five and a half year period, 10,464 pediatric urology patients met criteria for analysis. Overall 46.5% of patients (or caregivers) who were offered an activation code, logged into MyChart (Table 1). Preferred language, ethnicity, and race of patients were significantly associated with portal adoption. Those who reported their preferred language as Spanish were significantly less likely to activate the portal (χ2 = 895.9, p < .001) than English-speaking patients. Hispanic patients and those not reporting ethnicity (χ2 = 412.02, p < .001) were less likely than non-Hispanic patients to activate their portal. Those self-identifying as Other (not White, Asian, or African American) (χ2 = 437.7, p < .001) were less likely to activate their portal compared to Whites. Residential location was also associated with activation status (χ2 = 240.3, p < .001). Those living in the central urban region, which has some of the county’s greatest language diversity lowest income areas were significantly less likely to activate their accounts. Median household income and benefits in 2014 inflation dollars by region are presented in Table 2. Males were also less likely to activate MyChart (χ2 = 10.2, p = .02). Of note, males represented 72% of the studied urology patients.

Table 1.

Descriptive Characteristics of Study Population (N = 10,464)

Total Portal Activation Status
χ2 P Value
Activated Not Activated Inactivated Declined
Gender, No. (%) 10.20a 0.017
 Female 3171 (30.3) 1541 (31.7) 840 (28.4) 671 (30.2) 119 (28.5)
 Male 7293 (69.7) 3323 (68.3) 2119 (71.6) 1552 (69.8) 299 (71.5)
Race, No. (%) 437.66a <0.001
 White 4708 (45.2) 2629 (54.2) 1191 (40.7) 757 (34.2) 131 (31.3)
 Other 4455 (42.8) 1655 (34.1) 1350 (46.2) 1208 (54.5) 242 (57.9)
 Asian 598 (5.7) 331 (6.8) 147 (5.0) 100 (4.5) 20 (4.8)
 African American 407 (3.9) 179 (3.7) 128 (4.4) 90 (4.1) 10 (2.4)
 No response/Unknown 243 (2.3) 61 (1.3) 107 (3.7) 60 (2.7) 15 (3.6)
Ethnicity, No. (%) 412.02a <0.001
 Non-Hispanic 5895 (56.4) 3203 (65.9) 1559 (52.8) 957 (43.1) 176 (42.1)
 Hispanic 4355 (41.7) 1609 (33.1) 1300 (44.1) 1215 (54.8) 231 (55.3)
 No response/Unknown 198 (1.9) 49 (1.0) 91 (3.1) 47 (2.1) 11 (2.6)
Language, No. (%) 895.96a <0.001
 English 8480 (81.0) 4405 (90.6) 2416 (81.6) 1425 (64.1) 234 (56.0)
 Spanish 1704 (16.3) 358 (7.4) 487 (16.5) 697 (31.4) 162 (38.8)
 Other 280 (2.7) 101 (2.1) 56 (1.9) 101 (4.5) 22 (5.3)
Region, No. (%) 240.34a <0.001
 Central 1208 (11.5) 364 (7.5) 392 (13.2) 395 (17.8) 57 (13.6)
 East 1220 (11.7) 552 (11.3) 361 (12.2) 254 (11.4) 53 (12.7)
 North Central 1589 (15.2) 888 (18.3) 371(12.5) 274 (12.3) 56 (13.4)
 North Coastal 1457 (13.9) 700 (14.4) 441 (14.9) 255 (11.5) 61 (14.6)
 North Inland 1841 (17.6) 913 (18.8) 463 (15.6) 390 (17.5) 75 (17.9)
 South 1596 (15.3) 742 (15.3) 451 (15.2) 344 (15.5) 59 (14.1)
 Outside SD County 1553 (14.8) 705 (14.5) 480 (16.2) 311 (14.0) 57 (13.6)

Abbreviations: SD, San Diego.

a

Pearson chi-square

Table 2.

Estimated Median Household Income and Benefits in 2014 Inflation-Adjusted Dollarsa

Region No. of Patients (%) Mean ± SD 95% CI
 Centralb 1208 (14) 44,403.0 ± 11,030.1 43,780.4 – 45,025.6
 Eastc 1220 (14) 61,267.0 ± 13,158.2 60,527.9 – 62,006.1
 North Centrald 1594 (18) 87,412.0 ± 25,297.4 86,169.2 – 88,654.8
 North Coastale 1459 (16) 74,795.7 ± 23,441.4 73,591.9 – 75,999.5
 North Inland 1842 (21) 76,577.2 ± 26,895.3 75,348.2 – 77,806.2
 South 1596 (18) 59,749.4 ± 20,482.0 58,743.8 – 60,755.0
 Total 8919 68,759.0 ± 25,533.9 68,229.0 – 69,289.0

Abbreviations: SD, standard deviation; CI, confidence interval of the mean.

a

ANOVA: F = 697.37, p < .001 using Tukey Post-Hoc tests.

b

Central Region significantly different from all other regions

c

East Region significantly different from all other regions except South

d

North Central Region significantly different from all other regions

e

North Coastal Region significantly different from all other regions except North Inland

Language, gender, race, ethnicity, and residential region all demonstrated highly significant odds ratios in unadjusted bivariate logistics regression (Table 3), but in the saturated logistic regression model, controlling for all the variables in the model, language, race, and residential area remained significantly associated with activation status. Those reporting Spanish as their primary language were a third as likely to activate the portal (OR 0.33, p < .001) and those who reported a language other than English were 57% as likely to report activation (OR 0.57, p < .001) as compared to primary English language patients. Compared to those who reported being White, individuals reporting their race as Other (OR 0.69. p < .001) and those who identified as African American (OR 0.66, p < .001) were two-thirds as likely to activate; those who did not report a race (OR 0.36, p < .001) were a third as likely. Living in the suburbs was significant with two suburban areas, the North Central (OR 1.90, p < .001) and the Southern (OR 1.96, p < .001) areas of the county twice as likely to activate portal accounts as those living in the urban Central region (Table 3).

Table 3.

Summary of Logistic Regression Analysis Predicting Portal Activation

Characteristic Unadjusted
Adjusted
B SE Wald df Exp(B) P Value B SE Wald df Exp(B) P Value
Gendera
 Male −0.122 0.043 8.17 1 0.885 .004 −0.083 0.045 3.48 1 0.920 .062
Languageb 505.28 2 < .001 261.68 2 < .001
 Spanish −1.402 0.063 490.50 1 0.246 < .001 −1.123 0.072 246.34 1 0.325 < .001
 Other −0.650 0.126 26.48 1 0.522 < .001 −0.557 0.133 17.59 1 0.573 < .001
Racec 378.59 4 < .001 74.13 4 < .001
 Other −0.761 0.043 317.33 1 0.467 < .001 −0.375 0.052 52.72 1 0.687 < .001
 Asian −0.020 0.087 0.05 1 0.980 .820 −0.042 0.091 0.21 1 0.959 .643
 African American −0.477 0.104 20.97 1 0.621 < .001 −0.420 0.107 15.30 1 0.657 < .001
 No response/Unknown −1.328 0.151 77.51 1 0.265 < .001 −1.035 0.253 16.67 1 0.355 < .001
Ethnicityd 340.88 2 < .001 10.44 2 .005
 Hispanic −0.708 0.041 300.56 1 0.492 < .001 −0.172 0.056 9.52 1 0.842 .002
 No response/Unknown −1.310 0.162 65.80 1 0.270 < .001 −0.327 0.283 1.33 1 0.721 .248
Regione 190.37 6 < .001 90.49 6 < .001
 East 0.650 0.085 58.40 1 1.916 < .001 0.299 0.090 11.08 1 1.348 .001
 North Central 1.077 0.081 179.02 1 2.937 < .001 0.644 0.086 56.10 1 1.904 < .001
 North Coastal 0.763 0.082 87.06 1 2.144 < .001 0.420 0.087 23.21 1 1.522 < .001
 North Inland 0.825 0.078 111.41 1 2.281 < .001 0.514 0.083 38.30 1 1.672 < .001
 South 0.700 0.080 76.05 1 2.015 < .001 0.671 0.084 63.44 1 1.956 < .001
 Outside SD County 0.656 0.081 65.97 1 1.928 < .001 0.349 0.085 16.70 1 1.417 < .001
a

Reference Group Female

b

Reference Group English

c

Reference Group White

d

Reference Group Non-Hispanic

e

Reference Group Central

Discussion

A retrospective analysis of pediatric urology patient portal activation within a large heterogeneous healthcare delivery system, demonstrated significantly different activation rates for patients by language preference, race, ethnicity, and geographic region. These differences suggest a continuing health care informatics divide among patients (and their caregivers), even with the increased focus on electronic enrollment as part of meaningful use mandates. The differences in activation rates indicates the need for further exploration of barriers and patient satisfaction with the portal. The results from this analysis identify patient groups who are not activating the portal and supports targeted patient education and recruitment.

Although the front office staff are bilingual and the portal invitation, activation directions, and electronic interface were available in Spanish, individuals who report Spanish as their primary language are not activating at similar rates to those who report English as their primary language. These pediatric findings are congruent with several adult studies and one pediatric study reporting individuals of color and those who report a language other than English as their primary language were less likely to obtain a portal account.3,8,9,16 Ketterer et al noted several sociodemographic disparities among portal adoption, including Hispanic ethnicity, which decreased portal activation odds approximately 25%.17 Language was highly significant in this study. Controlling for other demographic factors, those reporting Spanish or another language other than English as the primary language were a third and half as likely to activate the portal, respectively. As a growing number of patients and families in the Southern California region identify Chinese and Arabic as their language preference, reducing potential linguistic issues as a barrier is critical for continued portal adoption.

More recently, Peacock et al suggest in addition to factors of race/ethnicity and language, individuals living in non-metropolitan areas are less likely to use the portal because they are not offered portal access as often as their urban counterparts.18 Different geographical adoption patterns were also noted in this study, with the most demographically diverse region the least likely to adopt the portal. While controlling for race, ethnicity, and language, this regional difference persisted, which may represent a variety of factors including limited internet access, receiving primary care at community clinics rather than within this healthcare system, and less general access to health care.

A significant study strength was the available statistical power for data analysis of demographic factors from a large heterogeneous healthcare delivery system that is the primary referral source for urologic conditions in the geographic area. This project demonstrated it is possible to summarize portal account activation and illustrated a notable and troubling disparity in activation. Such data regarding adoption patterns are critical if the portal is to become an active means of patient engagement with the clinical team and to serve as the patients’ conduit to meaningful use of the EHR. Data such as these will add to the growing body of patient engagement and portal activation and will be able to advise clinicians and administrators in order to provide the desired patient-centered approaches for increased engagement, which recognize critical social factors and the need to overcome current barriers. For example, the urology division treats patients with a variety of chronic conditions, such as spina bifida, and the portal may be a way to engage vulnerable patient groups into the healthcare system.

In order to protect patient security, the portal activation process purposefully incorporates multiple steps, introducing several opportunities for a patient to become frustrated and to fail to complete. In recognition of the complexity of the activation process, a useful approach may be to provide more in-clinic opportunities to register as well as additional patient education about the utility of the portal during waiting times and as part of the engagement with clinical staff. In addition to understanding why accounts are or are not activated, results from this study also demonstrated many accounts are deactivated after enrollment. Understanding why the account is no longer used after the activation process has been completed is an area for further investigation.

There are several limitations to this retrospective analysis, including unavailable information about specific income levels (zip code and regional information were considered, but they do not provide individual level data.) as well as patient and caregiver health literacy levels, to evaluate the role of eHealth literacy and income as barriers to use.19 Caregivers, rather than patients were the probable portal user, are likely to have been female and have similar racial and ethnic backgrounds as the patient 16,20, however their information is unknown. The patient’s date of birth was available as part of the data download script parameters, but not available as a variable, so patterns of use in different age groups could not be evaluated. Without dates for non- activation, it was not possible to analyze adoption over time. Mobile phone and tablet use of MyChart is limited compared to the desktop usage, which may impact activation rates among those without regular computer access. Potential portal barriers include slow or non-existent internet access, data entry time, and data entry difficulty.21 Future studies should incorporate a measurement of patient/caregiver internet access. Given the current available data structure, the study did not look at other clinical factors that might have affected use such as diagnoses and condition severity. Because the healthcare system studied is the sole pediatric referral health care center for two large Southern California counties and part of a third, many of the patients may have received specialty care within this department but receive and are part of a primary care system elsewhere. This may have affected activation rates as many individuals did not view the study site as their home system.

Conclusions

A limited body of research, conducted primarily in academic settings among parents of children with chronic conditions, addresses the patient portal. This study conducted within the urology department of a large, integrated pediatric healthcare system serving a vast geographic area in Southern California demonstrates many patients have yet to activate their patient portal access and there are significant differences in adoption rates by primary language; race; and geographic location. Bilingual, bicultural educational materials, and electronic enrollment with clinical staff assistance may help facilitate patient portal adoption. This study identifies foci areas including health literacy, education level, overall literacy, household size, and family structure to include in further barrier assessment. The benefits of pediatric patient portal use to improve patient engagement, to improve transition to care, and to benefit research, can only be realized if individuals are enrolled in the portal.

Acknowledgments

This project was supported in part by grant number R00 HS022404 from the Agency for Healthcare Research and Quality. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Agency for Healthcare Research and Quality.

Contributor Information

Ruth A. Bush, Hahn School of Nursing and Health Science, Beyster Institute for Nursing Research, University of San Diego, San Diego, California; Clinical Research Informatics, Rady Children’s Hospital San Diego, San Diego, California.

Andrew C. Richardson, Clinical Research Informatics, Rady Children’s Hospital San Diego, San Diego, California.

Diana Cardona-Grau, Department of Urology, University of California San Diego, San Diego, California.

Hena Din, Department of Surgery, Rady Children’s Hospital, San Diego, California.

Cynthia L. Kuelbs, Department of Pediatrics, University of California San Diego, San Diego, California.

George J. Chiang, Department of Urology, University of California San Diego, San Diego, California; Rady Children’s Institute of Genomic Medicine, Rady Children’s Hospital San Diego, San Diego, California.

References

RESOURCES