Skip to main content
Applied Clinical Informatics logoLink to Applied Clinical Informatics
. 2023 Aug 23;14(4):654–669. doi: 10.1055/s-0043-1770901

The State-of-the-Art of Patient Portals: Adapting to External Factors, Addressing Barriers, and Innovating

Tera L Reynolds 1,, Jared Guthrie Cobb 2, Bryan D Steitz 3, Jessica S Ancker 3, S Trent Rosenbloom 2,3,4,5
PMCID: PMC10446914  PMID: 37611795

Abstract

Background and Objective  Recent external factors—the 21st Century Cures Act and the coronavirus disease 2019 (COVID-19) pandemic—have stimulated major changes in the patient portal landscape. The objective of this state-of-the-art review is to describe recent developments in the patient portal literature and to identify recommendations and future directions for the design, implementation, and evaluation of portals.

Methods  To focus this review on salient contemporary issues, we elected to center it on four topics: (1) 21st Century Cures Act's impact on patient portals (e.g., Open Notes); (2) COVID-19's pandemic impact on portals; (3) proxy access to portals; and (4) disparities in portal adoption and use. We conducted targeted PubMed searches to identify recent empirical studies addressing these topics, used a two-part screening process to determine relevance, and conducted thematic analyses.

Results  Our search identified 174 unique papers, 74 were relevant empirical studies and included in this review. Among these papers, we identified 10 themes within our four a priori topics, including preparing for and understanding the consequences of increased patient access to their electronic health information (Cures Act); developing, deploying, and evaluating new virtual care processes (COVID-19); understanding current barriers to formal proxy use (proxy access); and addressing disparities in portal adoption and use (disparities).

Conclusion  Our results suggest that the recent trends toward understanding the implications of immediate access to most test results, exploring ways to close gaps in portal adoption and use among different sub-populations, and finding ways to leverage portals to improve health and health care are the next steps in the maturation of patient portals and are key areas that require more research. It is important that health care organizations share their innovative portal efforts, so that successful measures can be tested in other contexts, and progress can continue.

Keywords: patient portals, 21st Century Cures Act, COVID-19, proxy portal access, digital health disparities

Background and Significance

Patient portals are a web- and smartphone-based technology that is typically linked to a health care organization's (HCO's) electronic health record (EHR) system to offer patients access to their medical records and, often, to support communication (e.g., secure messaging) and administrative needs (e.g., appointment management, bill pay). 1 2 As a result of the Health Information Technology for Economic and Clinical Health (HITECH) Act of 2009, most HCOs now offer patient portals. Patient adoption of portals has been increasing since they became available. 3 However, two major recent events have significantly changed the landscape. First, the coronavirus disease 2019 (COVID-19) pandemic has catalyzed increased patient portal adoption and use—from viewing COVID-19 test results to the rapid deployment of telehealth through portals to enable care while adhering to social distancing measures. Second, key provisions of the 21st Century Cures Act (Cures Act) of 2016 went into effect in early 2021 and made more electronic health information (EHI) immediately available to patients through portals. These external factors have created the critical need to understand current state of the art in patient portal functionality and use, as well as likely future directions.

Existing literature reviews have established that portal use can have benefits such as improved patient adherence to provider recommendations and patient–provider communication 4 5 6 7 8 9 10 11 12 13 14 15 and that there are numerous barriers to patient adoption and use, such as limited access to technology or low digital literacy, that could prevent portals from achieving their intended outcomes. 4 14 16 17 18 19 20 21 22 23 Despite the significant existing knowledge, major gaps remain, including little being known about effective solutions to: (1) the well-known sociodemographic disparities in portal adoption and use 24 and (2) increasing and optimizing the utility of proxy portal access—when someone the patient has authorized (either informally through sharing login credentials or formally) accesses the portal on behalf of the patient.

Given the recent changes and gaps in current research, we conducted a state-of-the-art literature review focused on contemporary portal topics, issues, and future directions to provide suggestions for evidence-based use. We specifically focus on four topics: the impact of the Cures Act's rule on information blocking on patient portals; how the COVID-19 pandemic has affected patient portal design, governance, adoption, and use; proxy access to portals; and how to address disparities in portal engagement.

Objective

The objective of this state-of-the-art review article is to describe recent developments in portal research and to identify recommendations for patient portal design, implementation, and evaluation, as well as future trends and gaps in the literature.

Methods

We performed a state-of-the-art review 25 of the recent literature focusing on our four topics. We present our detailed search strategy in Table 1 . These searches were developed iteratively through testing and review of the titles and abstracts of the results. All searches were restricted to 2020 to 2022 except the proxy access topic. The proxy access search was expanded to cover the last 5 years (2017–2022) because unlike the other topics it was an emerging area of research prior to the COVID-19 pandemic and was not directly affected by the two recent phenomena.

Table 1. Search strategy for identifying studies that align with our four topics: 21st Century Cures Act, COVID-19, disparities in portal adoption and use, and proxy access to portals.

Topic PubMed search strategy Other identified Search results
21st Century Cures Act  • Title and abstract
 • Search limited: 2020–2022
 • Search string: (((“patient portal”) OR (“personal health record”)) AND ((“opennotes”) OR (“open notes”) OR (“open result”) OR (“open results”) OR (“21st century cures act”)))
2  • Total number of results: 26
 • Total included: 18
COVID-19  • All fields
 • Search limited: 2020–2022
 • Search string: (((“patient portal”) OR (“personal health record”)) AND (“covid”))
0  • Total number of results: 55
 • Total included: 28
Disparities in adoption and use  • All fields
 • Search limited: 2020–2022
 • Search string: (((“patient portal”) OR (“personal health record”)) AND ((“healthcare disparities”) OR (“health care disparities”) OR (“health disparities”) OR (“health equity”)))
2  • Total number of results: 27
 • Total included: 12
Proxy access  • All fields
 • Search limited: 2017–2022
 • Search string: (((patient portal) OR (personal health record)) AND (“proxy”))
1  • Total number of results: 78
 • Total included: 16

Our study selection approach involved an expert-driven selection of patient portal articles along our four topics. We included original research with all types of study designs. We excluded papers that were not an empirical study (e.g., literature review, perspectives, editorials), experimental research on presenting portal data, studies focused on a technology that did not meet our patient portal definition (e.g., national portal), and studies in which the portal was used only as a means to an end (e.g., identifying study participants). In the first stage of selection, at least two authors reviewed titles and abstracts of all papers identified through our search strategy, with any disagreements resolved through discussion. In the second stage, one author reviewed full texts, applied the inclusion and exclusion criteria, and extracted predetermined information from included papers such as organizational setting, patient population, methods employed, relevant results, and limitations. We did not perform a formal quality assessment but did extract information on methodological weaknesses from each included study. We then performed a thematic analysis, 26 identifying themes within each topic to surface salient recommendations and emerging trends.

Results

We identified 174 unique papers. We excluded 88 based on title and abstract, with the most common reasons being not thematically relevant and not an empirical study. After reviewing the full text of the remaining 86 articles, we excluded an additional 12 for not being an empirical study, not meeting our definition of patient portal, or not aligning with any of the topics. Ultimately, 74 articles on our four topic areas were included. Of note, investigating and addressing disparities in uptake and use of patient portals were studied across categories; we report these results in the “Digital Health Disparities” subsection.

The 21st Century Cures Act

The Cures Act includes the information blocking rule, which stipulates that HCOs must make EHI available to patients immediately upon their request, except in rare cases when exceptions apply. For most health systems, the only feasible way to accommodate the information blocking rule is to place EHI preemptively in the patient portal, even prior to a patient request. While the Office of the National Coordinator for Health Information Technology (ONC) has clarified that this is not required from a policy standpoint, 27 real-world commercial patient portal software and clinical workflows prohibit other modes of capturing and responding in a timely fashion to patient requests for EHI. The reviewed literature lacks clear evidence about how HCOs are accommodating this rule, but ample anecdotal evidence suggests that Cures Act compliance is being achieved by making all visit notes (referred to as Open Notes) and laboratory and imaging test results (referred to as Open Results) immediately accessible to patients through portals. Prior to the Cures Act, some HCOs released visit notes and many released test results through portals, but with delays based on the sensitivity and risk of misinterpretation. 28 We identified 18 papers that reported results relevant to this topic and three themes within this literature: (1) preparing for increased patient access to their EHI; (2) assessing consequences of increased patient access; and (3) leveraging Cures Act compliance to engage patients (results summarized in Table 2 ). Overall, the research published in the past 2 years has tended to focus more on notes release rather than test data release and has often been conducted in U.S. institutions that launched Open Notes or Open Results in advance of the April 2021 Cures Act deadline.

Table 2. 21st Century Cures Act topic thematic analysis results summary table.

Across themes, research has tended to:
 1. Focus on Open Notes more than the immediate release of laboratory test results (i.e., Open Results)
 2. Be conducted at U.S. institutions that launched the changes in advance of the April 2021 deadline
Theme Description Key points
Preparing for Increased patient access Focuses on the preparations that some health care organizations (HCOs) have done prior to providing patients with increased access to their electronic health information (EHI).  • Preimplementation patients are generally positive about increased access, especially to low-sensitivity EHI results such as cholesterol test results. 29 30 Clinicians tend to be more skeptical. 29
 • Literature focuses on clinician-targeted implementation strategies, including education and communication around changing policies. 31 32 33 34
 • Despite some efforts to improve the readability of visit notes for patients, 32 35 limited existing research suggests that the readability of notes postimplementation sometimes remains unchanged. 29 35
Consequences of increased patient access Positive and negative consequences of increased access to EHI, including studies after Open Notes and other Cures Act Compliance efforts have been implemented.  • There are few recently published studies of direct consequences of immediate access to EHI (e.g., incidence of patients viewing test results before clinicians 28 ).
 • Postimplementation, patients remain positive about increased access 36 37 38 39 and clinicians remain concerned. 31
 • Existing literature overwhelmingly suggests that increased access to EHI supports patient engagement without harming the patient–provider relationship, but there is significant risk of bias in this body of literature. 33 35 36 37 38 40 41 42 43
 • There is some evidence that Open Notes may be particularly beneficial to underserved populations, but there is also evidence of disparities in who accesses and uses their notes. 33 35 40 41
Leveraging the Cures Act to engage patients Research considering how to further engage patients by providing additional opportunities for collaboration and technical supports using or building upon the infrastructure being implemented to comply with the Cures Act.  • The few published studies focused on how to improve representation, understandability, and utility of EHI have been promising but have been experimental and limited by low uptake. 44 45 46
 • Patients and caregivers have many suggestions for improving engagement through increased access to EHI such as increasing patient awareness (e.g., advertising availability and utility, notifications, and reminders) and increased clinician training (e.g., using nonjudgmental language in notes). 36 41 45 46

Preparing for Increased Patient Access

Some HCOs had been preparing for increased patient access to their EHI prior to implementing these changes, specifically understanding patients' and clinicians' preimplementation attitudes and preferences to immediate access to test results and making visit notes available for the first time 29 30 and developing and employing organizational change management strategies. 31 32 33 34 The preimplementation literature suggests that patients generally welcome these changes. 29 30 However, Bruno et al suggest that this may be nuanced—when asked about hypothetical scenarios and past diagnoses, patients tended to prefer immediate release of low-sensitivity results such as cholesterol, but contact from a clinician for more sensitive results. 30 In addition, Janssen et al found that clinicians were apprehensive about the idea of sharing visit notes with patients, with their greatest concerns being patient confusion and emotional distress. 29

We identified a number of strategies targeting clinicians to support changes related to making notes more readily available to patients; there was little mention of proactive patient preparations. 31 32 33 34 Clinician-focused efforts included educating clinicians, often by distributing informational materials, and maintaining awareness of changing policies. 33 HCOs also developed a new confidential visit note type to handle sensitive information in specific care contexts (e.g., pediatric 34 and mental health 31 ) that defaults to not being shared with patients or caregivers. Two HCOs have employed, or plan to, more active strategies focused on improving the readability of visit notes for patients, including through online education modules and/or functionality in the EHR (e.g., learning mode). 32 35 To date, limited literature suggests that clinicians appear resistant to changing their documentation practices, with the readability of notes sometimes remaining unchanged postimplementation. 29 35

Consequences of Increased Patient Access

The literature on the positive or negative consequences of increased patient access fell into two groups: (1) evidence from early adopters of Open Notes that has only recently been published and (2) evidence of consequences when there is immediate access to EHI.

Open Notes

There is a significant body of evidence from Open Notes early adopters that has been published in the last 2 years and offers insights relevant to Cures Act compliance. Most of these papers do not specify the timing of the release of visit notes and are largely based on self-report (e.g., surveys) with a high risk of bias (e.g., response bias). However, this body of literature has assessed many outcomes: disparities in uptake 35 ; understanding patient, informal caregiver, and clinician perceptions of access to notes 31 36 37 38 ; effect on patient or caregiver engagement 35 36 37 38 39 40 41 ; and effect on the patient–clinician relationship. 38 40 The postimplementation literature shows similar patient and clinician perceptions as the preimplementation literature. Specifically, studies have found that patients and caregivers who view their notes are generally positive about Open Notes, citing perceived benefits such as supporting care coordination and decreasing caregiver stress. 36 37 38 Clinicians, on the other hand, often focus on the problems, citing concerns such as patient wellbeing, damaging the patient–clinician relationship, and increasing clinician workload. 31

Many HCOs have evaluated patient engagement with Open Notes, particularly patient comprehension and use of their data. The studies exploring the former generally show that patients do not report difficulties understanding their notes, but that reading notes may motivate some patients (e.g., those with two or more chronic conditions 37 ) to put forth additional efforts such as information seeking. 35 37 38 40 Patients and their caregivers have also reported using Open Notes to better engage in their care in numerous ways such as preparing for appointments 36 37 ; postappointment, for example, as a memory aid for care plans and medication regimens and making decisions 36 37 38 40 ; sharing the data with others such as a family member (including across geographic locations) 36 37 ; coordinating care with other doctors, 36 and in safety-related concerns such as identifying errors in care documentation. 40 41 While there is some evidence of particular benefit among underserved populations (e.g., patients with lower education levels tended to report higher engagement), 40 there is also evidence of disparities based on race and health status in who reported the errors. 41

Finally, Open Notes seems to have had a positive impact on the patient– and/or caregiver–clinician relationship, especially among non-white patients. 38 40 However, Lam et al found that concern for harming their relationship with their clinician kept some patients from reporting perceived errors, suggesting that in order for the Cures Act to achieve some of its intended benefits, patients may need to be reassured that their relationship with their doctor will be preserved. 41

Immediate Access to Electronic Health Information

There has been less focus in the recently published literature on the consequences when there is immediate access to EHI and, importantly, even fewer studies of the direct consequences of that immediate access. One of the few exceptions is a study conducted by Steitz et al who reported a fourfold increase in the proportion of test results reviewed by patients first (i.e., before their clinician). 28 Another post-Cures Act compliance study found that patients overwhelmingly preferred immediate access to their test results, even when receiving abnormal results; however, although it was a minority of patients, those with abnormal results were more likely to report increased worry as a consequence of reviewing their results before being contacted by a health care provider. 39 Other outcomes that have been assessed when patients have had immediate access to their personal health information (PHI) include disparities in access, 33 patient or caregiver engagement, 33 42 43 and patient–clinician relationship. 43 The results from these studies are similar to those from early adopters of Open Notes, showing that patients and caregivers have used the immediate access to their EHI to engage in their care (e.g., identifying potential errors) and that it has not hurt their relationship with their clinician. 33 42 43

Leveraging Cures Act Compliance to Engage Patients

The few published studies in this area have focused on ways to improve the representation, understandability, and utility of notes and results to support patient engagement that require no or little clinician effort. 44 45 46 For instance, Kemp et al found that patients who chose to view a patient-centered, interactive radiology report that included lay language and diagrams through a portal were more engaged with this report than those who chose to view their plain text report. 44 Despite the paucity of research since the deadline for Cures Act compliance, these studies offer promising directions for empowering patients in the context of increased transparency and “Open Everything” and some papers report that similar efforts are underway. 35

Other studies have also documented patient and caregiver suggestions for improving engagement such as advertising the availability and utility of visit notes, 36 providing reminders when notes are available, 36 training clinicians to adjust their documentation practices (e.g., using nonjudgmental language), 36 offering communication guidance, 36 45 46 and providing clear mechanisms for reporting patient-identified errors. 41

COVID-19 Pandemic

The COVID-19 pandemic has disrupted health care in many ways and has led to major shifts in service delivery and resources, with patient portals playing a central role particularly in the delivery of telehealth. We identified two primary themes in the 28 papers that published relevant results: (1) developing, deploying, and evaluating new care processes and (2) developing and deploying portal tools for COVID-19 (results summarized in Table 3 ).

Table 3. COVID-19 pandemic topic thematic analysis results summary table.

Theme Description Key points
Developing, deploying, and evaluating new care processes, especially for telehealth delivery Providing health care during the COVID-19 pandemic while complying with public safety measures required developing new virtual care processes, which have been documented in the literature.  • New virtual care processes were required for all stages of a visit— previsit such as patient portal enrollment, during such as “rooming,” and postvisit follow-up—as well as remote disease monitoring and patient education. 47 48 49 50 51 52 53 54
 • The literature describes a wide variety of clinician-facing, sociotechnical implementation strategies, including securing and organizing human resources (e.g., clinician champions); developing guidelines, standard scripts, and best practices; offering trainings and clearly communicating evolving processes and resources; and leveraging technological resources. 47 48 49 50 51 52 53 55
 • The patient-facing initiatives reported in the literature are limited to technological training and support, with an emphasis on mitigating the risk of digital health disparities. 47 48 49 50 52 55 56 57 58 59 60 61 62
Developing and deploying portal tools to respond to COVID-19 The portal was leveraged as key infrastructure for deploying tools to respond to COVID-19 such as triage.  • Limited literature suggests that portals may successfully be used for triaging, scheduling, and monitoring patients with suspected or confirmed COVID-19. 63 64 65
 • Offering multimodal (e.g., portal and telephone) approaches was important to avoid disparities. 65

Developing, Deploying, and Evaluating New Care Processes

New care processes and workflow changes involving many different stakeholders were needed to successfully transition to telehealth, including changes to scheduling, the additional preparations needed prior to virtual visits (e.g., patient portal enrollment, virtual processes for previsit questionnaires), conversion of in-person processes to the virtual context (e.g., “rooming”), and postvisit follow-up, 47 48 49 50 51 52 53 as well as increased remote disease monitoring and virtual patient education programs. 54 To achieve these changes, HCOs also needed to employ implementation strategies to encourage acceptance among the various stakeholders. We found that existing literature was more likely to describe health care professional-facing implementation strategies to encourage acceptance of virtual visits than patient-facing strategies. Successful implementation or scaling-up of virtual care was a sociotechnical endeavor requiring multiple initiatives, including securing and organizing human resources (e.g., clinician champions, front-line staff working groups) 47 48 49 50 52 53 55 ; developing an optimization methodology (e.g., using data-driven processes to map out workflows, identify areas for improvement, and design and evaluate interventions) and/or using an established implementation science framework 48 50 ; clearly defining the roles and responsibilities for different members of the clinical team 49 51 53 ; developing guidelines, standard scripts, and best practices 48 49 50 52 53 55 ; offering regular trainings and educational materials 47 48 49 50 52 53 ; developing a robust communication strategy for disseminating evolving processes and resources 47 48 52 55 ; and leveraging technological resources to support humans where possible (e.g., automating processes). 49 51 53

While the literature generally shows that patients are receptive to virtual health care services, 48 58 60 61 patients may also need support to adopt virtual care. The two main approaches in the existing literature focus largely on technical support: offering multiple opportunities for one-on-one patient portal and video visit support (e.g., technical support hotline) 47 48 49 52 55 56 and providing training and educational resources, sometimes in multiple languages, especially leveraging existing communication modalities (e.g., appointment reminders). 49 50 52 55 57 Only one publication reported efforts to address structural issues like the digital divide, such as providing tablets to patients lacking technological resources. 49 Finally, of note, few studies described including patients in the planning and decision-making stages of the transition to telehealth. While this was likely a function of the emergency context, as the COVID-19 pandemic ends, it will be critical to engage patients in the next stage of telehealth's evolution.

Research has evaluated the effectiveness of these organizational efforts based on metrics such as wait and exam times, proportion of patients completing forms previsit, patient satisfaction, portal enrollment, and portal use (e.g., secure message [SM] volume). 47 48 52 53 58 66 67 68 69 70 Early evidence shows high levels of satisfaction with virtual visits among patients, especially with the time savings (e.g., no travel, decreased wait times). 47 66 Additionally, many studies documented increased portal adoption and use during the pandemic, which is likely the result of a combination of the aforementioned HCO efforts and necessity of the pandemic. 48 52 53 58 66 67 68 69 70 However, studies also documented disparities in patient portal enrollment and virtual visits through the portal during the pandemic, 56 58 69 71 72 73 with one potential factor being that remote portal enrollment appears less effective than in-person workflows for underserved populations. 56 59

Deploying Tools for COVID-19 Response

Three studies investigated how the portal, as important virtual care infrastructure, could be used in the COVID-19 response, particularly for triage and remote monitoring of those diagnosed with COVID-19. 63 64 65 For instance, Judson et al developed and deployed a COVID-19 self-triage and self-scheduling tool through their portal and early evidence showed significant use by patients, high sensitivity for patients with severe disease requiring emergency care, and reduced triage time for patients with less severe disease. 64 Offering multimodal opportunities may be critical to reducing the risk of disparities in uptake and use of COVID-19 response tools. 65

Proxy Portal Access

Proxy portal access provides a formal mechanism that allows trusted care partners (hereafter referred to as caregivers) to access key EHI about a patient. For example, spouses and parents often serve as proxies for their spouses and children, respectively. Patient portals commonly support proxy access—in one study of the availability of shared access to patient portal accounts in 20 health care systems, all offered shared access for parents or legal guardians of children (most often defined as <12 or 13 years old), and almost all offered some shared access for adolescents and adults (although it tended to be more limited). 74 However, the literature suggests that while formal proxy portal account use in the pediatric context can vary (e.g., 45% of patients <18 years 33 vs. 90% of logins for 12-year-old patients 75 ), 33 75 76 it has been almost universally low among different adult patient cohorts (e.g., less than 3% of patients with serious illness 77 ) 76 77 78 79 despite being recommended as a way to address eHealth literacy concerns. 80 It has been hypothesized that informal proxy use (share credentials to a patient's portal account) is relatively more common for adult patients. We discovered three themes in the 16 relevant papers: (1) who are portal proxies and how do they use the portal, (2) barriers to formal proxy use, and (3) identifying informal proxies and understanding the patients who share their account information (results summarized in Table 4 ).

Table 4. Patient portal proxy access topic thematic analysis results summary table.

Theme Description Key points
Who are proxies and how do they use the portal? Research characterizing proxy portal users and seeking to understand how they currently use, or may want to use, the portal.  • Patients usually choose lay-individuals close to them (in terms of physical proximity and/or social connection), 36 56 81 82 83 but sometimes choose health care professionals (home caregivers or clinicians with a different EHR) to address gaps in care coordination. 56 81 83
 • Proxies use portal access to support their caregiving role such as communication (with clinicians and others), especially care coordination; managing appointments and medications; decoding information for the patient; and advocating for the patient. 78 81 83 84
Barriers to formal proxy use Understanding the barriers to formal proxy use, which is critical to decreasing informal proxy use and increasing formal proxy account creation.  • There are several sociotechnical barriers to establishing formal proxy accounts, including insufficient or ineffective communication around creating proxy accounts; technical challenges with setting up accounts (e.g., poor usability); and few obvious incentives for creating a formal account (e.g., granular control over the information to which formal proxies have access). 74 81 85 86 87 88
Identifying informal proxies and understanding the patients who share their account information Identifying informal proxies (those who log-in to a patient's account using the patient's credentials) and investigating whether certain patient populations are more likely to share their log-in credentials than others. This could be useful for targeting interventions to increase formal proxy account use.  • There are direct (i.e., asking study participants) and indirect (e.g., using linguistic indicators in secure messages) strategies for identifying informal proxies. 36 43 78 79 81 82 Indirect, natural language processing-based strategies could be useful for large-scale identification of “hidden proxies.” 79
 • Patients who are older, non-white, male, married, with lower education levels, and indicators of worse health have been found to be more likely to share their patient portal log-in credentials with a care partner (i.e., have an informal proxy). It could be efficient to target messaging about formal proxy accounts to these patient populations. 78 79 82

Abbreviation: EHR, electronic health record.

Who Are Portal Proxies and How Do They Use the Portal?

Patients often select family members (e.g., spouse, child), close friends, or even neighbors to have formal or informal proxy portal access, 36 56 81 82 83 but sometimes chose (or also chose) paid home caregivers or clinicians that document in a different EHR to help close the gap in care coordination caused by a lack of interoperability in clinical systems. 56 81 83 Meanwhile, Jackson et al found that 78% of proxies saw the patient daily, suggesting that proximity may be a consideration when choosing a portal proxy. 36

Existing studies also provide insights into the roles that caregivers play in patients' health and wellbeing and how they use the portal to support these roles. Caregivers assist patients in both health care tasks, including providing instrumental support in getting patients to medical appointments, gaining digital access (e.g., assisting the patient to activate their portal account), reminding them to take medications, and communicating with clinicians, 56 81 and in everyday life tasks such as cooking. 81 Qualitative studies have found that proxy portal access supports some of caregivers' tasks, including communicating with clinicians and others (e.g., members of the patient's social support system), especially during times of transition 78 81 83 ; managing appointments and medications 83 ; checking laboratory test results 83 ; decoding information for the patient (e.g., explaining test results) 81 ; advocating for the patient 84 ; and providing access to key information during emergencies. 81 83 Importantly, limited existing research also suggests that many portal proxies try to respect patients' agency and privacy by only accessing the medical information necessary for a given task. 81 83

Barriers to Proxy Portal Use

While HCO leadership (and proxies themselves 83 ) may prefer that caregivers set up formal proxy accounts when they are available for security reasons, there appear to be a number of barriers to proxy use particularly through formal accounts, including some HCOs not offering proxy accounts (or not offering them for all patient groups such as adolescents), 74 85 institutional policies (in accordance with state laws) that limit parental access for adolescents, 87 88 insufficient or unclear communication around proxy accounts (e.g., HCO personnel endorsing password sharing), 85 86 challenges with setting up an account (e.g., poor usability), 86 and few obvious incentives to set up a formal account (compared to sharing login credentials). 74 85 For example, among HCOs that offer proxy access, the published literature suggests that 20% or fewer offer patients control over the data their proxies are able to access. 74 85 This lack of granular control can be a major barrier to providing caregivers with proxy access outside of an emergency, particularly for stigmatized conditions. 81

Identifying Informal Proxies and Understanding the Patients Who Share Their Account Information

We define informal portal proxies as those caregivers who access a patient portal account on behalf of a patient through the sharing of the patient's login credentials. Informal proxies circumvent organizational security precautions about access to PHI. Being able to identify when informal proxies exist is an important first step for targeting interventions to decrease this practice. There is not currently a published method for large-scale informal proxy identification. However, we identified three studies that approached this problem by directly asking participants through surveys or interviews 36 43 81 and three studies basing their estimates on language used in SMs, such as referring to patients in the third person. 78 79 82 In the former, estimates of informal proxies range from 2.1% (150/7,058 survey respondents 43 ) to 40% (4/10 interview participants 81 ). Among the latter, two studies were based on manual review 78 82 and one study developed a computational mechanism that identified a similar percentage of patients with likely proxy-authored SMs as a manual review did (45.7% of 9,856 patients 79 vs. 54.1% of 1,254 patients 78 ).

Research suggests that informal proxy-authored SMs are more likely for patients who are older 79 ; non-white 79 ; male 82 ; married 82 ; have lower education levels 79 ; and have indicators of worse health (e.g., more comorbidities, more advanced disease) or conditions that affect cognition (e.g., Alzheimer's disease). 78 79 82 Similarly, Semere et al also found that patients with a high proportion of predicted proxy-authored SMs were more likely to be older, non-white, and have indicators of communication barriers (e.g., lower health literacy) and worse health (e.g., more comorbidities). 79

Digital Health Disparities

Twenty-five included articles covered disparities related to patient portal adoption and use, with two themes emerging: (1) identifying disparities and barriers to adoption and use and (2) addressing disparities (summarized in Table 5 ).

Table 5. Digital health disparity topic thematic analysis results summary table.

Theme Description Key points
Identifying disparities and barriers among specific populations or people with specific conditions Recent studies have continued to monitor for disparities in patient portal adoption and use.  • Current data suggest that portal adoption and use is still less likely among several groups, including men and black and Hispanic patients, as well as those with limited English-language proficiency, lower levels of education, and less access to health care. 56 58 69 71 72 73 89 90 91 Similar disparities are seen in special care contexts such as palliative care. 77 92 93
 • There is some evidence that, among those who access, there may be few differences in feature use, 89 90 but this may depend on the study methodologies, features evaluated portals, and care contexts.
 • There is also some evidence that perceived need, privacy and security concerns, usability issues, and perceived negative effect on patient–care team communication are driving some of the disparities in portal engagement. 84 91 94 95
Addressing disparities Developing, deploying, and evaluating strategies for addressing disparities in portal adoption and use.  • Clinicians play an important role in encouraging or discouraging portal engagement. 89
 • Addressing the digital divide 96 and offering multimodal mechanisms 58 59 60 61 62 to engage in one's care can mitigate the risk of digital health disparities.

Identifying Disparities and Barriers to Adoption and Use

Research demonstrates consistent disparities in portal adoption and use through studies of the general population (i.e., Health Information National Trends Survey [HINTS]), 89 90 91 within specific HCOs, 56 58 69 71 72 73 and among specific sub-populations (e.g., palliative care patients). 77 92 93 These studies have found that disparities remain in who is offered portals, who accesses them, and who uses certain features, particularly Open Notes and video visits. The recently published literature shows that portal engagement is less likely among patients who are older 35 56 73 77 or younger in the context of telehealth during the COVID-19 pandemic, 56 58 men 35 56 72 90 or women in the case of serious illness, 77 nonmarried, 35 and non-White, 33 35 73 77 89 92 93 as well as those with limited English-language proficiency, 33 58 71 72 90 92 93 indicators of lower socioeconomic status, 33 35 72 73 90 92 93 better health, 35 58 77 93 lower technological engagement, 55 58 71 72 73 and less access to health care (e.g., without a regular doctor). 73 90 Two analyses of HINTS datasets found conflicting results from existing HCO-based studies: among those who access portals, there do not appear to be disparities in feature use. This difference in findings may reflect methodological differences between studies (e.g., self-report vs. audit logs, the specific features investigated). 89 90

Research has also identified barriers among underserved populations and especially surrounding certain, often stigmatized, health conditions, including perceived lack of need to access EHI, 91 privacy concerns, 91 94 95 usability issues (e.g., too many links overwhelming patients), 94 and perceived negative effect on patient–care team communication (e.g., extra step to contact care team). 84

Addressing Disparities

Numerous telehealth studies suggest the importance of offering multimodal opportunities for remote patient engagement, including telephone calls and text messages, to mitigate the risk of disparities. 58 59 60 61 62 For example, Davis et al reported on their telephone outreach efforts to augment their patient portal process for remote symptom monitoring among cancer patients, finding that they were able to increase the number of completed screens, identify additional needs, and capture a higher percentage of black and older adult (61–80 years) patients through telephone outreach. 59

Outside of the telehealth context, few studies published within our timeframe evaluated strategies for addressing disparities in portal engagement, with two exceptions. 89 96 Through their analysis of a nationally representative survey, Richwine et al found evidence that clinicians play an important role in black and Hispanic patient engagement with portals. 89 Griffin et al found an association between providing tablets to veterans with access barriers and an increase in portal adoption and use, although the biggest increase was among those who were already active users of the portal and lowest among nonusers, suggesting that other interventions are still needed to improve the initial engagement with portals. 96 Other studies provide recommendations based on their results such as: EHR vendors should (1) remove technological barriers to enrollment (e.g., email address requirements) 97 and (2) include safety net patients in their user experience testing to identify issues earlier in the design process, 97 and (3) HCOs should improve their portal marketing (e.g., clearly articulate the portals' everyday utility, targeted messaging). 97 98

Discussion

The findings of this state-of-the-art review point to ongoing and emerging sociotechnical challenges with portals, especially the rapid evolution of portal policies, processes, and features in response to the external environment and significant implementation efforts by many HCOs. These efforts seem to have effectively increased patient engagement with portals during the pandemic, providing patients access to video visits and key resources (e.g., remote screening and monitoring programs). However, the literature also shows that portals do not seem to be the most effective way to interact with all patient populations and that flexible, multimodal delivery of care is crucial to avoid creating barriers to health care access. While there have been noteworthy efforts to make patient portals more user-friendly and empowering for patients, the extent to which these efforts extend beyond single HCOs (and especially academic institutions) is largely unclear. Ultimately, it is critical to learn from and build upon the experiences of innovative HCOs.

Toward this end, we drew on our findings on HCO experiences and successes, as well as other relevant literature, to develop several recommendations for HCOs, EHR vendors, and researchers to continue improving the design and implementation of patient portals. Box 1 contains the full list of recommendations by the stakeholder group. We discuss a selection of these recommendations, specifically the need for multistakeholder commitment to addressing disparities in portal adoption and use and to supporting patient and caregivers when they view EHI, as well as more research to understand how newer mechanisms for accessing and leveraging EHI will affect patient portal adoption and use.

Box 1. Recommendations for health care organizations, electronic health record vendors, and researchers to continue improving the design and implementation of patient portals based on the findings from this state-of-the-art review.

Health care organizations
 • Continue to invest in the infrastructure necessary to virtual services, including offering flexible, multimodal options that can meet the preferences and needs of diverse patient populations.
 • Better support patients, especially through transitions in access to EHI and engagement in their health care.
 • Understand and address clinician concerns and resistance to changing visit note documentation practices to better communicate with patients.
 • Develop, evaluate, and disseminate the results of innovative portal efforts to equitably engage patients.
Electronic health record vendors
 • Make it easier to create a proxy account and offer patients more control over what formal proxies can access.
 • Engage diverse patients in the design and testing of portals and features.
Researchers
Future research directions include the need for more evidence to understand
 • How to better support patients as they view their EHI, especially test results, outside of interactions with health care professionals (e.g., understanding the potential role of artificial intelligence tools such as chatbots).
 • Direct consequences of immediate access to EHI, and especially test results, for patients across health care contexts (e.g., safety net).
 • How newer mechanisms for viewing and leveraging one's clinical data will affect patient portal engagement.
 • How to address persistent disparities in the uptake, use, and effectiveness of portals.
 • How proxy accounts could be improved to better support caregiver needs and how to increase proxy account creation.
 • How to build on the progress in portal engagement made during COVID-19 for sustainability outside of the public health crisis.

Abbreviation: EHI, electronic health information.

HCOs, EHR vendors, and researchers all have a role to play in the continued work to (1) address disparities in portal adoption and use and (2) better support all patients and caregivers as they view EHI with little support from clinicians. First, patient portals are integral to many HCOs' infrastructure and can be leveraged in many ways both during a crisis and in everyday contexts. For example, while outside of the scope of this review, we identified several studies that have leveraged portals as critical infrastructure for purposes outside of direct patient care, often research (e.g., delivering surveys). 99 100 101 102 103 104 105 106 Investing in the continued improvement of portals has the potential for benefits to patient care and beyond. However, it also means that addressing the well-established disparities in uptake and use 56 58 69 71 72 73 107 108 109 110 111 is critical for equitable access to these benefits. HCOs should develop, evaluate, and disseminate the results of innovative portal efforts to equitably engage patients; suggestions from the literature include screening for eHealth literacy, 80 112 ensuring that portal accounts are automatically created for all patients upon registration, 113 leveraging care settings with high proportions of vulnerable patients and significant wait down-times (e.g., emergency department), 114 using innovative methods to improve the understandability of EHI in portals, 115 providing targeted training and support, 80 112 and promoting formal proxy users. 80 116 Additionally, and as Casillas et al 97 and others 49 have recommended, EHR vendors should include diverse patient populations (e.g., non-English speaking patients) in the early phases of portal design, re-design, and feature development to ensure that they meet the needs of these users. Researchers should focus on how to sustainably address structural barriers to portal engagement. With the exception of initiatives that provide tablets to patients, 96 117 118 existing solutions have largely focused on patient education or have bypassed portals altogether, instead using other modes of communication such as telephone. While telephone communication may be acceptable in some cases, video visits have advantages such as allowing for some visual assessments. 119 There continues to be a need to identify organizational and societal strategies that enable equitable access to patient portals.

Second, as others have noted, 120 overall, clinicians should feel reassured about early evidence on increased patient access to EHI; however, that does not mean that patients do not need more support and preparation. The few existing efforts to prepare patients for increased access to their EHI have tended to focus on patient education. While this is an important tool, it is not the only one that could be employed. More sociotechnical solutions that leverage the existing technological infrastructure and limit additional burden on clinicians should be developed and evaluated. 121 122 For example, portal-integrated artificial intelligence tools such as chatbots and GPT (Generative Pretrained Transformer) could be explored for addressing common patient questions or providing lay-person summaries. Given the high proportion of patient portal users accessing their test results 108 110 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 and the existing research showing that many patients have questions about their results and sometimes seek information outside of the formal health care system (e.g., online health communities), 121 144 145 146 147 researchers should especially focus on developing effective tools for helping patients understand their test results at the point of viewing. HCOs should focus on preparing patients prior to key transitions in access to EHI. The two transitions highlighted in our review were increased access to EHI among all patients and autonomous viewing of medical records during adolescence. Finally, similar to the findings from another recent review, 148 EHR vendors should develop mechanisms to prevent inappropriate account creation and access (i.e., caregivers of adolescents), 149 make it easier to create a formal proxy account, and offer patients more control over what formal proxies can access, as the existing research suggests that caregivers support patients in decoding their EHI (among many other tasks).

Another key future research direction is understanding how newer mechanisms for viewing and leveraging one's clinical data will affect patient portal engagement. Specifically, another key aspect of the Cures Act was the provision that certified EHRs must provide standards-based application programming interface (API) access to EHI. This creates the potential for patients to access and leverage their data using new mechanisms such as non-HCO affiliated mobile applications (apps). This could affect portal engagement in the future if the more modular approach offered by an interconnected mobile health app ecosystem provides significant relative advantage for patients. However, given that this is currently a one-way transfer of information (EHI pushed to apps), the slow uptake of existing apps, 150 and relatively limited number of apps with the capability to download data via a standards-based API in the open app marketplace, 151 it is far from certain whether this will be a viable alternative to patient portals.

Limitations

This state-of-the-art review has several limitations. First, while we used a systematic approach for this review, it was not intended to be a systematic review and, thus, we cannot claim comprehensive coverage of the literature. Second, given the plethora of existing reviews, we chose to maximize our efforts and focused on a narrow timeframe and set of topics. It is important to note that many of the unaddressed problems highlighted in previous literature reviews are likely to still be problems despite being out of the scope of this review. For instance, many prior studies have cited usability issues with portals, 124 152 153 154 155 156 157 158 159 160 161 162 163 but it was not a major finding in our review. This does not mean that problems such as inconsistency across platforms are not still issues, especially considering that a recent survey of U.S. adults found that 44% of those with a portal account were managing two or more accounts. 164 Third, although multiple researchers performed the initial screening, collaboratively refined the inclusion and exclusion criteria, and built consensus around decisions, a single researcher was primarily responsible for the full-text screening (based on the first-round discussions), data extraction from included papers, and thematic analysis. However, it should be noted that most papers were excluded in the first stage of screening (88%, 88/100). Fourth, we chose to include articles where the research was conducted far in advance of the 2020 to 2022 publication date criterion (sometimes several years), which was particularly common in the 21st Century Cures Act research, because we felt that the results were still relevant to the topic. Finally, the authors acknowledge that there are other models of patient-accessible EHI, such as national portals which are common outside of the United States, that have been widely studied, and may include some results that are also relevant to portals, but given that there may be somewhat different levels of access to data (i.e., summary record vs. raw EHI), drawbacks, and benefits, these technologies are outside of the scope of this review.

Conclusion

While the COVID-19 pandemic and the Cures Act have catalyzed progress in providing more of what patients want in portals (e.g., video visits, faster access to test results), and consequently increased uptake and use in many places, it remains to be seen whether this progress is sustainable postpandemic. The recent trends toward understanding the implications of increased access to EHI and how to best support patients as medical records become more transparent without corresponding increased support from health care professionals, closing gaps in portal adoption and use among different sub-populations, and finding innovative ways to leverage portals to improve health and health care are important steps in the maturation of patient portals and are areas that will likely continue to be explored. It is crucial that HCOs share their innovative portal efforts, so that successful measures can be tested in other contexts, and progress can continue.

Clinical Relevance Statement

Patient portals are a critical part of the health care infrastructure. While several literature reviews focusing on patient portals have been previously published, recent external factors (i.e., the Cures Act and COVID-19 pandemic) as well as open questions and gaps from previous reviews call for a targeted investigation of the recent literature. This state-of-the-art review offers HCO examples of how to prepare for, thoughtfully implement, and evaluate major changes in care revolving around the patient portal infrastructure. Key findings include the importance of building and maintaining a strong sociotechnical infrastructure for virtual care (including the people, policies, workflows, and technologies) that can be adapted based on changing HCO needs and providing multimodal opportunities for patients to access care remotely. Based on these results, we offer several recommendations to HCOs such as better supporting patients through changes in clinical information management (e.g., from parent-managed information to adolescent-managed) and work to understand and address clinician resistance to visit note documentation changes to improve the utility of these data for patients.

Multiple-Choice Questions

  1. What strategies have health care organizations deployed to prepare for major externally driven changes to care such as increased patient access to their EHI and telehealth?

    1. Having a test period prior to full implementation.

    2. Offering regular trainings and educational materials.

    3. Developing guidelines, standard scripts, and best practices.

    4. Leveraging technological resources to support humans where possible (e.g., automating processes).

    5. All the above.

    Correct Answer: The correct answer is option e. Murugan et al reported their experience with having a test period prior to the 21st Century Cures Act going into effect (referred to as “learning mode”) to offer clinicians the opportunity to prepare for this change and get feedback on their visit note practices. Several papers credited the remaining answer options (b–d) for the successful launching or scaling up of virtual care at the beginning of the COVID-19 pandemic. With that said, most of the evidence for these practices is anecdotal and lacks an implementation science approach to evaluating their effectiveness.

  2. Which of the following is a key barrier that could affect formal proxy account registration?

    1. Adult patients are not interested in having care partners.

    2. Lack of granular patient control over what proxies can access.

    3. It is impossible to identify informal proxy use.

    Correct Answer: The best answer is option b. The literature has proposed this as a barrier, and it is possible that, without some obvious benefit such as enabling more control over the data and services for which proxies have access, patients do not see a reason to formally grant a care partner access. However, more research is needed to test the effectiveness of this feature. Adult patients are indeed interested in having care partners and the literature suggests that many are willing to grant care partners at least some access to their data. Finally, although it is challenging to identify informal proxy use of portals, there are promising mechanisms such as algorithms for identifying messages with linguistic indicators such as referencing themselves in the third person. More importantly, though, this has not been identified as a key barrier to formal proxy account registration in the literature.

Funding Statement

Funding This work was funded in part by Patient-Centered Outcomes Research Institute (PCORI) grant COVID-2020C2-10791.

Conflict of Interest None declared.

Authors' Contributions

S.T.R. and J.S.A. conceived and designed this state-of-the-art review. T.L.R., B.D.S., J.S.A., and S.T.R. developed the search strategy and participated in the first round of screening. T.L.R. conducted the second round of screening with input as needed from the other co-authors. T.L.R. led the thematic analysis with input from the other co-authors. T.L.R. drafted the manuscript. All co-authors contributed to the final manuscript.

Protection of Human and Animal Subjects

No human or animal subjects were involved in the project.

References

  • 1.Robert Wood Johnson Foundation Lessons learned. The value of personal health records and web portals to engage consumers and improve quality 2012. Accessed June 13, 2023 at:https://www.rwjf.org/en/insights/our-research/2012/07/the-value-of-personal-health-records-and-web-portals-to-engage-c.html
  • 2.HealthIT.gov. What is a patient portal? | FAQs | Providers & Professionals. Accessed November 22, 2017 at:https://www.healthit.gov/providers-professionals/faqs/what-patient-portal
  • 3.National Institutes of Health (NIH). Trends and disparities in patient portal use. Published April 2021. Accessed June 13, 2023 at:https://hints.cancer.gov/docs/Briefs/HINTS_Brief_45.pdf
  • 4.Otte-Trojel T, de Bont A, Rundall T G, van de Klundert J.What do we know about developing patient portals? a systematic literature review J Am Med Inform Assoc 201623(e1):e162–e168. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Ko H, Turner T, Jones C, Hill C. Patient-held medical records for patients with chronic disease: a systematic review. Qual Saf Health Care. 2010;19(05):e41. doi: 10.1136/qshc.2009.037531. [DOI] [PubMed] [Google Scholar]
  • 6.Goldzweig C L, Orshansky G, Paige N M et al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med. 2013;159(10):677–687. doi: 10.7326/0003-4819-159-10-201311190-00006. [DOI] [PubMed] [Google Scholar]
  • 7.Ammenwerth E, Schnell-Inderst P, Hoerbst A. The impact of electronic patient portals on patient care: a systematic review of controlled trials. J Med Internet Res. 2012;14(06):e162. doi: 10.2196/jmir.2238. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Saparova D.Motivating, influencing, and persuading patients through personal health records: a scoping review Perspect Health Inf Manag 20129(Summer):1f. [PMC free article] [PubMed] [Google Scholar]
  • 9.Ross S E, Lin C T. The effects of promoting patient access to medical records: a review. J Am Med Inform Assoc. 2003;10(02):129–138. doi: 10.1197/jamia.M1147. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Gysels M, Richardson A, Higginson I J. Does the patient-held record improve continuity and related outcomes in cancer care: a systematic review. Health Expect. 2007;10(01):75–91. doi: 10.1111/j.1369-7625.2006.00415.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Emont S.Measuring the impact of patient portals: What the Literature Tells UsCalifornia HealthCare Foundation; 2011. Accessed June 20, 2023 at:http://resource.nlm.nih.gov/101567346
  • 12.Ammenwerth E, Schnell-Inderst P, Hoerbst A. Patient empowerment by electronic health records: first results of a systematic review on the benefit of patient portals. Stud Health Technol Inform. 2011;165:63–67. [PubMed] [Google Scholar]
  • 13.Otte-Trojel T, de Bont A, Rundall T G, van de Klundert J. How outcomes are achieved through patient portals: a realist review. J Am Med Inform Assoc. 2014;21(04):751–757. doi: 10.1136/amiajnl-2013-002501. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Tapuria A, Porat T, Kalra D, Dsouza G, Xiaohui S, Curcin V. Impact of patient access to their electronic health record: systematic review. Inform Health Soc Care. 2021;46(02):192–204. doi: 10.1080/17538157.2021.1879810. [DOI] [PubMed] [Google Scholar]
  • 15.Ammenwerth E, Neyer S, Hörbst A, Mueller G, Siebert U, Schnell-Inderst P. Adult patient access to electronic health records. Cochrane Database Syst Rev. 2021;2(02):CD012707. doi: 10.1002/14651858.CD012707.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Abd-Alrazaq A A, Bewick B M, Farragher T, Gardner P. Factors that affect the use of electronic personal health records among patients: a systematic review. Int J Med Inform. 2019;126:164–175. doi: 10.1016/j.ijmedinf.2019.03.014. [DOI] [PubMed] [Google Scholar]
  • 17.Or C KL, Karsh B T. A systematic review of patient acceptance of consumer health information technology. J Am Med Inform Assoc. 2009;16(04):550–560. doi: 10.1197/jamia.M2888. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Jabour A, Jones J F.Facilitators and barriers to patients' engagements with personal health records: systematic reviewUAHCI2013, Part III. LNCS, Vol 8011.Heidelberg: Springer; 2013472–481. [Google Scholar]
  • 19.Kim K, Nahm E. Benefits of and barriers to the use of personal health records (PHR) for health management among adults. Online J Nurs Inform. 2012;16(03):1–9. [Google Scholar]
  • 20.Niazkhani Z, Toni E, Cheshmekaboodi M, Georgiou A, Pirnejad H. Barriers to patient, provider, and caregiver adoption and use of electronic personal health records in chronic care: a systematic review. BMC Med Inform Decis Mak. 2020;20(01):153. doi: 10.1186/s12911-020-01159-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Schwarz J, Bärkås A, Blease C et al. Sharing clinical notes and electronic health records with people affected by mental health conditions: scoping review. JMIR Ment Health. 2021;8(12):e34170. doi: 10.2196/34170. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Irizarry T, DeVito Dabbs A, Curran C R. Patient portals and patient engagement: a state of the science review. J Med Internet Res. 2015;17(06):e148. doi: 10.2196/jmir.4255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Lyles C R, Nelson E C, Frampton S, Dykes P C, Cemballi A G, Sarkar U.Using electronic health record portals to improve patient engagement: Research priorities and best practices Ann Intern Med 2020172(11, Suppl):S123–S129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Grossman L V, Masterson Creber R M, Benda N C, Wright D, Vawdrey D K, Ancker J S.Interventions to increase patient portal use in vulnerable populations: a systematic review J Am Med Inform Assoc 201926(8–9):855–870. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Grant M J, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26(02):91–108. doi: 10.1111/j.1471-1842.2009.00848.x. [DOI] [PubMed] [Google Scholar]
  • 26.Boyatzis R E. Thousand Oaks, CA: Sage Publications; 1998. Transforming Qualitative Information: Thematic Analysis and Code Development. [Google Scholar]
  • 27.Do the information blocking regulations (45 CFR Part 171) require actors to proactively make electronic health information (EHI) available through “patient portals,” application programming interfaces (API), or other health information technology? Accessed February 16, 2023 at:https://www.healthit.gov/faq/do-information-blocking-regulations-45-cfr-part-171-require-actors-proactively-make-electronic
  • 28.Steitz B D, Sulieman L, Wright A, Rosenbloom S T. Association of immediate release of test results to patients with implications for clinical workflow. JAMA Netw Open. 2021;4(10):e2129553. doi: 10.1001/jamanetworkopen.2021.29553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Janssen S L, Venema-Taat N, Medlock S. Anticipated benefits and concerns of sharing hospital outpatient visit notes with patients (Open Notes) in Dutch hospitals: mixed methods study. J Med Internet Res. 2021;23(08):e27764. doi: 10.2196/27764. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Bruno B, Steele S, Carbone J, Schneider K, Posk L, Rose S L. Informed or anxious: patient preferences for release of test results of increasing sensitivity on electronic patient portals. Health Technol (Berl) 2022;12(01):59–67. doi: 10.1007/s12553-021-00628-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.van Rijt A M, Hulter P, Weggelaar-Jansen A M, Ahaus K, Pluut B. Mental health care professionals' appraisal of patients' use of web-based access to their electronic health record: qualitative study. J Med Internet Res. 2021;23(08):e28045. doi: 10.2196/28045. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Murugan A, Gooding H, Greenbaum J et al. Lessons learned from OpenNotes learning mode and subsequent implementation across a pediatric health system. Appl Clin Inform. 2022;13(01):113–122. doi: 10.1055/s-0041-1741483. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Sangal R B, Powers E, Rothenberg C et al. Disparities in accessing and reading Open Notes in the emergency department upon implementation of the 21st Century CURES Act. Ann Emerg Med. 2021;78(05):593–598. doi: 10.1016/j.annemergmed.2021.06.014. [DOI] [PubMed] [Google Scholar]
  • 34.Parsons C R, Hron J D, Bourgeois F C. Preserving privacy for pediatric patients and families: use of confidential note types in pediatric ambulatory care. J Am Med Inform Assoc. 2020;27(11):1705–1710. doi: 10.1093/jamia/ocaa202. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Blok A C, Amante D J, Hogan T P et al. Impact of patient access to online VA notes on healthcare utilization and clinician documentation: a retrospective cohort study. J Gen Intern Med. 2021;36(03):592–599. doi: 10.1007/s11606-020-06304-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Jackson S L, Shucard H, Liao J M et al. Care partners reading patients' visit notes via patient portals: characteristics and perceptions. Patient Educ Couns. 2022;105(02):290–296. doi: 10.1016/j.pec.2021.08.025. [DOI] [PubMed] [Google Scholar]
  • 37.DesRoches C M, Salmi L, Dong Z, Blease C. How do older patients with chronic conditions view reading open visit notes? J Am Geriatr Soc. 2021;69(12):3497–3506. doi: 10.1111/jgs.17406. [DOI] [PubMed] [Google Scholar]
  • 38.Sarabu C, Lee T, Hogan A, Pageler N. The value of OpenNotes for pediatric patients, their families and impact on the patient-physician relationship. Appl Clin Inform. 2021;12(01):76–81. doi: 10.1055/s-0040-1721781. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Steitz B D, Turer R W, Lin C T et al. Perspectives of patients about immediate access to test results through an online patient portal. JAMA Netw Open. 2023;6(03):e233572. doi: 10.1001/jamanetworkopen.2023.3572. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Bell S K, Folcarelli P, Fossa A et al. Tackling ambulatory safety risks through patient engagement: what 10,000 patients and families say about safety-related knowledge, behaviors, and attitudes after reading visit notes. J Patient Saf. 2021;17(08):e791–e799. doi: 10.1097/PTS.0000000000000494. [DOI] [PubMed] [Google Scholar]
  • 41.Lam B D, Bourgeois F, Dong Z J, Bell S K. Speaking up about patient-perceived serious visit note errors: patient and family experiences and recommendations. J Am Med Inform Assoc. 2021;28(04):685–694. doi: 10.1093/jamia/ocaa293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Turer R W, DesRoches C M, Salmi L, Helmer T, Rosenbloom S T. Patient perceptions of receiving COVID-19 test results via an online patient portal: an open results survey. Appl Clin Inform. 2021;12(04):954–959. doi: 10.1055/s-0041-1736221. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Chimowitz H, Gerard M, Fossa A, Bourgeois F, Bell S K. Empowering informal caregivers with health information: OpenNotes as a safety strategy. Jt Comm J Qual Patient Saf. 2018;44(03):130–136. doi: 10.1016/j.jcjq.2017.09.004. [DOI] [PubMed] [Google Scholar]
  • 44.Kemp J, Short R, Bryant S, Sample L, Befera N.Patient-friendly radiology reporting-implementation and outcomes J Am Coll Radiol 202219(2, Pt B):377–383. [DOI] [PubMed] [Google Scholar]
  • 45.van Mens H JT, van Eysden M M, Nienhuis R, van Delden J JM, de Keizer N F, Cornet R. Evaluation of lexical clarification by patients reading their clinical notes: a quasi-experimental interview study. BMC Med Inform Decis Mak. 2020;20 10:278. doi: 10.1186/s12911-020-01286-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Walker J, Leveille S, Kriegel G et al. Patients contributing to visit notes: mixed methods evaluation of OurNotes. J Med Internet Res. 2021;23(11):e29951. doi: 10.2196/29951. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Hoffman P E, London Y R, Weerakoon T S, DeLucia N L. Rapidly scaling video visits during COVID-19: The ethos of virtual care at Yale Medicine. Healthc (Amst) 2020;8(04):100482. doi: 10.1016/j.hjdsi.2020.100482. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Kummer B R, Sweetnam C, Vickrey B G et al. Teleneurology expansion in response to the COVID-19 outbreak at a tertiary health system in New York City. Neurol Clin Pract. 2021;11(02):e102–e111. doi: 10.1212/CPJ.0000000000001057. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Tan-McGrory A, Schwamm L H, Kirwan C, Betancourt J R, Barreto E A. Addressing virtual care disparities for patients with limited English proficiency. Am J Manag Care. 2022;28(01):36–40. doi: 10.37765/ajmc.2022.88814. [DOI] [PubMed] [Google Scholar]
  • 50.Touson J C, Azad N, Beirne J et al. Application of the consolidated framework for implementation research model to design and implement an optimization methodology within an ambulatory setting. Appl Clin Inform. 2022;13(01):123–131. doi: 10.1055/s-0041-1741479. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Simon G E, Stewart C C, Gary M C, Richards J E. Detecting and assessing suicide ideation during the COVID-19 pandemic. Jt Comm J Qual Patient Saf. 2021;47(07):452–457. doi: 10.1016/j.jcjq.2021.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Touson J C, Azad N, Depue C, Crimmins T, Long R. An application of Harrison's system theory model to spark a rapid telehealth expansion in the time of COVID-19. Learn Health Syst. 2020;5(01):e10239. doi: 10.1002/lrh2.10239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Patel P D, Cobb J, Wright D et al. Rapid development of telehealth capabilities within pediatric patient portal infrastructure for COVID-19 care: barriers, solutions, results. J Am Med Inform Assoc. 2020;27(07):1116–1120. doi: 10.1093/jamia/ocaa065. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Lamba A H, Muralidhar K, Jain A et al. Characteristics of women enrolled in a patient portal intervention for menopause. Womens Health Rep (New Rochelle) 2020;1(01):500–510. doi: 10.1089/whr.2020.0091. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Gmunder K N, Ruiz J W, Franceschi D, Suarez M M. Factors to effective telemedicine visits during the COVID-19 pandemic: cohort study. JMIR Med Inform. 2021;9(08):e27977. doi: 10.2196/27977. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Francke J A, Groden P, Ferrer C et al. Remote enrollment into a telehealth-delivering patient portal: barriers faced in an urban population during the COVID-19 pandemic. Health Technol (Berl) 2022;12(01):227–238. doi: 10.1007/s12553-021-00614-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Leader A E, Capparella L M, Waldman L B et al. Digital literacy at an urban cancer center: implications for technology use and vulnerable patients. JCO Clin Cancer Inform. 2021;5:872–880. doi: 10.1200/CCI.21.00039. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Zachrison K S, Yan Z, Sequist Tet al. Patient characteristics associated with the successful transition to virtual care: lessons learned from the first million patients J Telemed Telecare 2021(e-pub ahead of print). 10.1177/1357633X211015547 [DOI] [PubMed] [Google Scholar]
  • 59.Davis K, Wilbur K, Metzger S et al. Symptom and needs assessment screening in oncology patients: alternate outreach methods during COVID-19. J Psychosoc Oncol. 2021;39(03):452–460. doi: 10.1080/07347332.2021.1890663. [DOI] [PubMed] [Google Scholar]
  • 60.Tashkandi E, BaAbdullah M, Zeeneldin A et al. Optimizing the communication with cancer patients during the COVID-19 pandemic: patient perspectives. Patient Prefer Adherence. 2020;14:1205–1212. doi: 10.2147/PPA.S263022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Eberly L A, Sanghavi M, Julien H M, Burger L, Chokshi N, Lewey J. Evaluation of online patient portal vs text-based blood pressure monitoring among black patients with medicaid and medicare insurance who have hypertension and cardiovascular disease. JAMA Netw Open. 2022;5(02):e2144255. doi: 10.1001/jamanetworkopen.2021.44255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Yue H, Mail V, DiSalvo M, Borba C, Piechniczek-Buczek J, Yule A. Patient preferences for patient portal-based telepsychiatry in a safety-net hospital setting during COVID-19: a cross-sectional study. JMIR Form Res. 2022;6(01):e33697. doi: 10.2196/33697. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Cher B AY, Wilson E A, Pinsky A M et al. Utility of a telephone triage hotline in response to the covid-19 pandemic: longitudinal observational study. J Med Internet Res. 2021;23(11):e28105. doi: 10.2196/28105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Judson T J, Odisho A Y, Neinstein A B et al. Rapid design and implementation of an integrated patient self-triage and self-scheduling tool for COVID-19. J Am Med Inform Assoc. 2020;27(06):860–866. doi: 10.1093/jamia/ocaa051. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Fritz B A, Ramsey B, Taylor D et al. Association of race and neighborhood disadvantage with patient engagement in a home-based COVID-19 remote monitoring program. J Gen Intern Med. 2022;37(04):838–846. doi: 10.1007/s11606-021-07207-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Chang G, Doshi A, Chandarana H, Recht M. Impact of COVID-19 workflow changes on patient throughput at outpatient imaging centers. Acad Radiol. 2021;28(03):297–306. doi: 10.1016/j.acra.2020.12.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Pairawan S S, Olmedo Temich L, de Armas S et al. Recovery of screening mammogram cancellations during COVID-19. Am Surg. 2021;87(10):1651–1655. doi: 10.1177/00031348211051695. [DOI] [PubMed] [Google Scholar]
  • 68.Thorakkattil S A, Parakkal S A, Abushoumi F et al. Online patient portal-based management of medication renewal and refill pickup in ambulatory care settings: a retrospective utilization study at tertiary care hospital in Saudi Arabia. Saudi Pharm J. 2022;30(01):45–52. doi: 10.1016/j.jsps.2021.12.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Huang M, Khurana A, Mastorakos G et al. Patient asynchronous response to coronavirus disease 2019 (COVID-19): a retrospective analysis of patient portal messages. JMIR Human Factors. 2022;9(02):e35187. doi: 10.2196/35187. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Portz J D, Brungardt A, Shanbhag P et al. Advance care planning among users of a patient portal during the COVID-19 pandemic: retrospective observational study. J Med Internet Res. 2020;22(08):e21385. doi: 10.2196/21385. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Blundell A R, Kroshinsky D, Hawryluk E B, Das S. Disparities in telemedicine access for Spanish-speaking patients during the COVID-19 crisis. Pediatr Dermatol. 2021;38(04):947–949. doi: 10.1111/pde.14489. [DOI] [PubMed] [Google Scholar]
  • 72.Frydman J L, Berkalieva A, Liu B, Scarborough B M, Mazumdar M, Smith C B. Telemedicine utilization in the ambulatory palliative care setting: are there disparities? J Pain Symptom Manage. 2022;63(03):423–429. doi: 10.1016/j.jpainsymman.2021.09.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Hsiao V, Chandereng T, Lankton R L et al. Disparities in telemedicine access: a cross-sectional study of a newly established infrastructure during the COVID-19 pandemic. Appl Clin Inform. 2021;12(03):445–458. doi: 10.1055/s-0041-1730026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Wolff J L, Kim V S, Mintz S, Stametz R, Griffin J M. An environmental scan of shared access to patient portals. J Am Med Inform Assoc. 2018;25(04):408–412. doi: 10.1093/jamia/ocx088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Szilagyi P G, Valderrama R, Vangala S et al. Pediatric patient portal use in one health system. J Am Med Inform Assoc. 2020;27(03):444–448. doi: 10.1093/jamia/ocz203. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Steitz B D, Wong J IS, Cobb J G, Carlson B, Smith G, Rosenbloom S T. Policies and procedures governing patient portal use at an academic medical center. JAMIA Open. 2019;2(04):479–488. doi: 10.1093/jamiaopen/ooz039. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Dickman Portz J, Powers J D, Casillas A et al. Characteristics of patients and proxy caregivers using patient portals in the setting of serious illness and end of life. J Palliat Med. 2021;24(11):1697–1704. doi: 10.1089/jpm.2020.0667. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Ramirez-Zohfeld V, Seltzer A, Xiong L, Morse L, Lindquist L A. Use of electronic health records by older adults, 85 years and older, and their caregivers. J Am Geriatr Soc. 2020;68(05):1078–1082. doi: 10.1111/jgs.16393. [DOI] [PubMed] [Google Scholar]
  • 79.Semere W, Crossley S, Karter A J et al. Secure messaging with physicians by proxies for patients with diabetes: findings from the ECLIPPSE study. J Gen Intern Med. 2019;34(11):2490–2496. doi: 10.1007/s11606-019-05259-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Price-Haywood E G, Harden-Barrios J, Ulep R, Luo Q. eHealth literacy: patient engagement in identifying strategies to encourage use of patient portals among older adults. Popul Health Manag. 2017;20(06):486–494. doi: 10.1089/pop.2016.0164. [DOI] [PubMed] [Google Scholar]
  • 81.Latulipe C, Quandt S A, Melius K A et al. Insights into older adult patient concerns around the caregiver proxy portal use: qualitative interview study. J Med Internet Res. 2018;20(11):e10524. doi: 10.2196/10524. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Pecina J, Duvall M J, North F. Frequency of and factors associated with care partner proxy interaction with health care teams using patient portal accounts. Telemed J E Health. 2020;26(11):1368–1372. doi: 10.1089/tmj.2019.0208. [DOI] [PubMed] [Google Scholar]
  • 83.Hodgson J, Welch M, Tucker E, Forbes T, Pye J.Utilization of EHR to improve support person engagement in health care for patients with chronic conditions J Patient Exp 2022923743735221077528 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Ordaz O H, Croff R L, Robinson L D, Shea S A, Bowles N P. Optimization of primary care among black Americans using patient portals: qualitative study. J Med Internet Res. 2021;23(06):e27820. doi: 10.2196/27820. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Latulipe C, Mazumder S F, Wilson R KW et al. Security and privacy risks associated with adult patient portal accounts in US hospitals. JAMA Intern Med. 2020;180(06):845–849. doi: 10.1001/jamainternmed.2020.0515. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Ali S B, Romero J, Morrison K, Hafeez B, Ancker J S. Focus section health IT usability: applying a task-technology fit model to adapt an electronic patient portal for patient work. Appl Clin Inform. 2018;9(01):174–184. doi: 10.1055/s-0038-1632396. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Foster B, Krasowski M D. The use of an electronic health record patient portal to access diagnostic test results by emergency patients at an academic medical center: retrospective study. J Med Internet Res. 2019;21(06):e13791. doi: 10.2196/13791. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Krasowski M D, Grieme C V, Cassady B et al. Variation in results release and patient portal access to diagnostic test results at an academic medical center. J Pathol Inform. 2017;8(01):45. doi: 10.4103/jpi.jpi_53_17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Richwine C, Johnson C, Patel V. Disparities in patient portal access and the role of providers in encouraging access and use. J Am Med Inform Assoc. 2023;30(02):308–317. doi: 10.1093/jamia/ocac227. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.El-Toukhy S, Méndez A, Collins S, Pérez-Stable E J. Barriers to patient portal access and use: evidence from the health information national trends survey. J Am Board Fam Med. 2020;33(06):953–968. doi: 10.3122/jabfm.2020.06.190402. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 91.Clarke M A, Lyden E R, Ma J et al. Sociodemographic differences and factors affecting patient portal utilization. J Racial Ethn Health Disparities. 2021;8(04):879–891. doi: 10.1007/s40615-020-00846-z. [DOI] [PubMed] [Google Scholar]
  • 92.Varady N H, d'Amonville S, Chen A F. Electronic patient portal use in orthopaedic surgery is associated with disparities, improved satisfaction, and lower no-show rates. J Bone Joint Surg Am. 2020;102(15):1336–1343. doi: 10.2106/JBJS.19.01080. [DOI] [PubMed] [Google Scholar]
  • 93.Wood K E, Greene H R, Krasowski M D. Patient portal activation and use in hospitalized children at an academic medical center. Hosp Pediatr. 2021;11(06):587–594. doi: 10.1542/hpeds.2020-003707. [DOI] [PubMed] [Google Scholar]
  • 94.Matthews E B, Savoy M, Paranjape A et al. Acceptability of health information exchange and patient portal use in depression care among underrepresented patients. J Gen Intern Med. 2022;37(15):3947–3955. doi: 10.1007/s11606-022-07427-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Jackman K P, Hightow-Weidman L, Poteat T, Wirtz A L, Kane J C, Baral S D. Evaluating psychometric determinants of willingness to adopt sexual health patient portal services among black college students: a mixed-methods approach. J Am Coll Health. 2021;69(02):190–197. doi: 10.1080/07448481.2019.1660352. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Griffin A C, Troszak L K, Van Campen J, Midboe A M, Zulman D M. Tablet distribution to veterans: an opportunity to increase patient portal adoption and use. J Am Med Inform Assoc. 2022;30(01):73–82. doi: 10.1093/jamia/ocac195. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Casillas A, Abhat A, Mahajan A et al. Portals of change: how patient portals will ultimately work for safety net populations. J Med Internet Res. 2020;22(10):e16835. doi: 10.2196/16835. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98.Shimada S L, Zocchi M S, Hogan T P et al. Impact of patient-clinical team secure messaging on communication patterns and patient experience: Randomized encouragement design trial. J Med Internet Res. 2020;22(11):e22307. doi: 10.2196/22307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Cakiroglu B, Kaya C, Kilic H H, Aksoy S H, Gözüküçük R. Did COVID-19 area change our urology practice: a retrospective analysis. Urologia. 2022;89(02):149–152. doi: 10.1177/03915603211001681. [DOI] [PubMed] [Google Scholar]
  • 100.Peeler A, Miller H, Ogungbe O et al. Centralized registry for COVID-19 research recruitment: design, development, implementation, and preliminary results. J Clin Transl Sci. 2021;5(01):e152. doi: 10.1017/cts.2021.819. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.Speaker S L, Doherty C M, Pfoh E et al. Social behaviors associated with a positive COVID-19 test result. Cureus. 2021;13(02):e13064. doi: 10.7759/cureus.13064. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 102.Bachtiger P, Adamson A, Chow J J, Sisodia R, Quint J K, Peters N S. The impact of the COVID-19 pandemic on the uptake of influenza vaccine: UK-wide observational study. JMIR Public Health Surveill. 2021;7(04):e26734. doi: 10.2196/26734. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 103.Bachtiger P, Adamson A, Maclean W A, Kelshiker M A, Quint J K, Peters N S. Determinants of shielding behavior during the covid-19 pandemic and associations with well-being among national health service patients: longitudinal observational study. JMIR Public Health Surveill. 2021;7(09):e30460. doi: 10.2196/30460. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104.Herman H S, Rosenthaler M P, Elhassan N, Weinberg J M, Satyam V R, Wasan S K. COVID-19 vaccine hesitancy among patients with inflammatory bowel diseases at a diverse safety net hospital. Dig Dis Sci. 2022;67(11):5029–5033. doi: 10.1007/s10620-022-07413-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Shermohammed M, Goren A, Lanyado Aet al. Informing patients that they are at high risk for serious complications of viral infection increases vaccination rates medRxiv 2021
  • 106.McDonald S, Basit M A, Toomay S et al. Rolling up the sleeve: equitable, efficient, and safe COVID-19 mass immunization for academic medical center employees. Appl Clin Inform. 2021;12(05):1074–1081. doi: 10.1055/s-0041-1739517. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 107.Casacchia N J, Rosenthal G E, O'Connell N S et al. Characteristics of adult primary care patients who use the patient portal: a cross-sectional analysis. Appl Clin Inform. 2022;13(05):1053–1062. doi: 10.1055/a-1951-3153. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108.Sarkar U, Karter A J, Liu J Y et al. Social disparities in internet patient portal use in diabetes: evidence that the digital divide extends beyond access. J Am Med Inform Assoc. 2011;18(03):318–321. doi: 10.1136/jamia.2010.006015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 109.Swoboda C M, DePuccio M J, Fareed N, McAlearney A S, Walker D M. Patient portals: useful for whom and for what? A cross-sectional analysis of national survey data. Appl Clin Inform. 2021;12(03):573–581. doi: 10.1055/s-0041-1731339. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 110.Tsai R, Bell E J, III, Woo H, Baldwin K, Pfeffer M A. How patients use a patient portal: an institutional case study of demographics and usage patterns. Appl Clin Inform. 2019;10(01):96–102. doi: 10.1055/s-0038-1677528. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 111.Bush R A, Vemulakonda V M, Richardson A C, Deakyne Davies S J, Chiang G J. Providing access: differences in pediatric portal activation begin at patient check-in. Appl Clin Inform. 2019;10(04):670–678. doi: 10.1055/s-0039-1695792. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 112.Tieu L, Schillinger D, Sarkar Uet al. Online patient websites for electronic health record access among vulnerable populations: portals to nowhere? J Am Med Inform Assoc 201724(e1):e47–e54. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Ancker J S, Nosal S, Hauser D, Way C, Calman N. Access policy and the digital divide in patient access to medical records. Health Policy Technol. 2017;6(01):3–11. [Google Scholar]
  • 114.Turer R W, Martin K R, Courtney D M et al. Real-time patient portal use among emergency department patients: an open results study. Appl Clin Inform. 2022;13(05):1123–1130. doi: 10.1055/a-1951-3268. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115.van Mens H JT, Hannen G EG, Nienhuis R, Bolt R J, de Keizer N F, Cornet R. Evaluation of patient-friendly diagnosis clarifications in a hospital patient portal. Appl Clin Inform. 2023;14(03):455–464. doi: 10.1055/a-2067-5310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 116.Armstrong M, Benda N C, Seier K et al. Improving cancer care communication: identifying sociodemographic differences in patient portal secure messages not authored by the patient. Appl Clin Inform. 2023;14(02):296–299. doi: 10.1055/a-2015-8679. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 117.Di Tosto G, Walker D M, Sieck C J et al. Examining the relationship between health literacy, health numeracy, and patient portal use. Appl Clin Inform. 2022;13(03):692–699. doi: 10.1055/s-0042-1751239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 118.Brewster R CL, Zhang J, Stewart M, Kaur R, Arellano M, Bourgeois F. A prescription for internet: feasibility of a tablet loaner program to address digital health inequities. Appl Clin Inform. 2023;14(02):273–278. doi: 10.1055/a-2016-7417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 119.Chang J E, Lindenfeld Z, Albert S L et al. Telephone vs. video visits during COVID-19: safety-net provider perspectives. J Am Board Fam Med. 2021;34(06):1103–1114. doi: 10.3122/jabfm.2021.06.210186. [DOI] [PubMed] [Google Scholar]
  • 120.DesRoches C, Walker J, Delbanco T. US experience with transparent medical records should reassure doctors. BMJ. 2022;379:o2969. doi: 10.1136/bmj.o2969. [DOI] [PubMed] [Google Scholar]
  • 121.Reynolds T L, Zhang J, Zheng K, Chen Y.Unpacking the use of laboratory test results in an online health community throughout the medical care trajectoryIn: Proceedings of the ACM on Human-Computer Interaction.2021;6(CSCW2):1–32.
  • 122.Martinez W, Hackstadt A J, Hickson G B et al. The my diabetes care patient portal intervention: usability and pre-post assessment. Appl Clin Inform. 2021;12(03):539–550. doi: 10.1055/s-0041-1730324. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 123.Sarkar U, Karter A J, Liu J Yet al. The literacy divide: health literacy and the use of an internet-based patient portal in an integrated health system-results from the diabetes study of northern California (DISTANCE) J Health Commun 201015(Suppl02183–196. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 124.Tulu B, Strong D, Johnson S, Bar-On I, Trudel J, Garber L.Personal health records: identifying utilization patterns from system use logs and patient interviews45th Hawaii International Conference on System Sciences.20122716–2725.; Maui, HI 2012
  • 125.Nielsen A S, Halamka J D, Kinkel R P. Internet portal use in an academic multiple sclerosis center. J Am Med Inform Assoc. 2012;19(01):128–133. doi: 10.1136/amiajnl-2011-000177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 126.Gerber D E, Laccetti A L, Chen B et al. Predictors and intensity of online access to electronic medical records among patients with cancer. J Oncol Pract. 2014;10(05):e307–e312. doi: 10.1200/JOP.2013.001347. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 127.Weingart S N, Rind D, Tofias Z, Sands D Z. Who uses the patient internet portal? The PatientSite experience. J Am Med Inform Assoc. 2006;13(01):91–95. doi: 10.1197/jamia.M1833. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 128.Sue V M, Griffin M T, Allen J Y.Individual characteristics associated with PHR use in an integrated care organizationIn: Proceedings of the Annual Hawaii International Conference on System Sciences. IEEE;20111–9.
  • 129.Wiljer D, Leonard K J, Urowitz S et al. The anxious wait: assessing the impact of patient accessible EHRs for breast cancer patients. BMC Med Inform Decis Mak. 2010;10(01):46. doi: 10.1186/1472-6947-10-46. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 130.Ralston J D, Carrell D, Reid R, Anderson M, Moran M, Hereford J. Patient web services integrated with a shared medical record: patient use and satisfaction. J Am Med Inform Assoc. 2007;14(06):798–806. doi: 10.1197/jamia.M2302. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 131.Dalal A K, Dykes P C, Collins S et al. A web-based, patient-centered toolkit to engage patients and caregivers in the acute care setting: a preliminary evaluation. J Am Med Inform Assoc. 2016;23(01):80–87. doi: 10.1093/jamia/ocv093. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 132.Alpert J M, Krist A H, Aycock R A, Kreps G L. Applying multiple methods to comprehensively evaluate a patient portal's effectiveness to convey information to patients. J Med Internet Res. 2016;18(05):e112. doi: 10.2196/jmir.5451. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 133.Jhamb M, Cavanaugh K L, Bian A et al. Disparities in electronic health record patient portal use in nephrology clinics. Clin J Am Soc Nephrol. 2015;10(11):2013–2022. doi: 10.2215/CJN.01640215. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 134.Kelly M M, Hoonakker P LT, Dean S M. Using an inpatient portal to engage families in pediatric hospital care. J Am Med Inform Assoc. 2017;24(01):153–161. doi: 10.1093/jamia/ocw070. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 135.Griffin A, Skinner A, Thornhill J, Weinberger M. Patient portals: who uses them? What features do they use? And do they reduce hospital readmissions? Appl Clin Inform. 2016;7(02):489–501. doi: 10.4338/ACI-2016-01-RA-0003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 136.Neuner J, Fedders M, Caravella M, Bradford L, Schapira M. Meaningful use and the patient portal: patient enrollment, use, and satisfaction with patient portals at a later-adopting center. Am J Med Qual. 2015;30(02):105–113. doi: 10.1177/1062860614523488. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 137.Kahn J S, Hilton J F, Van Nunnery T et al. Personal health records in a public hospital: experience at the HIV/AIDS clinic at San Francisco General Hospital. J Am Med Inform Assoc. 2010;17(02):224–228. doi: 10.1136/jamia.2009.000315. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 138.Tenforde M, Nowacki A, Jain A, Hickner J. The association between personal health record use and diabetes quality measures. J Gen Intern Med. 2012;27(04):420–424. doi: 10.1007/s11606-011-1889-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 139.Tom J O, Chen C, Zhou Y Y. Personal health record use and association with immunizations and well-child care visits recommendations. J Pediatr. 2014;164(01):112–117. doi: 10.1016/j.jpeds.2013.08.046. [DOI] [PubMed] [Google Scholar]
  • 140.Osborn C Y, Rosenbloom S T, Stenner S P et al. MyHealthAtVanderbilt: policies and procedures governing patient portal functionality. J Am Med Inform Assoc. 2011;18 01:i18–i23. doi: 10.1136/amiajnl-2011-000184. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 141.Ketterer T, West D W, Sanders V P, Hossain J, Kondo M C, Sharif I. Correlates of patient portal enrollment and activation in primary care pediatrics. Acad Pediatr. 2013;13(03):264–271. doi: 10.1016/j.acap.2013.02.002. [DOI] [PubMed] [Google Scholar]
  • 142.Perzynski A T, Roach M J, Shick S et al. Patient portals and broadband internet inequality. J Am Med Inform Assoc. 2017;24(05):927–932. doi: 10.1093/jamia/ocx020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 143.Steitz B, Cronin R M, Davis S E, Yan E, Jackson G P. Long-term patterns of patient portal use for pediatric patients at an academic medical center. Appl Clin Inform. 2017;8(03):779–793. doi: 10.4338/ACI-2017-01-RA-0005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 144.Reynolds T L, Ali N, McGregor E et al. Understanding patient questions about their medical records in an online health forum: opportunity for patient portal design. AMIA Annu Symp Proc. 2017;2017:1468–1477. [PMC free article] [PubMed] [Google Scholar]
  • 145.Sun S, Zhou X, Denny J C, Rosenbloom T, Xu H. Understanding patient-provider communication entered via a patient portal system. Proc Am Soc Inf Sci Technol. 2012;49(01):1–4. [Google Scholar]
  • 146.Zhang Z, Lu Y, Kou Y, Wu D TY, Huh-Yoo J, He Z. Understanding patient information needs about their clinical laboratory results: a study of social Q&A site. Stud Health Technol Inform. 2019;264:1403–1407. doi: 10.3233/SHTI190458. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 147.Mishra V K, Hoyt R E, Wolver S E, Yoshihashi A, Banas C. Qualitative and quantitative analysis of patients' perceptions of the patient portal experience with OpenNotes. Appl Clin Inform. 2019;10(01):10–18. doi: 10.1055/s-0038-1676588. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 148.Gleason K T, Peereboom D, Wec A, Wolff J L. Patient portals to support care partner engagement in adolescent and adult populations: a scoping review. JAMA Netw Open. 2022;5(12):e2248696. doi: 10.1001/jamanetworkopen.2022.48696. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 149.Xie J, Hogan A, McPherson T, Pageler N, Lee T, Carlson J. Creating a guardrail system to ensure appropriate activation of adolescent portal accounts. Appl Clin Inform. 2023;14(02):258–262. doi: 10.1055/a-2015-0964. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 150.Adler-Milstein J, Longhurst C. Assessment of patient use of a new approach to access health record data among 12 US health systems. JAMA Netw Open. 2019;2(08):e199544. doi: 10.1001/jamanetworkopen.2019.9544. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 151.Reynolds T L, Kaligotla M, Zheng K. Investigating the interoperable health app ecosystem at the start of the 21st Century Cures Act. AMIA Annu Symp Proc. 2023;2022:942–951. [PMC free article] [PubMed] [Google Scholar]
  • 152.Tom J O, Mangione-Smith R, Solomon C, Grossman D C. Integrated personal health record use: association with parent-reported care experiences. Pediatrics. 2012;130(01):e183–e190. doi: 10.1542/peds.2011-1786. [DOI] [PubMed] [Google Scholar]
  • 153.Emani S, Healey M, Ting D Y et al. Awareness and use of the after-Visit summary through a patient portal: evaluation of patient characteristics and an application of the theory of planned behavior. J Med Internet Res. 2016;18(04):e77. doi: 10.2196/jmir.5207. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 154.O'Leary K J, Sharma R K, Killarney A et al. Patients' and healthcare providers' perceptions of a mobile portal application for hospitalized patients. BMC Med Inform Decis Mak. 2016;16(01):123. doi: 10.1186/s12911-016-0363-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 155.Bush R A, Stahmer A C, Connelly C D. Exploring perceptions and use of the electronic health record by parents of children with autism spectrum disorder: a qualitative study. Health Informatics J. 2016;22(03):702–711. doi: 10.1177/1460458215581911. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 156.Bose-Brill S, Kretovics M, Ballenger T et al. Development of a tethered personal health record framework for early end-of-life discussions. Am J Manag Care. 2016;22(06):412–418. [PMC free article] [PubMed] [Google Scholar]
  • 157.Hess R, Bryce C L, Paone S et al. Exploring challenges and potentials of personal health records in diabetes self-management: implementation and initial assessment. Telemed J E Health. 2007;13(05):509–517. doi: 10.1089/tmj.2006.0089. [DOI] [PubMed] [Google Scholar]
  • 158.Nazi K M, Turvey C L, Klein D M, Hogan T P, Woods S S. VA OpenNotes: exploring the experiences of early patient adopters with access to clinical notes. J Am Med Inform Assoc. 2015;22(02):380–389. doi: 10.1136/amiajnl-2014-003144. [DOI] [PubMed] [Google Scholar]
  • 159.Haun J N, Lind J D, Shimada S L et al. Evaluating user experiences of the secure messaging tool on the Veterans Affairs' patient portal system. J Med Internet Res. 2014;16(03):e75. doi: 10.2196/jmir.2976. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 160.Wilcox L, Woollen J, Prey J et al. Interactive tools for inpatient medication tracking: a multi-phase study with cardiothoracic surgery patients. J Am Med Inform Assoc. 2016;23(01):144–158. doi: 10.1093/jamia/ocv160. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 161.Byczkowski T L, Munafo J K, Britto M T. Family perceptions of the usability and value of chronic disease web-based patient portals. Health Informatics J. 2014;20(02):151–162. doi: 10.1177/1460458213489054. [DOI] [PubMed] [Google Scholar]
  • 162.Makai P, Perry M, Robben S H et al. Which frail older patients use online health communities and why? A mixed methods process evaluation of use of the Health and Welfare portal. J Med Internet Res. 2014;16(12):e278. doi: 10.2196/jmir.3609. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 163.Turner A, Osterhage K, Joe J, Hartzler A, Lin L, Demiris G.Use of Patient Portals: Personal Health Information Management in Older AdultsIn: Vol 216. Studies in Health Technology and Informatics.; 2015:978. 10.3233/978-1-61499-564-7-978 [DOI] [PubMed]
  • 164.Balogun Z A, Reynolds T L.Patient Portal Adoption, Use, and Satisfaction among U.S. Adults in Late-stage COVID-19 PandemicPaper presented at: 2022 IEEE 10th International Conference on Healthcare Informatics (ICHI), Rochester, MN, USA. 2022:384–392

Articles from Applied Clinical Informatics are provided here courtesy of Thieme Medical Publishers

RESOURCES